[2025-10-29T17:00:01.105494] [INFO ] [MAIN ] Using last completed trading day: 2025-10-29 [2025-10-29T17:00:01.305682] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-29T17:00:01.305846] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-29T17:00:01.312055] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-29T17:00:01.312358] [WARN ] [STATE ] State set to: RUNNING [2025-10-29T17:00:01.312433] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-29T17:00:01.312476] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-29T17:00:01.312551] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-29T17:00:01.312585] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-29T17:00:02.386717] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-29T17:00:02.386870] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-29T17:00:02.387116] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-29T17:00:02.387731] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-29T17:00:02.387788] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-29T17:00:02.387821] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-29T17:00:02.387877] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-29T17:00:02.387909] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-29T17:00:02.387938] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-29T17:00:02.388323] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-29T17:00:02.388376] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-29T17:00:02.388568] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-29T17:00:02.388663] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-29T17:00:02.388725] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-29T17:00:02.388761] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-29T17:00:02.415257] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-29T17:00:02.441804] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-29T17:00:02.442033] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-29T17:00:02.442090] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-29T17:00:02.442145] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-29T17:00:02.442414] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-29T17:00:02.442799] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-29T17:00:02.442850] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-29T17:00:02.442887] [INFO ] [MAIN ] Starting incremental update for 2367 symbols. [2025-10-29T17:00:02.442914] [INFO ] [MAIN ] Running in parallel mode [2025-10-29T17:00:02.442997] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2367 symbols [2025-10-29T17:00:03.100386] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:03.258243] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:03.279808] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:03.317431] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-29T17:00:03.317854] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-29T17:00:03.336277] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-29T17:00:03.336708] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-29T17:00:03.335773] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:03.336957] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-29T17:00:03.337059] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-29T17:00:03.336595] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-29T17:00:03.337800] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-29T17:00:03.338007] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-29T17:00:03.337940] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-29T17:00:03.338089] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-29T17:00:03.343812] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-29T17:00:03.778175] [DEBUG] [LOCAL ] AAMI: Loaded 23756 existing records from primary storage. [2025-10-29T17:00:03.818333] [DEBUG] [LOCAL ] A: Loaded 50460 existing records from primary storage. [2025-10-29T17:00:03.818503] [INFO ] [MAIN ] AAMI: Loaded 23756 existing records. [2025-10-29T17:00:03.871936] [INFO ] [MAIN ] A: Loaded 50460 existing records. [2025-10-29T17:00:04.348537] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:04.393429] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-29T17:00:04.555384] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:04.559801] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:04.560325] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-29T17:00:04.546509] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:04.561452] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-29T17:00:04.561524] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-29T17:00:04.560625] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-29T17:00:04.561909] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-29T17:00:04.562005] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-29T17:00:04.562062] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-29T17:00:04.606060] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-29T17:00:04.618559] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-29T17:00:05.103436] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T17:00:05.140399] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-29T17:00:05.291836] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:05.312976] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-29T17:00:05.312745] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:05.314000] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-29T17:00:05.529736] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-29T17:00:05.530685] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-29T17:00:05.787020] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-29T17:00:05.788182] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-29T17:00:06.084615] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-29T17:00:06.085970] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-29T17:00:06.089694] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-29T17:00:06.120791] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-29T17:00:06.120174] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-29T17:00:06.125989] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-29T17:00:06.524551] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T17:00:06.534921] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-29T17:00:06.668178] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-29T17:00:06.669141] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-29T17:00:06.849883] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.18 seconds). [2025-10-29T17:00:06.849774] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T17:00:06.850969] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-29T17:00:06.856880] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-29T17:00:07.078419] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-29T17:00:07.079371] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-29T17:00:07.315358] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-29T17:00:07.316475] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-29T17:00:07.546280] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-29T17:00:07.556207] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-29T17:00:07.558962] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-29T17:00:07.560068] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-29T17:00:07.756088] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T17:00:07.761688] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-29T17:00:07.806360] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T17:00:07.816104] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-29T17:00:08.006108] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-29T17:00:08.006841] [INFO ] [REMOTE ] AAM: Full fetch complete (915 records). [2025-10-29T17:00:08.006923] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-29T17:00:08.251787] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-29T17:00:08.252055] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:00:08.252147] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:00:08.252238] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-29T17:00:08.252322] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-29T17:00:08.252401] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-29T17:00:08.252485] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-29T17:00:08.252565] [INFO ] [MAIN ] Update Progress: 1/2367 symbols completed. AAM took 5.8s. Estimated remaining: 3h 49m 5s. Rate: 10.3 symbols/min [2025-10-29T17:00:08.457424] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:08.516157] [DEBUG] [LOCAL ] AAP: Loaded 51543 existing records from primary storage. [2025-10-29T17:00:08.516506] [INFO ] [MAIN ] AAP: Loaded 51543 existing records. [2025-10-29T17:00:08.717090] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:08.717561] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-29T17:00:08.717678] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-29T17:00:08.718402] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-29T17:00:08.718482] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-29T17:00:09.083073] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T17:00:09.137081] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-29T17:00:09.191145] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:09.191835] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-29T17:00:09.232446] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T17:00:09.244668] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-29T17:00:09.290131] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-29T17:00:09.301356] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-29T17:00:09.954037] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T17:00:09.959979] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-29T17:00:10.493578] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T17:00:10.508214] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-29T17:00:10.573281] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T17:00:10.580572] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-29T17:00:10.680094] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T17:00:10.692224] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-29T17:00:10.988441] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-29T17:00:11.002693] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-29T17:00:11.292505] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T17:00:11.298600] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-29T17:00:11.931376] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T17:00:11.941485] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-29T17:00:12.078091] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T17:00:12.089818] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-29T17:00:12.117717] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T17:00:12.123092] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-29T17:00:12.347483] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T17:00:12.358850] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-29T17:00:12.807031] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T17:00:12.813857] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-29T17:00:13.305967] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T17:00:13.321569] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-29T17:00:13.525156] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-29T17:00:13.540243] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-29T17:00:13.717314] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-29T17:00:13.734888] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-29T17:00:14.411222] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-29T17:00:14.418244] [INFO ] [REMOTE ] AAMI: Full fetch complete (33155 records). [2025-10-29T17:00:14.418419] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-29T17:00:14.851670] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-29T17:00:14.851969] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-29T17:00:14.852813] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-29T17:00:14.852978] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-29T17:00:14.854632] [DEBUG] [LOCAL ] AAMI: Trimmed 33155 records to 23622 (keeping 200 days of data) [2025-10-29T17:00:14.898014] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-29T17:00:15.040260] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-29T17:00:15.078217] [DEBUG] [LOCAL ] AAMI: Primary data saved (23622 records). [2025-10-29T17:00:15.079080] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-29T17:00:15.079285] [INFO ] [MAIN ] Update Progress: 2/2367 symbols completed. AAMI took 12.5s. Estimated remaining: 4h 9m 2s. Rate: 9.5 symbols/min [2025-10-29T17:00:15.229701] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-29T17:00:15.296170] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-29T17:00:15.329180] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:15.362844] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-29T17:00:15.374961] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-29T17:00:15.398815] [DEBUG] [LOCAL ] AAT: Loaded 29902 existing records from primary storage. [2025-10-29T17:00:15.399092] [INFO ] [MAIN ] AAT: Loaded 29902 existing records. [2025-10-29T17:00:15.574122] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:15.574333] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-29T17:00:15.574382] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-29T17:00:15.574705] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-29T17:00:15.574763] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-29T17:00:15.944193] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:15.944832] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-29T17:00:16.599733] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T17:00:16.609956] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-29T17:00:16.810687] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-29T17:00:16.822042] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-29T17:00:16.922337] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-29T17:00:16.929086] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-29T17:00:17.715432] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T17:00:17.721277] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-29T17:00:18.202745] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-10-29T17:00:18.258852] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-29T17:00:18.258406] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-29T17:00:18.277673] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-29T17:00:18.444776] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-29T17:00:18.455716] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-29T17:00:18.584955] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T17:00:18.591883] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-29T17:00:19.479548] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T17:00:19.487092] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-29T17:00:19.636945] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:00:19.648367] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-29T17:00:19.778542] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T17:00:19.788537] [INFO ] [REMOTE ] A: Full fetch complete (73170 records). [2025-10-29T17:00:19.788698] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-29T17:00:19.789490] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:00:19.789580] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:00:19.789677] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:00:19.789765] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-29T17:00:19.789844] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-29T17:00:19.789895] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-10-29T17:00:19.790355] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-10-29T17:00:19.790867] [INFO ] [MAIN ] Update Progress: 3/2367 symbols completed. A took 17.3s. Estimated remaining: 3h 47m 50s. Rate: 10.4 symbols/min [2025-10-29T17:00:19.969234] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:19.969461] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-29T17:00:19.969558] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-29T17:00:19.969750] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-29T17:00:19.969811] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-29T17:00:19.969857] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-29T17:00:19.969978] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-29T17:00:20.265241] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-29T17:00:20.352876] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-29T17:00:20.420900] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:20.421360] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-29T17:00:20.440540] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T17:00:20.448463] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-29T17:00:20.657943] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:00:20.658264] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-29T17:00:20.658372] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:00:20.658461] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-29T17:00:20.658545] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:00:20.658639] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-29T17:00:20.658746] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-29T17:00:20.658788] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-29T17:00:20.658829] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-29T17:00:20.658909] [INFO ] [MAIN ] Update Progress: 4/2367 symbols completed. AAUC took 0.9s. Estimated remaining: 2h 59m 21s. Rate: 13.2 symbols/min [2025-10-29T17:00:20.853044] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:20.853235] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-29T17:00:20.853281] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-29T17:00:20.853399] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-29T17:00:20.853455] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-29T17:00:20.853496] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-29T17:00:20.853529] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-29T17:00:21.205861] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:21.206235] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-29T17:00:21.337803] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-29T17:00:21.349615] [INFO ] [REMOTE ] AA: Full fetch complete (77739 records). [2025-10-29T17:00:21.349831] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-29T17:00:21.615409] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:00:21.677085] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-29T17:00:21.808879] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-29T17:00:21.809074] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-29T17:00:21.810127] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-29T17:00:21.810228] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-29T17:00:21.826063] [DEBUG] [LOCAL ] AA: Trimmed 77739 records to 53622 (keeping 200 days of data) [2025-10-29T17:00:21.897762] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-29T17:00:21.947164] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-29T17:00:22.184402] [DEBUG] [LOCAL ] AA: Primary data saved (53622 records). [2025-10-29T17:00:22.184597] [INFO ] [MAIN ] AA: Full history saved. [2025-10-29T17:00:22.184777] [INFO ] [MAIN ] Update Progress: 5/2367 symbols completed. AA took 19.7s. Estimated remaining: 2h 35m 26s. Rate: 15.2 symbols/min [2025-10-29T17:00:22.312793] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T17:00:22.323371] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-29T17:00:22.393329] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:22.442728] [DEBUG] [LOCAL ] ABBV: Loaded 53674 existing records from primary storage. [2025-10-29T17:00:22.443048] [INFO ] [MAIN ] ABBV: Loaded 53674 existing records. [2025-10-29T17:00:22.629597] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:22.629959] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-29T17:00:22.630202] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-29T17:00:22.637259] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-29T17:00:22.649795] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-29T17:00:22.656486] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T17:00:22.766147] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-29T17:00:23.052662] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:23.053695] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-29T17:00:23.103852] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T17:00:23.115389] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-29T17:00:23.545839] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T17:00:23.559182] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-29T17:00:23.761971] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-29T17:00:23.768559] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-29T17:00:24.496252] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T17:00:24.506946] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-29T17:00:24.560682] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-29T17:00:24.569402] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-29T17:00:24.596664] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T17:00:24.608767] [INFO ] [REMOTE ] AAP: Full fetch complete (74964 records). [2025-10-29T17:00:24.608895] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-29T17:00:25.034948] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-29T17:00:25.036066] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T17:00:25.036158] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-29T17:00:25.045570] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-29T17:00:25.046134] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-29T17:00:25.046567] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-29T17:00:25.048379] [DEBUG] [LOCAL ] AAP: Trimmed 74964 records to 51534 (keeping 200 days of data) [2025-10-29T17:00:25.346546] [DEBUG] [LOCAL ] AAP: Primary data saved (51534 records). [2025-10-29T17:00:25.346703] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-29T17:00:25.347048] [INFO ] [MAIN ] Update Progress: 6/2367 symbols completed. AAP took 17.1s. Estimated remaining: 2h 30m 13s. Rate: 15.7 symbols/min [2025-10-29T17:00:25.523326] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:25.523551] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-29T17:00:25.523679] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-29T17:00:25.523817] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-29T17:00:25.523876] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-29T17:00:25.523927] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-29T17:00:25.523959] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-29T17:00:25.792849] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T17:00:25.838964] [INFO ] [REMOTE ] AAT: Full fetch complete (43077 records). [2025-10-29T17:00:25.849891] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-29T17:00:25.959268] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:25.989438] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-29T17:00:26.348785] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-29T17:00:26.349021] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-29T17:00:26.349570] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-29T17:00:26.349707] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-29T17:00:26.352698] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-29T17:00:26.363733] [DEBUG] [LOCAL ] AAT: Trimmed 43077 records to 29845 (keeping 200 days of data) [2025-10-29T17:00:26.363568] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-29T17:00:26.474782] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T17:00:26.493907] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-29T17:00:26.573880] [DEBUG] [LOCAL ] AAT: Primary data saved (29845 records). [2025-10-29T17:00:26.574025] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-29T17:00:26.574107] [INFO ] [MAIN ] Update Progress: 7/2367 symbols completed. AAT took 11.5s. Estimated remaining: 2h 15m 36s. Rate: 17.4 symbols/min [2025-10-29T17:00:26.744505] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:26.791397] [DEBUG] [LOCAL ] ABEV: Loaded 53276 existing records from primary storage. [2025-10-29T17:00:26.791721] [INFO ] [MAIN ] ABEV: Loaded 53276 existing records. [2025-10-29T17:00:26.948759] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T17:00:26.974597] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-29T17:00:26.995784] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:26.996724] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-29T17:00:26.996796] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-29T17:00:26.997382] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-29T17:00:26.997445] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-29T17:00:27.366555] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:27.367020] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-29T17:00:27.384830] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T17:00:27.391321] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-29T17:00:27.837986] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T17:00:27.849905] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-29T17:00:27.870190] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T17:00:27.876871] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-29T17:00:28.072938] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T17:00:28.077635] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-29T17:00:28.659906] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T17:00:28.670340] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-29T17:00:28.847172] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T17:00:28.854383] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-29T17:00:28.960152] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T17:00:28.965665] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-29T17:00:29.629088] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-29T17:00:29.640110] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-29T17:00:29.758689] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-29T17:00:29.763975] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-29T17:00:29.867250] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T17:00:29.877972] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-29T17:00:29.939606] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T17:00:29.950042] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-29T17:00:30.375188] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-29T17:00:30.383527] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-29T17:00:30.705686] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-29T17:00:30.712053] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-29T17:00:31.271450] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-29T17:00:31.276968] [INFO ] [REMOTE ] AB: Full fetch complete (43743 records). [2025-10-29T17:00:31.277127] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-29T17:00:31.694769] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-29T17:00:31.757429] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-29T17:00:31.757664] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-29T17:00:31.758822] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-29T17:00:31.759354] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-29T17:00:31.759441] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-29T17:00:31.800094] [DEBUG] [LOCAL ] AB: Trimmed 43743 records to 23912 (keeping 200 days of data) [2025-10-29T17:00:31.810479] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-29T17:00:31.881929] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:00:31.891480] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-29T17:00:31.937917] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-29T17:00:31.986231] [DEBUG] [LOCAL ] AB: Primary data saved (23912 records). [2025-10-29T17:00:31.986364] [INFO ] [MAIN ] AB: Full history saved. [2025-10-29T17:00:31.986434] [INFO ] [MAIN ] Update Progress: 8/2367 symbols completed. AB took 11.3s. Estimated remaining: 2h 25m 12s. Rate: 16.2 symbols/min [2025-10-29T17:00:32.157561] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:32.157774] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-10-29T17:00:32.157819] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-10-29T17:00:32.157937] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-29T17:00:32.157979] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-29T17:00:32.158021] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-29T17:00:32.158054] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-29T17:00:32.535358] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:32.535758] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-29T17:00:32.896142] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T17:00:32.903598] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-29T17:00:33.256095] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T17:00:33.269088] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-29T17:00:33.320804] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-29T17:00:33.320436] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-29T17:00:33.336492] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-29T17:00:33.338604] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-29T17:00:33.758016] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-29T17:00:33.764842] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-29T17:00:33.923025] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-29T17:00:33.926834] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-29T17:00:34.553683] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T17:00:34.565253] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-29T17:00:34.578850] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-29T17:00:34.583942] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-29T17:00:34.603446] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T17:00:34.610927] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-29T17:00:35.195619] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-29T17:00:35.207329] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-29T17:00:35.537630] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T17:00:35.543959] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-29T17:00:35.674114] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T17:00:35.684869] [INFO ] [REMOTE ] ABCB: Full fetch complete (44934 records). [2025-10-29T17:00:35.685014] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-29T17:00:36.136635] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-29T17:00:36.136939] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-29T17:00:36.138159] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-29T17:00:36.139455] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-29T17:00:36.139598] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-29T17:00:36.159686] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-29T17:00:36.161794] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T17:00:36.166288] [DEBUG] [LOCAL ] ABCB: Trimmed 44934 records to 30076 (keeping 200 days of data) [2025-10-29T17:00:36.166187] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-29T17:00:36.354852] [DEBUG] [LOCAL ] ABCB: Primary data saved (30076 records). [2025-10-29T17:00:36.355168] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-29T17:00:36.355253] [INFO ] [MAIN ] Update Progress: 9/2367 symbols completed. ABCB took 11.0s. Estimated remaining: 2h 28m 5s. Rate: 15.9 symbols/min [2025-10-29T17:00:36.556535] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:36.556751] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-29T17:00:36.556799] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-29T17:00:36.556939] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-29T17:00:36.557011] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-29T17:00:36.557092] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-29T17:00:36.557151] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-29T17:00:36.987845] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:36.988864] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-29T17:00:36.989531] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T17:00:36.994505] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-29T17:00:37.028151] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-29T17:00:37.039631] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-29T17:00:37.490555] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T17:00:37.502215] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-29T17:00:37.754929] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T17:00:37.772632] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-29T17:00:37.773408] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T17:00:37.779691] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-29T17:00:38.505507] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-29T17:00:38.529721] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-29T17:00:38.530811] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T17:00:38.536592] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-29T17:00:38.564087] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T17:00:38.571639] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-29T17:00:38.642455] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-29T17:00:38.655395] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-29T17:00:39.110851] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-29T17:00:39.116762] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-29T17:00:39.178131] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-29T17:00:39.189882] [INFO ] [REMOTE ] ABBV: Full fetch complete (77839 records). [2025-10-29T17:00:39.190074] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-29T17:00:39.601250] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-29T17:00:39.601359] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-29T17:00:39.602309] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-29T17:00:39.602394] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-29T17:00:39.633388] [DEBUG] [LOCAL ] ABBV: Trimmed 77839 records to 53674 (keeping 200 days of data) [2025-10-29T17:00:39.635018] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T17:00:39.643143] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-29T17:00:39.983293] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T17:00:39.993356] [INFO ] [REMOTE ] ABG: Full fetch complete (26858 records). [2025-10-29T17:00:39.995242] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-29T17:00:40.055773] [DEBUG] [LOCAL ] ABBV: Primary data saved (53674 records). [2025-10-29T17:00:40.077767] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-29T17:00:40.106499] [INFO ] [MAIN ] Update Progress: 10/2367 symbols completed. ABBV took 17.9s. Estimated remaining: 2h 27m 57s. Rate: 15.9 symbols/min [2025-10-29T17:00:40.420527] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-29T17:00:40.587325] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-29T17:00:40.615063] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:40.709361] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-29T17:00:40.709718] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-29T17:00:40.710069] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-29T17:00:40.710111] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-29T17:00:40.711274] [DEBUG] [LOCAL ] ABG: Trimmed 26858 records to 17324 (keeping 200 days of data) [2025-10-29T17:00:40.819066] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T17:00:40.846225] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-29T17:00:40.861546] [DEBUG] [LOCAL ] ABG: Primary data saved (17324 records). [2025-10-29T17:00:40.861871] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-29T17:00:40.861956] [INFO ] [MAIN ] Update Progress: 11/2367 symbols completed. ABG took 8.9s. Estimated remaining: 2h 17m 9s. Rate: 17.2 symbols/min [2025-10-29T17:00:40.973871] [DEBUG] [LOCAL ] ABR: Loaded 51778 existing records from primary storage. [2025-10-29T17:00:40.984944] [INFO ] [MAIN ] ABR: Loaded 51778 existing records. [2025-10-29T17:00:41.165823] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:41.316160] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:41.316514] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-29T17:00:41.316578] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-29T17:00:41.317801] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-29T17:00:41.317876] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-29T17:00:41.490845] [DEBUG] [LOCAL ] ABT: Loaded 53625 existing records from primary storage. [2025-10-29T17:00:41.502076] [INFO ] [MAIN ] ABT: Loaded 53625 existing records. [2025-10-29T17:00:41.892562] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:41.924487] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-29T17:00:41.947367] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-29T17:00:41.953477] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:41.954025] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-29T17:00:41.960626] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-29T17:00:41.969462] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-29T17:00:42.008169] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T17:00:42.079856] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-29T17:00:42.364394] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:42.364944] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-29T17:00:42.397291] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-29T17:00:42.409326] [INFO ] [REMOTE ] ABEV: Full fetch complete (77327 records). [2025-10-29T17:00:42.409492] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-29T17:00:42.884662] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-29T17:00:42.884780] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-29T17:00:42.885551] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-29T17:00:42.885621] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-29T17:00:42.887736] [DEBUG] [LOCAL ] ABEV: Trimmed 77327 records to 53277 (keeping 200 days of data) [2025-10-29T17:00:43.185483] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T17:00:43.198355] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-29T17:00:43.218268] [DEBUG] [LOCAL ] ABEV: Primary data saved (53277 records). [2025-10-29T17:00:43.218365] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-29T17:00:43.220701] [INFO ] [MAIN ] Update Progress: 12/2367 symbols completed. ABEV took 16.6s. Estimated remaining: 2h 13m 23s. Rate: 17.7 symbols/min [2025-10-29T17:00:43.404835] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:43.405098] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-29T17:00:43.405148] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-29T17:00:43.405260] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-29T17:00:43.405303] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-29T17:00:43.405345] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-29T17:00:43.405378] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-29T17:00:43.777325] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:43.777775] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-29T17:00:43.806400] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-29T17:00:43.816487] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-29T17:00:44.095527] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-29T17:00:44.103365] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-29T17:00:44.132631] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-29T17:00:44.143492] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-29T17:00:44.722933] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T17:00:44.728745] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-29T17:00:44.962234] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-29T17:00:45.091493] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T17:00:45.193635] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-29T17:00:45.496238] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T17:00:45.591595] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T17:00:45.993629] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-29T17:00:46.394807] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T17:00:46.793548] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-29T17:00:46.893290] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T17:00:47.593563] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-29T17:00:47.976518] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-29T17:00:47.984985] [INFO ] [REMOTE ] ABM: Full fetch complete (45114 records). [2025-10-29T17:00:47.985136] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-29T17:00:48.400180] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-29T17:00:48.443334] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-29T17:00:48.443413] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-29T17:00:48.443924] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-29T17:00:48.444004] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-29T17:00:48.445157] [DEBUG] [LOCAL ] ABM: Trimmed 45114 records to 31578 (keeping 200 days of data) [2025-10-29T17:00:48.565011] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-29T17:00:48.662767] [DEBUG] [LOCAL ] ABM: Primary data saved (31578 records). [2025-10-29T17:00:48.662904] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-29T17:00:48.662976] [INFO ] [MAIN ] Update Progress: 13/2367 symbols completed. ABM took 12.3s. Estimated remaining: 2h 19m 29s. Rate: 16.9 symbols/min [2025-10-29T17:00:48.836978] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:00:48.869715] [DEBUG] [LOCAL ] ACCO: Loaded 36225 existing records from primary storage. [2025-10-29T17:00:48.870012] [INFO ] [MAIN ] ACCO: Loaded 36225 existing records. [2025-10-29T17:00:49.046077] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:00:49.046362] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-29T17:00:49.046422] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-29T17:00:49.046753] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-29T17:00:49.046809] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-29T17:00:49.194945] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-29T17:00:49.410017] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:00:49.828384] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T17:00:49.993589] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-29T17:00:50.733049] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-29T17:00:50.793600] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-29T17:00:51.089198] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T17:00:51.593557] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-29T17:00:52.074532] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:00:52.393552] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-29T17:00:53.033535] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T17:00:53.193586] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-29T17:00:53.306433] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T17:00:53.993620] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-29T17:00:54.655050] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T17:00:54.793544] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-29T17:00:55.065631] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T17:00:55.593599] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-29T17:00:56.349063] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-29T17:00:56.380908] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-29T17:00:56.393510] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-29T17:00:57.028286] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T17:00:57.193581] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-29T17:00:57.993576] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-29T17:00:58.436132] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T17:00:58.793567] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-29T17:00:58.911562] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T17:00:59.593603] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-29T17:01:00.028112] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T17:01:00.356331] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T17:01:00.393521] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-29T17:01:01.193633] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-29T17:01:01.422064] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T17:01:01.993688] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-29T17:01:02.359463] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T17:01:02.793608] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-29T17:01:03.341696] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T17:01:03.514820] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-29T17:01:03.593605] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-29T17:01:04.393596] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-29T17:01:04.481976] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-29T17:01:04.488413] [INFO ] [REMOTE ] ACA: Full fetch complete (34033 records). [2025-10-29T17:01:04.488552] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-29T17:01:04.868205] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-29T17:01:04.868296] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-29T17:01:04.868706] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-29T17:01:04.868772] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-29T17:01:04.869725] [DEBUG] [LOCAL ] ACA: Trimmed 34033 records to 21893 (keeping 200 days of data) [2025-10-29T17:01:05.003235] [DEBUG] [LOCAL ] ACA: Primary data saved (21893 records). [2025-10-29T17:01:05.003371] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-29T17:01:05.003443] [INFO ] [MAIN ] Update Progress: 14/2367 symbols completed. ACA took 21.8s. Estimated remaining: 2h 55m 15s. Rate: 13.4 symbols/min [2025-10-29T17:01:05.172314] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:01:05.196987] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-29T17:01:05.197700] [DEBUG] [LOCAL ] ACEL: Loaded 25609 existing records from primary storage. [2025-10-29T17:01:05.199096] [INFO ] [MAIN ] ACEL: Loaded 25609 existing records. [2025-10-29T17:01:05.376741] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:01:05.377002] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-29T17:01:05.377050] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-29T17:01:05.377325] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-29T17:01:05.377382] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-29T17:01:05.744238] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:01:05.774268] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T17:01:05.993576] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-29T17:01:06.793523] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-29T17:01:06.855042] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T17:01:06.920853] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-29T17:01:07.593575] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-29T17:01:07.819888] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T17:01:08.393576] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-29T17:01:09.126803] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-29T17:01:09.193563] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-29T17:01:09.213552] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-29T17:01:09.993596] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-29T17:01:10.660808] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T17:01:10.793552] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-29T17:01:10.955716] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T17:01:11.593567] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-29T17:01:12.202982] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T17:01:12.393597] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-29T17:01:12.485852] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T17:01:13.019605] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T17:01:13.031162] [INFO ] [REMOTE ] ABT: Full fetch complete (77774 records). [2025-10-29T17:01:13.031326] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-29T17:01:13.193684] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-29T17:01:13.444224] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-29T17:01:13.444313] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-29T17:01:13.445104] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-29T17:01:13.445174] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-29T17:01:13.446863] [DEBUG] [LOCAL ] ABT: Trimmed 77774 records to 53625 (keeping 200 days of data) [2025-10-29T17:01:13.798261] [DEBUG] [LOCAL ] ABT: Primary data saved (53625 records). [2025-10-29T17:01:13.798409] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-29T17:01:13.798494] [INFO ] [MAIN ] Update Progress: 15/2367 symbols completed. ABT took 32.9s. Estimated remaining: 3h 6m 29s. Rate: 12.6 symbols/min [2025-10-29T17:01:13.977184] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:01:14.005994] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-29T17:01:14.031320] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-29T17:01:14.031691] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-29T17:01:14.221985] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:01:14.222243] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-29T17:01:14.222310] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-29T17:01:14.229572] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-29T17:01:14.242291] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-29T17:01:14.290366] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T17:01:14.647442] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:01:14.793613] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-29T17:01:15.468341] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T17:01:15.479975] [INFO ] [REMOTE ] ABR: Full fetch complete (74944 records). [2025-10-29T17:01:15.480231] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-29T17:01:15.481426] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:01:15.481533] [FATAL] [MAIN ] ABR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:01:15.481579] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:01:15.481623] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-29T17:01:15.481918] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-29T17:01:15.481997] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-10-29T17:01:15.482191] [DEBUG] [LOCAL ] ABR: Deleted derivative data file. [2025-10-29T17:01:15.482282] [INFO ] [MAIN ] Update Progress: 16/2367 symbols completed. ABR took 35.4s. Estimated remaining: 2h 58m 52s. Rate: 13.1 symbols/min [2025-10-29T17:01:15.598826] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-29T17:01:15.673378] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:01:15.673715] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-29T17:01:15.673772] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-29T17:01:15.673924] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-29T17:01:15.673967] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-29T17:01:15.674010] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-29T17:01:15.674044] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-29T17:01:16.062616] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:01:16.393537] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-29T17:01:16.505336] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T17:01:17.010507] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-29T17:01:17.193561] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-29T17:01:17.426515] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T17:01:17.993557] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-29T17:01:18.793571] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-29T17:01:19.138942] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-29T17:01:19.388529] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T17:01:19.593550] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-29T17:01:19.721971] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T17:01:20.393562] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-29T17:01:21.167627] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-29T17:01:21.193583] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-29T17:01:21.446633] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-29T17:01:21.993608] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-29T17:01:22.212431] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T17:01:22.220631] [INFO ] [REMOTE ] ACCO: Full fetch complete (53714 records). [2025-10-29T17:01:22.220840] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-29T17:01:22.637122] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-29T17:01:22.637211] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-29T17:01:22.637857] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-29T17:01:22.637925] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-29T17:01:22.639196] [DEBUG] [LOCAL ] ACCO: Trimmed 53714 records to 36145 (keeping 200 days of data) [2025-10-29T17:01:22.766259] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T17:01:22.814824] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-29T17:01:22.870119] [DEBUG] [LOCAL ] ACCO: Primary data saved (36145 records). [2025-10-29T17:01:22.870254] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-29T17:01:22.870339] [INFO ] [MAIN ] Update Progress: 17/2367 symbols completed. ACCO took 34.2s. Estimated remaining: 3h 5m 18s. Rate: 12.7 symbols/min [2025-10-29T17:01:23.048188] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:01:23.048375] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-10-29T17:01:23.048416] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-10-29T17:01:23.048536] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-29T17:01:23.048578] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-29T17:01:23.048620] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-29T17:01:23.048684] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-29T17:01:23.426961] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:01:23.593535] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-29T17:01:23.613837] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-29T17:01:24.393623] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-29T17:01:24.867718] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T17:01:25.193576] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-29T17:01:25.558613] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T17:01:25.993622] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-29T17:01:26.465378] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T17:01:26.793559] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-29T17:01:27.089281] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T17:01:27.593572] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-29T17:01:28.393588] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-29T17:01:28.533295] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-29T17:01:28.712111] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-29T17:01:29.193587] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-29T17:01:29.929794] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T17:01:29.993536] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-29T17:01:30.034056] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-29T17:01:30.039422] [INFO ] [REMOTE ] ACEL: Full fetch complete (38582 records). [2025-10-29T17:01:30.039514] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-29T17:01:30.419357] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-29T17:01:30.419434] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-29T17:01:30.419867] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-29T17:01:30.419934] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-29T17:01:30.420806] [DEBUG] [LOCAL ] ACEL: Trimmed 38582 records to 25448 (keeping 200 days of data) [2025-10-29T17:01:30.565489] [DEBUG] [LOCAL ] ACEL: Primary data saved (25448 records). [2025-10-29T17:01:30.565620] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-29T17:01:30.565734] [INFO ] [MAIN ] Update Progress: 18/2367 symbols completed. ACEL took 25.6s. Estimated remaining: 3h 11m 40s. Rate: 12.3 symbols/min [2025-10-29T17:01:30.737344] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:01:30.737527] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-10-29T17:01:30.737564] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-10-29T17:01:30.737752] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-29T17:01:30.737822] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-29T17:01:30.737878] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-29T17:01:30.737912] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-29T17:01:30.803495] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-29T17:01:31.107998] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:01:31.593555] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-29T17:01:31.956025] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-29T17:01:32.110547] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T17:01:32.393703] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-29T17:01:32.780904] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T17:01:33.193618] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-29T17:01:33.993586] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-29T17:01:34.426557] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-29T17:01:34.599605] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-29T17:01:34.793572] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-29T17:01:35.209038] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T17:01:35.593561] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-29T17:01:36.393590] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-29T17:01:36.854857] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-29T17:01:36.905873] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T17:01:37.193595] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-29T17:01:37.751624] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T17:01:37.993590] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-29T17:01:38.506349] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T17:01:38.793563] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-29T17:01:39.144515] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T17:01:39.593579] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-29T17:01:40.305108] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-29T17:01:40.393589] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-29T17:01:41.193598] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-29T17:01:41.427160] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-29T17:01:41.993628] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-29T17:01:42.574184] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-29T17:01:42.793614] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-29T17:01:42.885371] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-29T17:01:43.281617] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T17:01:43.593564] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-29T17:01:44.303537] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T17:01:44.317330] [INFO ] [REMOTE ] ACI: Full fetch complete (77227 records). [2025-10-29T17:01:44.317516] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-29T17:01:44.398658] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-29T17:01:44.743602] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-29T17:01:44.743852] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-29T17:01:44.744730] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-29T17:01:44.744867] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-29T17:01:44.746861] [DEBUG] [LOCAL ] ACI: Trimmed 77227 records to 53280 (keeping 200 days of data) [2025-10-29T17:01:44.868786] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T17:01:45.108684] [DEBUG] [LOCAL ] ACI: Primary data saved (53280 records). [2025-10-29T17:01:45.108834] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-29T17:01:45.108907] [INFO ] [MAIN ] Update Progress: 19/2367 symbols completed. ACI took 29.6s. Estimated remaining: 3h 31m 27s. Rate: 11.1 symbols/min [2025-10-29T17:01:45.198686] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-29T17:01:45.293005] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:01:45.327256] [DEBUG] [LOCAL ] ACP: Loaded 30672 existing records from primary storage. [2025-10-29T17:01:45.327767] [INFO ] [MAIN ] ACP: Loaded 30672 existing records. [2025-10-29T17:01:45.512845] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:01:45.513091] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-29T17:01:45.513141] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-29T17:01:45.513940] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-29T17:01:45.513998] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-29T17:01:45.912239] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:01:45.943611] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-29T17:01:45.993523] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-29T17:01:46.302602] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-29T17:01:46.793603] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-29T17:01:47.404155] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T17:01:47.593568] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-29T17:01:47.922956] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T17:01:48.393569] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-29T17:01:49.193558] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-29T17:01:49.559883] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T17:01:49.613162] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-29T17:01:49.993543] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-29T17:01:50.753812] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-29T17:01:50.793568] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-29T17:01:51.187965] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T17:01:51.602472] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-29T17:01:51.604898] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T17:01:52.393618] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-29T17:01:52.793504] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T17:01:52.802455] [INFO ] [REMOTE ] ACM: Full fetch complete (63025 records). [2025-10-29T17:01:52.802620] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-29T17:01:53.201843] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-29T17:01:53.205000] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-29T17:01:53.205103] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-29T17:01:53.205751] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-29T17:01:53.206838] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-29T17:01:53.208296] [DEBUG] [LOCAL ] ACM: Trimmed 63025 records to 42213 (keeping 200 days of data) [2025-10-29T17:01:53.464316] [DEBUG] [LOCAL ] ACM: Primary data saved (42213 records). [2025-10-29T17:01:53.464434] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-29T17:01:53.464500] [INFO ] [MAIN ] Update Progress: 20/2367 symbols completed. ACM took 30.6s. Estimated remaining: 3h 37m 8s. Rate: 10.8 symbols/min [2025-10-29T17:01:53.661774] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:01:53.668939] [DEBUG] [LOCAL ] ACR: Loaded 5179 existing records from primary storage. [2025-10-29T17:01:53.669101] [INFO ] [MAIN ] ACR: Loaded 5179 existing records. [2025-10-29T17:01:53.849107] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:01:53.849331] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-29T17:01:53.849378] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-29T17:01:53.849538] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-29T17:01:53.849576] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-29T17:01:53.999634] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-29T17:01:54.213160] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:01:54.235288] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T17:01:54.735281] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-29T17:01:54.746878] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-29T17:01:54.747023] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-29T17:01:54.803197] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-29T17:01:55.159487] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-29T17:01:55.159636] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-29T17:01:55.160601] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-29T17:01:55.160690] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-29T17:01:55.162331] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-29T17:01:55.479618] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-29T17:01:55.479778] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-29T17:01:55.479860] [INFO ] [MAIN ] Update Progress: 21/2367 symbols completed. ACHR took 41.7s. Estimated remaining: 3h 30m 28s. Rate: 11.1 symbols/min [2025-10-29T17:01:55.598791] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-29T17:01:55.654502] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:01:55.685205] [DEBUG] [LOCAL ] ACRE: Loaded 32581 existing records from primary storage. [2025-10-29T17:01:55.685462] [INFO ] [MAIN ] ACRE: Loaded 32581 existing records. [2025-10-29T17:01:55.873466] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:01:55.874100] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-29T17:01:55.874238] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-29T17:01:55.875454] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-29T17:01:55.875514] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-29T17:01:56.039956] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-29T17:01:56.258220] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-29T17:01:56.259615] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-29T17:01:56.351532] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:01:56.393518] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-29T17:01:57.193565] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-29T17:01:57.508335] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T17:01:57.993633] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-29T17:01:58.367072] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T17:01:58.465837] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T17:01:58.793582] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-29T17:01:59.250705] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T17:01:59.593590] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-29T17:02:00.387210] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T17:02:00.393610] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-29T17:02:00.927832] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T17:02:01.193604] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-29T17:02:01.993572] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-29T17:02:02.162147] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T17:02:02.793611] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-29T17:02:03.230186] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T17:02:03.593593] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-29T17:02:03.814805] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T17:02:04.393579] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-29T17:02:04.970816] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T17:02:05.193590] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-29T17:02:05.904117] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T17:02:05.993560] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-29T17:02:06.793551] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-29T17:02:06.871778] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T17:02:06.941087] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-29T17:02:07.435722] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-29T17:02:07.593569] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-29T17:02:08.393579] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-29T17:02:09.193608] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-29T17:02:09.405070] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T17:02:09.452426] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-29T17:02:09.465387] [INFO ] [REMOTE ] ACN: Full fetch complete (77422 records). [2025-10-29T17:02:09.465670] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-29T17:02:09.995755] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-29T17:02:10.070761] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-29T17:02:10.070892] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-29T17:02:10.072462] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-29T17:02:10.072579] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-29T17:02:10.074917] [DEBUG] [LOCAL ] ACN: Trimmed 77422 records to 53429 (keeping 200 days of data) [2025-10-29T17:02:10.268943] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T17:02:10.650843] [DEBUG] [LOCAL ] ACN: Primary data saved (53429 records). [2025-10-29T17:02:10.651003] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-29T17:02:10.651083] [INFO ] [MAIN ] Update Progress: 22/2367 symbols completed. ACN took 40.1s. Estimated remaining: 3h 47m 46s. Rate: 10.3 symbols/min [2025-10-29T17:02:10.800746] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-29T17:02:10.841990] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:02:10.850849] [DEBUG] [LOCAL ] ACV: Loaded 7282 existing records from primary storage. [2025-10-29T17:02:10.851089] [INFO ] [MAIN ] ACV: Loaded 7282 existing records. [2025-10-29T17:02:11.049785] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:02:11.050361] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-29T17:02:11.050630] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-29T17:02:11.051056] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-29T17:02:11.051117] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-29T17:02:11.350763] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T17:02:11.448131] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:02:11.593568] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-29T17:02:11.923574] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T17:02:11.930682] [INFO ] [REMOTE ] ACP: Full fetch complete (46084 records). [2025-10-29T17:02:11.930850] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-29T17:02:11.931526] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:02:11.931637] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:02:11.931757] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:02:11.931857] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-29T17:02:11.931943] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-29T17:02:11.931984] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-29T17:02:11.932159] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-29T17:02:11.932256] [INFO ] [MAIN ] Update Progress: 23/2367 symbols completed. ACP took 26.8s. Estimated remaining: 3h 39m 57s. Rate: 10.7 symbols/min [2025-10-29T17:02:12.124132] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:02:12.168544] [DEBUG] [LOCAL ] ACVA: Loaded 49057 existing records from primary storage. [2025-10-29T17:02:12.168871] [INFO ] [MAIN ] ACVA: Loaded 49057 existing records. [2025-10-29T17:02:12.286282] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-29T17:02:12.356501] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:02:12.356763] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-29T17:02:12.356834] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-29T17:02:12.357262] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-29T17:02:12.357301] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-29T17:02:12.398663] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-29T17:02:12.730003] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:02:13.193614] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-29T17:02:13.360192] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-29T17:02:13.649773] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-29T17:02:13.993684] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-29T17:02:14.456976] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T17:02:14.793604] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-29T17:02:15.285974] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-29T17:02:15.593584] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-29T17:02:16.393602] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-29T17:02:16.888496] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T17:02:17.193544] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-29T17:02:17.292441] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T17:02:17.616604] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-29T17:02:17.993630] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-29T17:02:18.793634] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-29T17:02:19.160540] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T17:02:19.593575] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-29T17:02:19.933017] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-29T17:02:19.942568] [INFO ] [REMOTE ] ACRE: Full fetch complete (48971 records). [2025-10-29T17:02:19.942868] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-29T17:02:20.081795] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-29T17:02:20.370114] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-29T17:02:20.370200] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-29T17:02:20.370746] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-29T17:02:20.370810] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-29T17:02:20.371942] [DEBUG] [LOCAL ] ACRE: Trimmed 48971 records to 32447 (keeping 200 days of data) [2025-10-29T17:02:20.421323] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-29T17:02:20.560793] [DEBUG] [LOCAL ] ACRE: Primary data saved (32447 records). [2025-10-29T17:02:20.560927] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-29T17:02:20.561009] [INFO ] [MAIN ] Update Progress: 24/2367 symbols completed. ACRE took 25.1s. Estimated remaining: 3h 44m 44s. Rate: 10.4 symbols/min [2025-10-29T17:02:20.740762] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:02:20.740953] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-29T17:02:20.741013] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-29T17:02:20.741128] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-29T17:02:20.741171] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-29T17:02:20.741214] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-29T17:02:20.741246] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-29T17:02:21.131409] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:02:21.193546] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-29T17:02:21.370401] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:02:21.370707] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-29T17:02:21.370793] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:02:21.370848] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-29T17:02:21.370906] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:02:21.370978] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-29T17:02:21.371039] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-29T17:02:21.371075] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-29T17:02:21.371113] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-29T17:02:21.371158] [INFO ] [MAIN ] Update Progress: 25/2367 symbols completed. AD took 0.8s. Estimated remaining: 3h 36m 55s. Rate: 10.8 symbols/min [2025-10-29T17:02:21.549045] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:02:21.588712] [DEBUG] [LOCAL ] ADC: Loaded 46262 existing records from primary storage. [2025-10-29T17:02:21.589024] [INFO ] [MAIN ] ADC: Loaded 46262 existing records. [2025-10-29T17:02:21.776824] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:02:21.777136] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-29T17:02:21.777215] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-29T17:02:21.777743] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-29T17:02:21.777800] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-29T17:02:21.994581] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-29T17:02:22.034247] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-29T17:02:22.200273] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:02:22.600521] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-29T17:02:22.793571] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-29T17:02:23.298539] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-29T17:02:23.593557] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-29T17:02:24.181610] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T17:02:24.393587] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-29T17:02:25.193562] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-29T17:02:25.458824] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-29T17:02:25.993564] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-29T17:02:26.431667] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T17:02:26.662105] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T17:02:26.793565] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-29T17:02:27.593745] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-29T17:02:28.001724] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T17:02:28.265054] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-29T17:02:28.268123] [INFO ] [REMOTE ] ACV: Full fetch complete (10618 records). [2025-10-29T17:02:28.268268] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-29T17:02:28.268833] [FATAL] [VALIDATOR ] ACV: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:02:28.268916] [FATAL] [MAIN ] ACV: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:02:28.268960] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:02:28.269008] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-29T17:02:28.269089] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-29T17:02:28.269127] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-10-29T17:02:28.269293] [DEBUG] [LOCAL ] ACV: Deleted derivative data file. [2025-10-29T17:02:28.269384] [INFO ] [MAIN ] Update Progress: 26/2367 symbols completed. ACV took 17.6s. Estimated remaining: 3h 38m 50s. Rate: 10.7 symbols/min [2025-10-29T17:02:28.398754] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-29T17:02:28.458492] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:02:28.494290] [DEBUG] [LOCAL ] ADCT: Loaded 35678 existing records from primary storage. [2025-10-29T17:02:28.494574] [INFO ] [MAIN ] ADCT: Loaded 35678 existing records. [2025-10-29T17:02:28.689370] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:02:28.689593] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-29T17:02:28.689666] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-29T17:02:28.689931] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-29T17:02:28.689973] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-29T17:02:29.118882] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:02:29.193612] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-29T17:02:29.677845] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T17:02:29.677552] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T17:02:29.993630] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-29T17:02:30.793556] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-29T17:02:31.010881] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T17:02:31.593559] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-29T17:02:31.953620] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T17:02:32.393841] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-29T17:02:32.674756] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T17:02:33.193606] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-29T17:02:33.723834] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T17:02:33.993622] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-29T17:02:34.152813] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T17:02:34.515511] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-29T17:02:34.793605] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-29T17:02:35.119279] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T17:02:35.593563] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-29T17:02:36.062778] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-29T17:02:36.064279] [INFO ] [REMOTE ] ACR: Full fetch complete (8537 records). [2025-10-29T17:02:36.064426] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-29T17:02:36.403974] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-29T17:02:36.448428] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-29T17:02:36.448522] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-29T17:02:36.448811] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-29T17:02:36.448874] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-29T17:02:36.449289] [DEBUG] [LOCAL ] ACR: Trimmed 8537 records to 5178 (keeping 200 days of data) [2025-10-29T17:02:36.480551] [DEBUG] [LOCAL ] ACR: Primary data saved (5178 records). [2025-10-29T17:02:36.480867] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-29T17:02:36.480967] [INFO ] [MAIN ] Update Progress: 27/2367 symbols completed. ACR took 43.0s. Estimated remaining: 3h 42m 30s. Rate: 10.5 symbols/min [2025-10-29T17:02:36.653000] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:02:36.702256] [DEBUG] [LOCAL ] ADM: Loaded 53377 existing records from primary storage. [2025-10-29T17:02:36.702561] [INFO ] [MAIN ] ADM: Loaded 53377 existing records. [2025-10-29T17:02:36.888033] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:02:36.888263] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-29T17:02:36.888314] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-29T17:02:36.888736] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-29T17:02:36.888794] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-29T17:02:37.194967] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-29T17:02:37.271441] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:02:37.315617] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T17:02:37.993599] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-29T17:02:38.538071] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T17:02:38.793593] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-29T17:02:39.537376] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-29T17:02:39.593575] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-29T17:02:39.770590] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T17:02:40.393590] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-29T17:02:41.082972] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-29T17:02:41.193568] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-29T17:02:41.276338] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T17:02:41.993571] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-29T17:02:42.774566] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-29T17:02:42.793533] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-29T17:02:42.972383] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T17:02:43.593594] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-29T17:02:44.182344] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T17:02:44.393606] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-29T17:02:44.962579] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-29T17:02:45.193632] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-29T17:02:45.889612] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T17:02:45.900821] [INFO ] [REMOTE ] ACVA: Full fetch complete (71094 records). [2025-10-29T17:02:45.900977] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-29T17:02:46.000238] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-29T17:02:46.392350] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-29T17:02:46.392502] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-29T17:02:46.393321] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-29T17:02:46.393596] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-29T17:02:46.395477] [DEBUG] [LOCAL ] ACVA: Trimmed 71094 records to 49044 (keeping 200 days of data) [2025-10-29T17:02:46.424506] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T17:02:46.732534] [DEBUG] [LOCAL ] ACVA: Primary data saved (49044 records). [2025-10-29T17:02:46.732695] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-29T17:02:46.733573] [INFO ] [MAIN ] Update Progress: 28/2367 symbols completed. ACVA took 34.8s. Estimated remaining: 3h 48m 44s. Rate: 10.2 symbols/min [2025-10-29T17:02:46.799348] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-29T17:02:46.917950] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:02:46.966535] [DEBUG] [LOCAL ] ADNT: Loaded 45939 existing records from primary storage. [2025-10-29T17:02:46.966907] [INFO ] [MAIN ] ADNT: Loaded 45939 existing records. [2025-10-29T17:02:47.164659] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:02:47.164905] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-29T17:02:47.165149] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-29T17:02:47.166206] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-29T17:02:47.166268] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-29T17:02:47.550611] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:02:47.598886] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-29T17:02:47.620082] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-29T17:02:47.860823] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-29T17:02:48.393715] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-29T17:02:49.005574] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T17:02:49.193609] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-29T17:02:49.740842] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T17:02:49.993606] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-29T17:02:50.304818] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T17:02:50.793622] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-29T17:02:51.555666] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-29T17:02:51.593564] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-29T17:02:51.859978] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-29T17:02:52.393588] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-29T17:02:52.947513] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T17:02:53.193609] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-29T17:02:53.533161] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T17:02:53.993542] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-29T17:02:54.261933] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T17:02:54.793579] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-29T17:02:55.469177] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-29T17:02:55.593591] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-29T17:02:55.913770] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-29T17:02:56.393575] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-29T17:02:56.996665] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T17:02:57.013009] [INFO ] [REMOTE ] ADC: Full fetch complete (66738 records). [2025-10-29T17:02:57.013250] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-29T17:02:57.198808] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-29T17:02:57.640597] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-29T17:02:57.640780] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-29T17:02:57.642243] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-29T17:02:57.642342] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-29T17:02:57.644392] [DEBUG] [LOCAL ] ADC: Trimmed 66738 records to 46236 (keeping 200 days of data) [2025-10-29T17:02:58.018413] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-29T17:02:58.097921] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-29T17:02:58.095772] [DEBUG] [LOCAL ] ADC: Primary data saved (46236 records). [2025-10-29T17:02:58.114143] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-29T17:02:58.114910] [INFO ] [MAIN ] Update Progress: 29/2367 symbols completed. ADC took 36.7s. Estimated remaining: 3h 56m 3s. Rate: 9.9 symbols/min [2025-10-29T17:02:58.295191] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:02:58.295473] [DEBUG] [LOCAL ] ADT: No existing data file found in primary storage. [2025-10-29T17:02:58.295585] [WARN ] [MAIN ] ADT: No existing data found, performing full refresh instead. [2025-10-29T17:02:58.295839] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-29T17:02:58.295968] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-29T17:02:58.296065] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-29T17:02:58.296152] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-29T17:02:58.637128] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T17:02:58.696277] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:02:58.793529] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-29T17:02:59.386147] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T17:02:59.395084] [INFO ] [REMOTE ] ADCT: Full fetch complete (51501 records). [2025-10-29T17:02:59.395208] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-29T17:02:59.601811] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-29T17:02:59.810735] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-29T17:02:59.810822] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-29T17:02:59.811372] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-29T17:02:59.811416] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-29T17:02:59.812486] [DEBUG] [LOCAL ] ADCT: Trimmed 51501 records to 35864 (keeping 200 days of data) [2025-10-29T17:03:00.013876] [DEBUG] [LOCAL ] ADCT: Primary data saved (35864 records). [2025-10-29T17:03:00.014027] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-29T17:03:00.014762] [INFO ] [MAIN ] Update Progress: 30/2367 symbols completed. ADCT took 31.7s. Estimated remaining: 3h 50m 33s. Rate: 10.1 symbols/min [2025-10-29T17:03:00.207268] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:03:00.207750] [DEBUG] [LOCAL ] ADX: No existing data file found in primary storage. [2025-10-29T17:03:00.208031] [WARN ] [MAIN ] ADX: No existing data found, performing full refresh instead. [2025-10-29T17:03:00.208199] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-29T17:03:00.208279] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-29T17:03:00.208544] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-10-29T17:03:00.208794] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-29T17:03:00.396695] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-29T17:03:00.472628] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-29T17:03:00.680947] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:03:01.112336] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-29T17:03:01.193557] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-29T17:03:01.998764] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-29T17:03:02.029040] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-29T17:03:02.584815] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T17:03:02.793614] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-29T17:03:03.330411] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T17:03:03.593621] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-29T17:03:04.013400] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T17:03:04.393572] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-29T17:03:04.787241] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-29T17:03:04.991259] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T17:03:05.006198] [INFO ] [REMOTE ] ADM: Full fetch complete (77466 records). [2025-10-29T17:03:05.006495] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-29T17:03:05.208155] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-29T17:03:05.435457] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-29T17:03:05.435543] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-29T17:03:05.436334] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-29T17:03:05.436423] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-29T17:03:05.437955] [DEBUG] [LOCAL ] ADM: Trimmed 77466 records to 53375 (keeping 200 days of data) [2025-10-29T17:03:05.763684] [DEBUG] [LOCAL ] ADM: Primary data saved (53375 records). [2025-10-29T17:03:05.763824] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-29T17:03:05.763908] [INFO ] [MAIN ] Update Progress: 31/2367 symbols completed. ADM took 29.3s. Estimated remaining: 3h 50m 14s. Rate: 10.1 symbols/min [2025-10-29T17:03:05.938817] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:03:05.986890] [DEBUG] [LOCAL ] AEE: Loaded 49871 existing records from primary storage. [2025-10-29T17:03:05.987281] [INFO ] [MAIN ] AEE: Loaded 49871 existing records. [2025-10-29T17:03:05.998832] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-29T17:03:06.170901] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:03:06.171098] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-29T17:03:06.171146] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-29T17:03:06.171972] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-29T17:03:06.172029] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-29T17:03:06.539665] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:03:06.566660] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-29T17:03:06.793587] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-29T17:03:07.580965] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-29T17:03:07.593534] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-29T17:03:07.887835] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T17:03:08.393609] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-29T17:03:08.894010] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T17:03:09.193600] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-29T17:03:09.613835] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T17:03:09.993630] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-29T17:03:10.665692] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-29T17:03:10.793562] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-29T17:03:11.312822] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:03:11.593594] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-29T17:03:11.997371] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T17:03:12.393556] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-29T17:03:12.450391] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T17:03:13.193569] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-29T17:03:13.631860] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T17:03:13.993575] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-29T17:03:14.338292] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T17:03:14.793542] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-29T17:03:15.295959] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T17:03:15.593605] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-29T17:03:16.162173] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T17:03:16.171761] [INFO ] [REMOTE ] ADNT: Full fetch complete (67541 records). [2025-10-29T17:03:16.171916] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-29T17:03:16.402014] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-29T17:03:16.579357] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-29T17:03:16.579461] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-29T17:03:16.580353] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-29T17:03:16.580429] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-29T17:03:16.581898] [DEBUG] [LOCAL ] ADNT: Trimmed 67541 records to 45853 (keeping 200 days of data) [2025-10-29T17:03:16.885108] [DEBUG] [LOCAL ] ADNT: Primary data saved (45853 records). [2025-10-29T17:03:16.887019] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T17:03:16.886012] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-29T17:03:16.898043] [INFO ] [MAIN ] Update Progress: 32/2367 symbols completed. ADNT took 30.2s. Estimated remaining: 3h 56m 29s. Rate: 9.9 symbols/min [2025-10-29T17:03:17.073679] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:03:17.084579] [DEBUG] [LOCAL ] AEFC: Loaded 7433 existing records from primary storage. [2025-10-29T17:03:17.084841] [INFO ] [MAIN ] AEFC: Loaded 7433 existing records. [2025-10-29T17:03:17.198842] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-29T17:03:17.265274] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:03:17.265586] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-29T17:03:17.265698] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-29T17:03:17.265938] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-29T17:03:17.265998] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-29T17:03:17.636479] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:03:17.782054] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T17:03:17.993542] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-29T17:03:18.507853] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T17:03:18.793538] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-29T17:03:18.822325] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-29T17:03:19.593568] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-29T17:03:19.803190] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T17:03:20.393570] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-29T17:03:20.949080] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T17:03:21.193569] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-29T17:03:21.570966] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T17:03:21.629173] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-29T17:03:21.993566] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-29T17:03:22.793562] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-29T17:03:23.316478] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T17:03:23.593597] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-29T17:03:23.726868] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-29T17:03:24.393559] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-29T17:03:24.978308] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:03:25.193587] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-29T17:03:25.600950] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T17:03:25.993586] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-29T17:03:26.064899] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-29T17:03:26.579818] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-29T17:03:26.793531] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-29T17:03:27.361208] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-29T17:03:27.593559] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-29T17:03:28.393585] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-29T17:03:29.007750] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-29T17:03:29.019136] [INFO ] [REMOTE ] ADT: Full fetch complete (77380 records). [2025-10-29T17:03:29.019301] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-29T17:03:29.194145] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-29T17:03:29.503146] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T17:03:29.513351] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-29T17:03:29.513689] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-29T17:03:29.515273] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-29T17:03:29.518893] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-29T17:03:29.520420] [DEBUG] [LOCAL ] ADT: Trimmed 77380 records to 53424 (keeping 200 days of data) [2025-10-29T17:03:29.837707] [DEBUG] [LOCAL ] ADT: Primary data saved (53424 records). [2025-10-29T17:03:29.837836] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-29T17:03:29.837911] [INFO ] [MAIN ] Update Progress: 33/2367 symbols completed. ADT took 31.7s. Estimated remaining: 4h 4m 28s. Rate: 9.5 symbols/min [2025-10-29T17:03:30.011105] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:03:30.007369] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-29T17:03:30.054613] [DEBUG] [LOCAL ] AEG: Loaded 49393 existing records from primary storage. [2025-10-29T17:03:30.055020] [INFO ] [MAIN ] AEG: Loaded 49393 existing records. [2025-10-29T17:03:30.236706] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:03:30.236949] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-29T17:03:30.236996] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-29T17:03:30.237875] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-29T17:03:30.237933] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-29T17:03:30.623340] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:03:30.671051] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T17:03:30.793582] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-29T17:03:31.022607] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-29T17:03:31.593558] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-29T17:03:32.191531] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T17:03:32.288364] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T17:03:32.298335] [INFO ] [REMOTE ] AEE: Full fetch complete (72593 records). [2025-10-29T17:03:32.298477] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-29T17:03:32.299268] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:03:32.299379] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:03:32.299422] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:03:32.299460] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-29T17:03:32.299516] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-29T17:03:32.299552] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-29T17:03:32.299765] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-10-29T17:03:32.300503] [INFO ] [MAIN ] Update Progress: 34/2367 symbols completed. AEE took 26.5s. Estimated remaining: 3h 59m 60s. Rate: 9.7 symbols/min [2025-10-29T17:03:32.398821] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-29T17:03:32.481906] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:03:32.537609] [DEBUG] [LOCAL ] AEM: Loaded 53472 existing records from primary storage. [2025-10-29T17:03:32.537950] [INFO ] [MAIN ] AEM: Loaded 53472 existing records. [2025-10-29T17:03:32.715888] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:03:32.716105] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-29T17:03:32.716151] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-29T17:03:32.717038] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-29T17:03:32.717095] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-29T17:03:33.113477] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:03:33.193536] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-29T17:03:33.696234] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T17:03:33.993584] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-29T17:03:34.701106] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-29T17:03:34.739770] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T17:03:34.793557] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-29T17:03:35.593574] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-29T17:03:35.906104] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:03:36.393585] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-29T17:03:36.460387] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-29T17:03:36.811204] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-29T17:03:37.193594] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-29T17:03:37.993561] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-29T17:03:38.237491] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T17:03:38.243880] [INFO ] [REMOTE ] ADX: Full fetch complete (41633 records). [2025-10-29T17:03:38.244003] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-29T17:03:38.515740] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T17:03:38.639514] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-29T17:03:38.639631] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-29T17:03:38.640128] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-29T17:03:38.640175] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-29T17:03:38.641193] [DEBUG] [LOCAL ] ADX: Trimmed 41633 records to 27530 (keeping 200 days of data) [2025-10-29T17:03:38.806040] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-29T17:03:38.811944] [DEBUG] [LOCAL ] ADX: Primary data saved (27530 records). [2025-10-29T17:03:38.812300] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-29T17:03:38.813577] [INFO ] [MAIN ] Update Progress: 35/2367 symbols completed. ADX took 38.8s. Estimated remaining: 4h 0m 16s. Rate: 9.7 symbols/min [2025-10-29T17:03:38.986064] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:03:39.036373] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-29T17:03:39.036726] [INFO ] [MAIN ] AEO: Loaded 53563 existing records. [2025-10-29T17:03:39.215708] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:03:39.215951] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-29T17:03:39.216016] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-29T17:03:39.216537] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-29T17:03:39.216578] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-29T17:03:39.526014] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-29T17:03:39.587068] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:03:39.593514] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-29T17:03:40.393744] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-29T17:03:40.945396] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T17:03:41.193556] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-29T17:03:41.608843] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T17:03:41.993623] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-29T17:03:42.423817] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T17:03:42.793631] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-29T17:03:42.982214] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T17:03:43.356661] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-29T17:03:43.593627] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-29T17:03:44.393569] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-29T17:03:44.890104] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T17:03:44.908906] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-29T17:03:44.910576] [INFO ] [REMOTE ] AEFC: Full fetch complete (11514 records). [2025-10-29T17:03:44.910669] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-29T17:03:45.196024] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-29T17:03:45.285050] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-29T17:03:45.285174] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-29T17:03:45.285421] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-29T17:03:45.285463] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-29T17:03:45.286157] [DEBUG] [LOCAL ] AEFC: Trimmed 11514 records to 7378 (keeping 200 days of data) [2025-10-29T17:03:45.330944] [DEBUG] [LOCAL ] AEFC: Primary data saved (7378 records). [2025-10-29T17:03:45.331083] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-29T17:03:45.331167] [INFO ] [MAIN ] Update Progress: 36/2367 symbols completed. AEFC took 28.4s. Estimated remaining: 4h 0m 32s. Rate: 9.7 symbols/min [2025-10-29T17:03:45.505771] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:03:45.552107] [DEBUG] [LOCAL ] AER: Loaded 47659 existing records from primary storage. [2025-10-29T17:03:45.552409] [INFO ] [MAIN ] AER: Loaded 47659 existing records. [2025-10-29T17:03:45.730690] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:03:45.730939] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-29T17:03:45.731021] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-29T17:03:45.731616] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-29T17:03:45.731739] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-29T17:03:45.998903] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-29T17:03:46.090228] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:03:46.468070] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T17:03:46.793730] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-29T17:03:47.476261] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T17:03:47.593577] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-29T17:03:47.919704] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T17:03:48.393628] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-29T17:03:48.923605] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T17:03:49.193607] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-29T17:03:49.951511] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-29T17:03:49.993690] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-29T17:03:50.563103] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-29T17:03:50.793571] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-29T17:03:51.541426] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T17:03:51.593616] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-29T17:03:51.860012] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T17:03:52.393555] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-29T17:03:53.038966] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-29T17:03:53.193602] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-29T17:03:53.647325] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T17:03:53.993605] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-29T17:03:54.489454] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T17:03:54.793558] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-29T17:03:55.278866] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T17:03:55.593576] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-29T17:03:56.039233] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:03:56.393573] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-29T17:03:56.584804] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-29T17:03:57.193615] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-29T17:03:57.868776] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-29T17:03:57.993568] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-29T17:03:58.622775] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-29T17:03:58.793596] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-29T17:03:59.414888] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-29T17:03:59.593602] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-29T17:03:59.987567] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T17:04:00.393572] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-29T17:04:01.193694] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-29T17:04:01.395478] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-29T17:04:01.779639] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T17:04:01.993608] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-29T17:04:02.793525] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-29T17:04:02.868028] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-29T17:04:03.591895] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-29T17:04:03.602357] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-29T17:04:04.213661] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T17:04:04.393577] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-29T17:04:05.198676] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-29T17:04:05.221780] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-29T17:04:05.835877] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-29T17:04:05.846357] [INFO ] [REMOTE ] AEG: Full fetch complete (70656 records). [2025-10-29T17:04:05.846520] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-29T17:04:05.997516] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-29T17:04:06.262278] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-29T17:04:06.262365] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-29T17:04:06.263180] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-29T17:04:06.263251] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-29T17:04:06.264669] [DEBUG] [LOCAL ] AEG: Trimmed 70656 records to 49369 (keeping 200 days of data) [2025-10-29T17:04:06.539407] [DEBUG] [LOCAL ] AEG: Primary data saved (49369 records). [2025-10-29T17:04:06.539548] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-29T17:04:06.539667] [INFO ] [MAIN ] Update Progress: 37/2367 symbols completed. AEG took 36.7s. Estimated remaining: 4h 16m 11s. Rate: 9.1 symbols/min [2025-10-29T17:04:06.793538] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-29T17:04:06.956824] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-29T17:04:06.968477] [INFO ] [REMOTE ] AEM: Full fetch complete (77494 records). [2025-10-29T17:04:06.968696] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-29T17:04:07.369691] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-29T17:04:07.369778] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-29T17:04:07.370497] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-29T17:04:07.370540] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-29T17:04:07.371984] [DEBUG] [LOCAL ] AEM: Trimmed 77494 records to 53471 (keeping 200 days of data) [2025-10-29T17:04:07.700954] [DEBUG] [LOCAL ] AEM: Primary data saved (53471 records). [2025-10-29T17:04:07.701193] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-29T17:04:07.702200] [INFO ] [MAIN ] Update Progress: 38/2367 symbols completed. AEM took 35.4s. Estimated remaining: 4h 10m 32s. Rate: 9.3 symbols/min [2025-10-29T17:04:07.738618] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T17:04:07.750191] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-29T17:04:07.967232] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T17:04:08.393557] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-29T17:04:09.390636] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T17:04:09.402610] [INFO ] [REMOTE ] AEO: Full fetch complete (77651 records). [2025-10-29T17:04:09.402814] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-29T17:04:09.817705] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-29T17:04:09.817813] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-29T17:04:09.818756] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-29T17:04:09.818837] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-29T17:04:09.820394] [DEBUG] [LOCAL ] AEO: Trimmed 77651 records to 53563 (keeping 200 days of data) [2025-10-29T17:04:09.954250] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-29T17:04:09.974442] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-29T17:04:10.188492] [DEBUG] [LOCAL ] AEO: Primary data saved (53563 records). [2025-10-29T17:04:10.188622] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-29T17:04:10.188761] [INFO ] [MAIN ] Update Progress: 39/2367 symbols completed. AEO took 31.4s. Estimated remaining: 4h 6m 29s. Rate: 9.4 symbols/min [2025-10-29T17:04:11.352546] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:04:11.362760] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-29T17:04:12.779849] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-29T17:04:12.789610] [INFO ] [REMOTE ] AER: Full fetch complete (69903 records). [2025-10-29T17:04:12.789780] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-29T17:04:13.184201] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-29T17:04:13.184286] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-29T17:04:13.184981] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-29T17:04:13.185044] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-29T17:04:13.186432] [DEBUG] [LOCAL ] AER: Trimmed 69903 records to 47644 (keeping 200 days of data) [2025-10-29T17:04:13.474795] [DEBUG] [LOCAL ] AER: Primary data saved (47644 records). [2025-10-29T17:04:13.474945] [INFO ] [MAIN ] AER: Full history saved. [2025-10-29T17:04:13.476005] [INFO ] [MAIN ] Update Progress: 40/2367 symbols completed. AER took 28.1s. Estimated remaining: 4h 3m 24s. Rate: 9.6 symbols/min [2025-10-29T17:04:14.105761] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:14.166953] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:14.216357] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-29T17:04:14.237339] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-29T17:04:14.238945] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-29T17:04:14.238369] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:14.241080] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-29T17:04:14.240832] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:14.241629] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-29T17:04:14.242076] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-29T17:04:14.357992] [DEBUG] [LOCAL ] AFB: Loaded 10993 existing records from primary storage. [2025-10-29T17:04:14.377770] [INFO ] [MAIN ] AFB: Loaded 10993 existing records. [2025-10-29T17:04:14.702683] [DEBUG] [LOCAL ] AESI: Loaded 49737 existing records from primary storage. [2025-10-29T17:04:14.769172] [DEBUG] [LOCAL ] AES: Loaded 53663 existing records from primary storage. [2025-10-29T17:04:14.779609] [INFO ] [MAIN ] AESI: Loaded 49737 existing records. [2025-10-29T17:04:14.827839] [INFO ] [MAIN ] AES: Loaded 53663 existing records. [2025-10-29T17:04:14.817125] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:04:14.884812] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-29T17:04:14.969099] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-29T17:04:15.104910] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:15.110197] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-29T17:04:15.136725] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-29T17:04:15.150211] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-29T17:04:15.302572] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:04:15.373288] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:04:15.387221] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-29T17:04:15.397714] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-29T17:04:15.415741] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-29T17:04:15.416013] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-29T17:04:15.421899] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-29T17:04:15.422017] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-29T17:04:15.442857] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-29T17:04:15.432367] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-29T17:04:15.572003] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:04:15.741789] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-29T17:04:15.805950] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:04:15.832845] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-29T17:04:15.892123] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:04:15.985076] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-29T17:04:16.168163] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:16.067781] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-29T17:04:16.226056] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-29T17:04:16.225622] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-29T17:04:16.284932] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-29T17:04:16.310493] [INFO ] [MAIN ] Update Progress: 41/2367 symbols completed. AEXA took 2.8s. Estimated remaining: 4h 0m 2s. Rate: 9.7 symbols/min [2025-10-29T17:04:16.509844] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:16.576102] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-29T17:04:16.575812] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:16.587870] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-29T17:04:16.658861] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:16.690314] [DEBUG] [LOCAL ] AFG: Loaded 31464 existing records from primary storage. [2025-10-29T17:04:16.690584] [INFO ] [MAIN ] AFG: Loaded 31464 existing records. [2025-10-29T17:04:16.866778] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:04:16.867188] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-29T17:04:16.867255] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-29T17:04:16.867766] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-29T17:04:16.867826] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-29T17:04:16.989803] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T17:04:17.015420] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-29T17:04:17.229061] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:17.229367] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-29T17:04:17.643463] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T17:04:17.646323] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-29T17:04:17.877126] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T17:04:17.886542] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-29T17:04:18.046569] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T17:04:18.058012] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-29T17:04:18.075720] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-29T17:04:18.081624] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-29T17:04:18.237404] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-29T17:04:18.793567] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-29T17:04:19.048222] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T17:04:19.178212] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T17:04:19.358822] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-29T17:04:19.412751] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-29T17:04:19.593531] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-29T17:04:20.393558] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-29T17:04:21.149875] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-29T17:04:21.193591] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-29T17:04:21.472384] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T17:04:21.578098] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-29T17:04:21.993561] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-29T17:04:22.793588] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-29T17:04:22.944045] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T17:04:23.272839] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-29T17:04:23.593621] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-29T17:04:24.393563] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-29T17:04:25.203726] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-29T17:04:25.225688] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-29T17:04:25.316798] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-29T17:04:25.757602] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-29T17:04:25.993573] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-29T17:04:26.555902] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-29T17:04:26.793579] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-29T17:04:27.593608] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-29T17:04:28.393570] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-29T17:04:28.484508] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-29T17:04:28.800803] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T17:04:29.193576] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-29T17:04:29.580418] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T17:04:29.993584] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-29T17:04:30.132496] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T17:04:30.612582] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-29T17:04:30.793573] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-29T17:04:31.593590] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-29T17:04:31.746570] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T17:04:32.393566] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-29T17:04:33.178575] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-29T17:04:33.193519] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-29T17:04:33.393474] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-29T17:04:33.993591] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-29T17:04:34.765596] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-29T17:04:34.793540] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-29T17:04:35.064002] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-29T17:04:35.593567] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-29T17:04:36.255877] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T17:04:36.393568] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-29T17:04:36.831794] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:04:37.193696] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-29T17:04:37.993529] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-29T17:04:38.026218] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-29T17:04:38.393177] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T17:04:38.793563] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-29T17:04:38.891966] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T17:04:38.898354] [INFO ] [REMOTE ] AFG: Full fetch complete (46621 records). [2025-10-29T17:04:38.898473] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-29T17:04:38.899128] [FATAL] [VALIDATOR ] AFG: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:04:38.899235] [FATAL] [MAIN ] AFG: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:04:38.899278] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:04:38.899342] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-29T17:04:38.899405] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-29T17:04:38.899440] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-10-29T17:04:38.899633] [DEBUG] [LOCAL ] AFG: Deleted derivative data file. [2025-10-29T17:04:38.899751] [INFO ] [MAIN ] Update Progress: 42/2367 symbols completed. AFG took 22.6s. Estimated remaining: 4h 15m 4s. Rate: 9.1 symbols/min [2025-10-29T17:04:39.076571] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:39.080133] [DEBUG] [LOCAL ] AFGB: Loaded 2112 existing records from primary storage. [2025-10-29T17:04:39.080273] [INFO ] [MAIN ] AFGB: Loaded 2112 existing records. [2025-10-29T17:04:39.270439] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:04:39.270689] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-29T17:04:39.270746] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-29T17:04:39.270913] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-29T17:04:39.270969] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-29T17:04:39.556677] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T17:04:39.570068] [INFO ] [REMOTE ] AFB: Full fetch complete (16153 records). [2025-10-29T17:04:39.585524] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-29T17:04:39.601903] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-29T17:04:39.608088] [FATAL] [VALIDATOR ] AFB: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:04:39.646227] [FATAL] [MAIN ] AFB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:04:39.646127] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:39.646430] [WARN ] [MAIN ] AFB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:04:39.646776] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-29T17:04:39.646857] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-29T17:04:39.646921] [INFO ] [LOCAL ] AFB: Starting deletion of derivative data. [2025-10-29T17:04:39.647109] [DEBUG] [LOCAL ] AFB: Deleted derivative data file. [2025-10-29T17:04:39.647209] [INFO ] [MAIN ] Update Progress: 43/2367 symbols completed. AFB took 26.2s. Estimated remaining: 4h 9m 42s. Rate: 9.3 symbols/min [2025-10-29T17:04:39.816152] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:39.820106] [DEBUG] [LOCAL ] AFGC: Loaded 2560 existing records from primary storage. [2025-10-29T17:04:39.820246] [INFO ] [MAIN ] AFGC: Loaded 2560 existing records. [2025-10-29T17:04:39.998247] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:04:39.998473] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-29T17:04:39.998521] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-29T17:04:39.998711] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-29T17:04:39.998770] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-29T17:04:40.347866] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:40.393529] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-29T17:04:40.821400] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-29T17:04:41.023563] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-29T17:04:41.193567] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-29T17:04:41.993565] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-29T17:04:42.793608] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-29T17:04:43.166482] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T17:04:43.200781] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T17:04:43.273533] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-29T17:04:43.284612] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-29T17:04:43.284800] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-29T17:04:43.596439] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-29T17:04:43.694744] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-29T17:04:43.694832] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-29T17:04:43.695555] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-29T17:04:43.695595] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-29T17:04:43.697076] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 53663 (keeping 200 days of data) [2025-10-29T17:04:44.018961] [DEBUG] [LOCAL ] AES: Primary data saved (53663 records). [2025-10-29T17:04:44.019096] [INFO ] [MAIN ] AES: Full history saved. [2025-10-29T17:04:44.019170] [INFO ] [MAIN ] Update Progress: 44/2367 symbols completed. AES took 30.5s. Estimated remaining: 4h 7m 46s. Rate: 9.4 symbols/min [2025-10-29T17:04:44.192152] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:44.192329] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-29T17:04:44.192366] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-29T17:04:44.192478] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-29T17:04:44.192541] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-29T17:04:44.192617] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-29T17:04:44.192699] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-29T17:04:44.399111] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-29T17:04:44.557381] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:44.844082] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T17:04:44.937669] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-29T17:04:45.193582] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-29T17:04:45.496556] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T17:04:45.993595] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-29T17:04:46.623311] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-29T17:04:46.793564] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-29T17:04:47.098635] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-29T17:04:47.593602] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-29T17:04:48.393573] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-29T17:04:48.809694] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-29T17:04:49.074247] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T17:04:49.085293] [INFO ] [REMOTE ] AESI: Full fetch complete (71997 records). [2025-10-29T17:04:49.085447] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-29T17:04:49.198679] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-29T17:04:49.469420] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-29T17:04:49.469515] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-29T17:04:49.470249] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-29T17:04:49.470313] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-29T17:04:49.471824] [DEBUG] [LOCAL ] AESI: Trimmed 71997 records to 49754 (keeping 200 days of data) [2025-10-29T17:04:49.682717] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-29T17:04:49.770595] [DEBUG] [LOCAL ] AESI: Primary data saved (49754 records). [2025-10-29T17:04:49.770763] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-29T17:04:49.770878] [INFO ] [MAIN ] Update Progress: 45/2367 symbols completed. AESI took 36.3s. Estimated remaining: 4h 7m 6s. Rate: 9.4 symbols/min [2025-10-29T17:04:49.937969] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:04:49.941907] [DEBUG] [LOCAL ] AFGE: Loaded 2204 existing records from primary storage. [2025-10-29T17:04:49.942091] [INFO ] [MAIN ] AFGE: Loaded 2204 existing records. [2025-10-29T17:04:49.998718] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-29T17:04:50.153190] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:04:50.153421] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-29T17:04:50.153470] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-29T17:04:50.153687] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-29T17:04:50.153745] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-29T17:04:50.417862] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T17:04:50.519835] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:04:50.793559] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-29T17:04:51.098440] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-29T17:04:51.593599] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-29T17:04:51.881035] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-29T17:04:52.393584] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-29T17:04:52.843625] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T17:04:53.193568] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-29T17:04:53.643773] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-29T17:04:53.993573] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-29T17:04:54.278310] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-29T17:04:54.793584] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-29T17:04:55.084964] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-29T17:04:55.593605] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-29T17:04:55.865169] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-29T17:04:56.393578] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-29T17:04:56.825428] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-29T17:04:57.193553] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-29T17:04:57.814476] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-29T17:04:57.993555] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-29T17:04:58.272139] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-29T17:04:58.793554] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-29T17:04:59.061449] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-29T17:04:59.593561] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-29T17:04:59.911138] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-29T17:05:00.393588] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-29T17:05:00.940124] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-29T17:05:00.941143] [INFO ] [REMOTE ] AFGB: Full fetch complete (3383 records). [2025-10-29T17:05:00.941217] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-29T17:05:01.198715] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-29T17:05:01.348411] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-29T17:05:01.348493] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-29T17:05:01.348615] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-29T17:05:01.348679] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-29T17:05:01.349060] [DEBUG] [LOCAL ] AFGB: Trimmed 3383 records to 2099 (keeping 200 days of data) [2025-10-29T17:05:01.361950] [DEBUG] [LOCAL ] AFGB: Primary data saved (2099 records). [2025-10-29T17:05:01.362044] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-29T17:05:01.362118] [INFO ] [MAIN ] Update Progress: 46/2367 symbols completed. AFGB took 22.5s. Estimated remaining: 4h 11m 22s. Rate: 9.2 symbols/min [2025-10-29T17:05:01.532565] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:05:01.587235] [DEBUG] [LOCAL ] AFL: Loaded 53148 existing records from primary storage. [2025-10-29T17:05:01.587609] [INFO ] [MAIN ] AFL: Loaded 53148 existing records. [2025-10-29T17:05:01.719116] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T17:05:01.832001] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:05:01.832243] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-29T17:05:01.832319] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-29T17:05:01.833377] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-29T17:05:01.833440] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-29T17:05:02.003489] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-29T17:05:02.242210] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:05:02.526408] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-29T17:05:02.793629] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-29T17:05:03.226542] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-29T17:05:03.593594] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-29T17:05:04.393597] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-29T17:05:04.758300] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-29T17:05:05.035381] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T17:05:05.193594] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-29T17:05:05.611313] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-29T17:05:05.993613] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-29T17:05:06.308738] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-29T17:05:06.793558] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-29T17:05:07.593576] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-29T17:05:07.874605] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-29T17:05:08.237283] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T17:05:08.393549] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-29T17:05:09.193549] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-29T17:05:09.591758] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-29T17:05:09.742379] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T17:05:09.993561] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-29T17:05:10.793570] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-29T17:05:11.066832] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-29T17:05:11.356479] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T17:05:11.593557] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-29T17:05:12.393568] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-29T17:05:12.708037] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-29T17:05:12.985527] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T17:05:13.193552] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-29T17:05:13.993559] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-29T17:05:14.356224] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-29T17:05:14.357431] [INFO ] [REMOTE ] AFGD: Full fetch complete (2619 records). [2025-10-29T17:05:14.357541] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-29T17:05:14.364748] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:05:14.736630] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-29T17:05:14.736736] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-29T17:05:14.736846] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-29T17:05:14.736885] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-29T17:05:14.737210] [DEBUG] [LOCAL ] AFGD: Trimmed 2619 records to 1683 (keeping 200 days of data) [2025-10-29T17:05:14.747158] [DEBUG] [LOCAL ] AFGD: Primary data saved (1683 records). [2025-10-29T17:05:14.747217] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-29T17:05:14.747278] [INFO ] [MAIN ] Update Progress: 47/2367 symbols completed. AFGD took 30.7s. Estimated remaining: 4h 16m 56s. Rate: 9.0 symbols/min [2025-10-29T17:05:14.798732] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-29T17:05:14.935625] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:05:14.985993] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-29T17:05:14.986304] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-29T17:05:15.167248] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:05:15.167479] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-29T17:05:15.167548] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-29T17:05:15.168750] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-29T17:05:15.168809] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-29T17:05:15.277812] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T17:05:15.540059] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:05:15.593546] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-29T17:05:16.393560] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-29T17:05:16.668360] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-29T17:05:17.037899] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T17:05:17.193547] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-29T17:05:17.463269] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-29T17:05:17.993540] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-29T17:05:18.470473] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-29T17:05:18.793548] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-29T17:05:19.593557] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-29T17:05:19.890548] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T17:05:20.357360] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-29T17:05:20.393509] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-29T17:05:21.193606] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-29T17:05:21.584091] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-29T17:05:21.585084] [INFO ] [REMOTE ] AFGC: Full fetch complete (3566 records). [2025-10-29T17:05:21.585151] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-29T17:05:21.941008] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-29T17:05:21.941234] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-29T17:05:21.941444] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-29T17:05:21.941551] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-29T17:05:21.942235] [DEBUG] [LOCAL ] AFGC: Trimmed 3566 records to 2570 (keeping 200 days of data) [2025-10-29T17:05:21.958707] [DEBUG] [LOCAL ] AFGC: Primary data saved (2570 records). [2025-10-29T17:05:21.958805] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-29T17:05:21.958880] [INFO ] [MAIN ] Update Progress: 48/2367 symbols completed. AFGC took 42.3s. Estimated remaining: 4h 17m 17s. Rate: 9.0 symbols/min [2025-10-29T17:05:21.998697] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-29T17:05:22.136485] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:05:22.171249] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-29T17:05:22.217448] [DEBUG] [LOCAL ] AGCO: Loaded 41768 existing records from primary storage. [2025-10-29T17:05:22.217756] [INFO ] [MAIN ] AGCO: Loaded 41768 existing records. [2025-10-29T17:05:22.397557] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:05:22.397832] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-29T17:05:22.397904] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-29T17:05:22.398793] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-29T17:05:22.398852] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-29T17:05:22.761956] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:05:22.793521] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-29T17:05:23.467320] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T17:05:23.593569] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-29T17:05:23.902364] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T17:05:23.914775] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-29T17:05:23.915807] [INFO ] [REMOTE ] AFGE: Full fetch complete (3254 records). [2025-10-29T17:05:23.915890] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-29T17:05:24.286958] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-29T17:05:24.287055] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-29T17:05:24.287185] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-29T17:05:24.287223] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-29T17:05:24.287595] [DEBUG] [LOCAL ] AFGE: Trimmed 3254 records to 2187 (keeping 200 days of data) [2025-10-29T17:05:24.301136] [DEBUG] [LOCAL ] AFGE: Primary data saved (2187 records). [2025-10-29T17:05:24.301255] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-29T17:05:24.301335] [INFO ] [MAIN ] Update Progress: 49/2367 symbols completed. AFGE took 34.5s. Estimated remaining: 4h 13m 46s. Rate: 9.1 symbols/min [2025-10-29T17:05:24.400449] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-29T17:05:24.480059] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:05:24.498205] [DEBUG] [LOCAL ] AGD: Loaded 19061 existing records from primary storage. [2025-10-29T17:05:24.498523] [INFO ] [MAIN ] AGD: Loaded 19061 existing records. [2025-10-29T17:05:24.679399] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:05:24.679607] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-29T17:05:24.679686] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-29T17:05:24.679899] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-29T17:05:24.679955] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-29T17:05:25.039993] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:05:25.193587] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-29T17:05:25.589849] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T17:05:25.993621] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-29T17:05:26.069572] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T17:05:26.793594] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-29T17:05:27.255441] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T17:05:27.593545] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-29T17:05:27.968154] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T17:05:28.393553] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-29T17:05:29.193584] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-29T17:05:29.252445] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T17:05:29.263560] [INFO ] [REMOTE ] AFL: Full fetch complete (77058 records). [2025-10-29T17:05:29.263740] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-29T17:05:29.668758] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-29T17:05:29.669003] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-29T17:05:29.669901] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-29T17:05:29.669994] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-29T17:05:29.671786] [DEBUG] [LOCAL ] AFL: Trimmed 77058 records to 53145 (keeping 200 days of data) [2025-10-29T17:05:29.833284] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T17:05:30.003857] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-29T17:05:30.053210] [DEBUG] [LOCAL ] AFL: Primary data saved (53145 records). [2025-10-29T17:05:30.053373] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-29T17:05:30.053467] [INFO ] [MAIN ] Update Progress: 50/2367 symbols completed. AFL took 28.7s. Estimated remaining: 4h 13m 1s. Rate: 9.2 symbols/min [2025-10-29T17:05:30.228011] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:05:30.274760] [DEBUG] [LOCAL ] AGI: Loaded 53421 existing records from primary storage. [2025-10-29T17:05:30.275061] [INFO ] [MAIN ] AGI: Loaded 53421 existing records. [2025-10-29T17:05:30.484263] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:05:30.484537] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-29T17:05:30.484598] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-29T17:05:30.485178] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-29T17:05:30.485248] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-29T17:05:30.796499] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-29T17:05:30.894672] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:05:30.944129] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-29T17:05:30.993956] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-29T17:05:31.593518] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-29T17:05:31.742402] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T17:05:32.393566] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-29T17:05:33.036848] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-29T17:05:33.193566] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-29T17:05:33.466821] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T17:05:33.993575] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-29T17:05:34.594703] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-29T17:05:34.713838] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-29T17:05:34.793528] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-29T17:05:35.593605] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-29T17:05:36.087348] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-29T17:05:36.295891] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T17:05:36.393555] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-29T17:05:37.193591] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-29T17:05:37.500961] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T17:05:37.773705] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T17:05:37.993615] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-29T17:05:38.615423] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T17:05:38.793566] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-29T17:05:39.593586] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-29T17:05:39.611941] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T17:05:40.393594] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-29T17:05:41.042344] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T17:05:41.090697] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-29T17:05:41.193568] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-29T17:05:42.003088] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-29T17:05:42.005233] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-29T17:05:42.793565] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-29T17:05:43.185370] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T17:05:43.593593] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-29T17:05:44.294454] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T17:05:44.347430] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-29T17:05:44.393525] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-29T17:05:45.193562] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-29T17:05:45.993570] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-29T17:05:46.712830] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-29T17:05:46.750728] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-29T17:05:46.761634] [INFO ] [REMOTE ] AG: Full fetch complete (77795 records). [2025-10-29T17:05:46.761779] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-29T17:05:46.804118] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-29T17:05:47.156796] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-29T17:05:47.157020] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-29T17:05:47.157836] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-29T17:05:47.158010] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-29T17:05:47.177808] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-29T17:05:47.184875] [DEBUG] [LOCAL ] AG: Trimmed 77795 records to 53643 (keeping 200 days of data) [2025-10-29T17:05:47.186038] [INFO ] [REMOTE ] AGD: Full fetch complete (26212 records). [2025-10-29T17:05:47.186166] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-29T17:05:47.186948] [FATAL] [VALIDATOR ] AGD: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:05:47.245583] [FATAL] [MAIN ] AGD: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:05:47.276820] [WARN ] [MAIN ] AGD: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:05:47.279678] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-29T17:05:47.280782] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-29T17:05:47.281743] [INFO ] [LOCAL ] AGD: Starting deletion of derivative data. [2025-10-29T17:05:47.282399] [DEBUG] [LOCAL ] AGD: Deleted derivative data file. [2025-10-29T17:05:47.282517] [INFO ] [MAIN ] Update Progress: 51/2367 symbols completed. AGD took 23.0s. Estimated remaining: 4h 20m 60s. Rate: 8.9 symbols/min [2025-10-29T17:05:47.476395] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:05:47.602867] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-29T17:05:47.705191] [DEBUG] [LOCAL ] AGL: Loaded 52573 existing records from primary storage. [2025-10-29T17:05:47.727063] [INFO ] [MAIN ] AGL: Loaded 52573 existing records. [2025-10-29T17:05:47.853606] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-29T17:05:47.855968] [INFO ] [MAIN ] AG: Full history saved. [2025-10-29T17:05:47.856383] [INFO ] [MAIN ] Update Progress: 52/2367 symbols completed. AG took 33.1s. Estimated remaining: 4h 16m 18s. Rate: 9.0 symbols/min [2025-10-29T17:05:48.063245] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:05:48.069579] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-29T17:05:48.070274] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-29T17:05:48.096579] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-29T17:05:48.102059] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-29T17:05:48.195765] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:05:48.389623] [DEBUG] [LOCAL ] AGM: Loaded 10454 existing records from primary storage. [2025-10-29T17:05:48.422814] [INFO ] [MAIN ] AGM: Loaded 10454 existing records. [2025-10-29T17:05:48.692677] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:05:48.710868] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-29T17:05:48.709474] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-29T17:05:48.758779] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:05:48.759281] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-29T17:05:48.759337] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-29T17:05:48.759514] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-29T17:05:48.759555] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-29T17:05:49.149993] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:05:49.152115] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-29T17:05:49.193511] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-29T17:05:49.993601] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-29T17:05:50.024622] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:05:50.579183] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T17:05:50.793554] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-29T17:05:51.107894] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T17:05:51.121183] [INFO ] [REMOTE ] AGCO: Full fetch complete (61374 records). [2025-10-29T17:05:51.121349] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-29T17:05:51.545279] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-29T17:05:51.545357] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-29T17:05:51.545987] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-29T17:05:51.546051] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-29T17:05:51.547263] [DEBUG] [LOCAL ] AGCO: Trimmed 61374 records to 41777 (keeping 200 days of data) [2025-10-29T17:05:51.600769] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-29T17:05:51.816944] [DEBUG] [LOCAL ] AGCO: Primary data saved (41777 records). [2025-10-29T17:05:51.817106] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-29T17:05:51.818361] [INFO ] [MAIN ] Update Progress: 53/2367 symbols completed. AGCO took 29.9s. Estimated remaining: 4h 14m 14s. Rate: 9.1 symbols/min [2025-10-29T17:05:51.992444] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:05:52.034360] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T17:05:52.070438] [DEBUG] [LOCAL ] AGO: Loaded 27199 existing records from primary storage. [2025-10-29T17:05:52.070770] [INFO ] [MAIN ] AGO: Loaded 27199 existing records. [2025-10-29T17:05:52.244131] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:05:52.244338] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-29T17:05:52.244386] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-29T17:05:52.244720] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-29T17:05:52.244777] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-29T17:05:52.405009] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-29T17:05:52.397779] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-29T17:05:52.648306] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:05:53.193627] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-29T17:05:53.808931] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-29T17:05:53.993544] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-29T17:05:54.458361] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T17:05:54.793613] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-29T17:05:55.584723] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-29T17:05:55.595330] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-29T17:05:55.955382] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T17:05:56.393561] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-29T17:05:56.590586] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-29T17:05:56.801426] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T17:05:57.193592] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-29T17:05:57.993570] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-29T17:05:58.124078] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-29T17:05:58.793619] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-29T17:05:59.603935] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-29T17:05:59.610011] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-29T17:06:00.029083] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:06:00.045809] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-29T17:06:00.393558] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-29T17:06:01.193577] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-29T17:06:01.993555] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-29T17:06:02.137573] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-29T17:06:02.171465] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T17:06:02.657439] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-29T17:06:02.793627] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-29T17:06:03.262995] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T17:06:03.593594] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-29T17:06:04.393566] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-29T17:06:04.996078] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T17:06:05.193624] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-29T17:06:05.352582] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-29T17:06:05.993612] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-29T17:06:06.451492] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T17:06:06.793549] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-29T17:06:06.934063] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-29T17:06:07.593557] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-29T17:06:08.107344] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T17:06:08.334637] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T17:06:08.393531] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-29T17:06:09.193604] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-29T17:06:09.993598] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-29T17:06:10.022789] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-29T17:06:10.346951] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-29T17:06:10.358459] [INFO ] [REMOTE ] AGI: Full fetch complete (77386 records). [2025-10-29T17:06:10.358628] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-29T17:06:10.808470] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-29T17:06:10.787785] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T17:06:10.813589] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-29T17:06:10.816519] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-29T17:06:10.818119] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-29T17:06:10.818209] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-29T17:06:10.819871] [DEBUG] [LOCAL ] AGI: Trimmed 77386 records to 53421 (keeping 200 days of data) [2025-10-29T17:06:11.171741] [DEBUG] [LOCAL ] AGI: Primary data saved (53421 records). [2025-10-29T17:06:11.171881] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-29T17:06:11.171963] [INFO ] [MAIN ] Update Progress: 54/2367 symbols completed. AGI took 41.1s. Estimated remaining: 4h 23m 14s. Rate: 8.8 symbols/min [2025-10-29T17:06:11.377596] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:06:11.409386] [DEBUG] [LOCAL ] AGRO: Loaded 32033 existing records from primary storage. [2025-10-29T17:06:11.409755] [INFO ] [MAIN ] AGRO: Loaded 32033 existing records. [2025-10-29T17:06:11.597422] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-29T17:06:11.629972] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:06:11.630215] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-29T17:06:11.630269] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-29T17:06:11.630530] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-29T17:06:11.630570] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-29T17:06:12.075740] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T17:06:12.083365] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:06:12.393559] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-29T17:06:12.419513] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T17:06:13.193553] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-29T17:06:13.455020] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T17:06:13.949445] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T17:06:13.993554] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-29T17:06:14.706404] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T17:06:14.793562] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-29T17:06:15.593562] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-29T17:06:15.847900] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T17:06:16.393588] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-29T17:06:17.013029] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-29T17:06:17.130590] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-29T17:06:17.193573] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-29T17:06:17.993615] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-29T17:06:18.742630] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T17:06:18.793524] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-29T17:06:18.823100] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T17:06:18.825669] [INFO ] [REMOTE ] AGM: Full fetch complete (13246 records). [2025-10-29T17:06:18.825747] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-29T17:06:19.187027] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-29T17:06:19.187107] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-29T17:06:19.187352] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-29T17:06:19.187391] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-29T17:06:19.187914] [DEBUG] [LOCAL ] AGM: Trimmed 13246 records to 10447 (keeping 200 days of data) [2025-10-29T17:06:19.253341] [DEBUG] [LOCAL ] AGM: Primary data saved (10447 records). [2025-10-29T17:06:19.253471] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-29T17:06:19.253550] [INFO ] [MAIN ] Update Progress: 55/2367 symbols completed. AGM took 31.4s. Estimated remaining: 4h 23m 60s. Rate: 8.8 symbols/min [2025-10-29T17:06:19.431297] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:06:19.466678] [DEBUG] [LOCAL ] AGX: Loaded 32137 existing records from primary storage. [2025-10-29T17:06:19.466977] [INFO ] [MAIN ] AGX: Loaded 32137 existing records. [2025-10-29T17:06:19.607496] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-29T17:06:19.651820] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:06:19.652233] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-29T17:06:19.652302] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-29T17:06:19.652787] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-29T17:06:19.652845] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-29T17:06:20.005139] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:06:20.076105] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T17:06:20.082145] [INFO ] [REMOTE ] AGO: Full fetch complete (39584 records). [2025-10-29T17:06:20.082228] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-29T17:06:20.408333] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-29T17:06:20.456773] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-29T17:06:20.456838] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-29T17:06:20.457263] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-29T17:06:20.457302] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-29T17:06:20.458144] [DEBUG] [LOCAL ] AGO: Trimmed 39584 records to 27118 (keeping 200 days of data) [2025-10-29T17:06:20.619585] [DEBUG] [LOCAL ] AGO: Primary data saved (27118 records). [2025-10-29T17:06:20.619734] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-29T17:06:20.619826] [INFO ] [MAIN ] Update Progress: 56/2367 symbols completed. AGO took 28.8s. Estimated remaining: 4h 20m 7s. Rate: 8.9 symbols/min [2025-10-29T17:06:20.784862] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:06:20.818785] [DEBUG] [LOCAL ] AHH: Loaded 39694 existing records from primary storage. [2025-10-29T17:06:20.819053] [INFO ] [MAIN ] AHH: Loaded 39694 existing records. [2025-10-29T17:06:21.009313] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:06:21.009599] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-29T17:06:21.009782] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-29T17:06:21.010219] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-29T17:06:21.010305] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-29T17:06:21.116404] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-29T17:06:21.202466] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-29T17:06:21.414941] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:06:21.660401] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T17:06:21.993596] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-29T17:06:22.793540] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-29T17:06:22.895611] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-29T17:06:22.907358] [INFO ] [REMOTE ] AGL: Full fetch complete (75992 records). [2025-10-29T17:06:22.907506] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-29T17:06:23.357211] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T17:06:23.361195] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-29T17:06:23.361297] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-29T17:06:23.369796] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-29T17:06:23.369960] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-29T17:06:23.371524] [DEBUG] [LOCAL ] AGL: Trimmed 75992 records to 52567 (keeping 200 days of data) [2025-10-29T17:06:23.616993] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-29T17:06:23.660444] [DEBUG] [LOCAL ] AGL: Primary data saved (52567 records). [2025-10-29T17:06:23.660670] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-29T17:06:23.661561] [INFO ] [MAIN ] Update Progress: 57/2367 symbols completed. AGL took 36.4s. Estimated remaining: 4h 17m 29s. Rate: 9.0 symbols/min [2025-10-29T17:06:23.856478] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:06:23.856748] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-29T17:06:23.856876] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-29T17:06:23.857123] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-29T17:06:23.857233] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-29T17:06:23.857377] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-29T17:06:23.857519] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-29T17:06:23.999577] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T17:06:24.275610] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:06:24.393577] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-29T17:06:24.667197] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-29T17:06:25.193584] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-29T17:06:25.389672] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-29T17:06:25.993620] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-29T17:06:26.550275] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T17:06:26.793597] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-29T17:06:26.948169] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T17:06:27.593582] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-29T17:06:27.745417] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:06:27.745783] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-29T17:06:27.745887] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:06:27.745997] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-29T17:06:27.746074] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:06:27.746159] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-29T17:06:27.746238] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-29T17:06:27.746287] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-29T17:06:27.746339] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-29T17:06:27.746396] [INFO ] [MAIN ] Update Progress: 58/2367 symbols completed. AHL took 4.1s. Estimated remaining: 4h 15m 39s. Rate: 9.0 symbols/min [2025-10-29T17:06:27.933452] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:06:27.933625] [DEBUG] [LOCAL ] AHR: No existing data file found in primary storage. [2025-10-29T17:06:27.933838] [WARN ] [MAIN ] AHR: No existing data found, performing full refresh instead. [2025-10-29T17:06:27.933997] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-29T17:06:27.934144] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-29T17:06:27.934347] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-29T17:06:27.934466] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-29T17:06:28.139633] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T17:06:28.318219] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:06:28.393520] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-29T17:06:29.193563] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-29T17:06:29.594397] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T17:06:29.993594] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-29T17:06:30.228923] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T17:06:30.793534] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-29T17:06:30.979331] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T17:06:31.593569] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-29T17:06:31.907291] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:06:32.393551] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-29T17:06:32.720762] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T17:06:33.001588] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T17:06:33.193566] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-29T17:06:33.993544] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-29T17:06:34.411918] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T17:06:34.793585] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-29T17:06:35.161362] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T17:06:35.593595] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-29T17:06:35.883168] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T17:06:36.393604] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-29T17:06:36.699329] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T17:06:37.193535] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-29T17:06:37.331141] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T17:06:37.993612] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-29T17:06:38.339209] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T17:06:38.789868] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-29T17:06:38.795925] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-29T17:06:39.593591] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-29T17:06:39.846822] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T17:06:40.393696] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-29T17:06:40.854108] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T17:06:41.193562] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-29T17:06:41.395256] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-29T17:06:41.401795] [INFO ] [REMOTE ] AGRO: Full fetch complete (48602 records). [2025-10-29T17:06:41.401893] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-29T17:06:41.794915] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-29T17:06:41.794990] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-29T17:06:41.795481] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-29T17:06:41.795519] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-29T17:06:41.796532] [DEBUG] [LOCAL ] AGRO: Trimmed 48602 records to 31944 (keeping 200 days of data) [2025-10-29T17:06:41.980996] [DEBUG] [LOCAL ] AGRO: Primary data saved (31944 records). [2025-10-29T17:06:41.981178] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-29T17:06:41.981276] [INFO ] [MAIN ] Update Progress: 59/2367 symbols completed. AGRO took 30.8s. Estimated remaining: 4h 20m 29s. Rate: 8.9 symbols/min [2025-10-29T17:06:42.002522] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-29T17:06:42.153082] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:06:42.160393] [DEBUG] [LOCAL ] AHT: Loaded 6372 existing records from primary storage. [2025-10-29T17:06:42.160552] [INFO ] [MAIN ] AHT: Loaded 6372 existing records. [2025-10-29T17:06:42.339067] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:06:42.339458] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-29T17:06:42.339569] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-29T17:06:42.339800] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-29T17:06:42.339896] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-29T17:06:42.734929] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:06:42.737090] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T17:06:42.793530] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-29T17:06:43.240090] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T17:06:43.246268] [INFO ] [REMOTE ] AGX: Full fetch complete (48535 records). [2025-10-29T17:06:43.246363] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-29T17:06:43.595469] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-29T17:06:43.632500] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-29T17:06:43.632858] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-29T17:06:43.634481] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-29T17:06:43.634553] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-29T17:06:43.636322] [DEBUG] [LOCAL ] AGX: Trimmed 48535 records to 32103 (keeping 200 days of data) [2025-10-29T17:06:43.841028] [DEBUG] [LOCAL ] AGX: Primary data saved (32103 records). [2025-10-29T17:06:43.841260] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-29T17:06:43.841386] [INFO ] [MAIN ] Update Progress: 60/2367 symbols completed. AGX took 24.6s. Estimated remaining: 4h 17m 14s. Rate: 9.0 symbols/min [2025-10-29T17:06:44.011768] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:06:44.039601] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:06:44.095507] [DEBUG] [LOCAL ] AI: Loaded 53764 existing records from primary storage. [2025-10-29T17:06:44.095834] [INFO ] [MAIN ] AI: Loaded 53764 existing records. [2025-10-29T17:06:44.213491] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-29T17:06:44.280635] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:06:44.280867] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-29T17:06:44.280914] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-29T17:06:44.281515] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-29T17:06:44.281571] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-29T17:06:44.398702] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-29T17:06:44.649956] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:06:45.193556] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-29T17:06:45.571373] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T17:06:45.993553] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-29T17:06:46.431758] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T17:06:46.793631] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-29T17:06:47.593553] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-29T17:06:47.888122] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-29T17:06:48.121967] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T17:06:48.393635] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-29T17:06:48.514900] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-29T17:06:49.193613] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-29T17:06:49.613138] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-29T17:06:49.739140] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T17:06:49.993604] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-29T17:06:50.793706] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-29T17:06:50.953227] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T17:06:51.593551] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-29T17:06:51.799551] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T17:06:52.393556] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-29T17:06:52.525797] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T17:06:53.193603] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-29T17:06:53.993533] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-29T17:06:54.419388] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-29T17:06:54.429569] [INFO ] [REMOTE ] AHR: Full fetch complete (70859 records). [2025-10-29T17:06:54.429747] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-29T17:06:54.518884] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-29T17:06:54.799347] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-29T17:06:54.850681] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-29T17:06:54.850807] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-29T17:06:54.851622] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-29T17:06:54.851819] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-29T17:06:54.853877] [DEBUG] [LOCAL ] AHR: Trimmed 70859 records to 48823 (keeping 200 days of data) [2025-10-29T17:06:54.971605] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-29T17:06:55.180363] [DEBUG] [LOCAL ] AHR: Primary data saved (48823 records). [2025-10-29T17:06:55.180488] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-29T17:06:55.180558] [INFO ] [MAIN ] Update Progress: 61/2367 symbols completed. AHR took 27.4s. Estimated remaining: 4h 20m 3s. Rate: 8.9 symbols/min [2025-10-29T17:06:55.378910] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:06:55.428016] [DEBUG] [LOCAL ] AIG: Loaded 53447 existing records from primary storage. [2025-10-29T17:06:55.428311] [INFO ] [MAIN ] AIG: Loaded 53447 existing records. [2025-10-29T17:06:55.600745] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-29T17:06:55.616370] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:06:55.617323] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-29T17:06:55.617395] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-29T17:06:55.618133] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-29T17:06:55.618196] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-29T17:06:55.992615] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:06:56.013379] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T17:06:56.137764] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-29T17:06:56.393549] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-29T17:06:56.792974] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-29T17:06:57.193556] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-29T17:06:57.993619] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-29T17:06:58.586080] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T17:06:58.793528] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-29T17:06:59.003755] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-29T17:06:59.593528] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-29T17:07:00.071210] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T17:07:00.393539] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-29T17:07:00.621372] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-29T17:07:00.630117] [INFO ] [REMOTE ] AHH: Full fetch complete (59300 records). [2025-10-29T17:07:00.630269] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-29T17:07:00.971945] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-29T17:07:01.044720] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-29T17:07:01.044807] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-29T17:07:01.045451] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-29T17:07:01.045519] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-29T17:07:01.046805] [DEBUG] [LOCAL ] AHH: Trimmed 59300 records to 39635 (keeping 200 days of data) [2025-10-29T17:07:01.210484] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-29T17:07:01.281421] [DEBUG] [LOCAL ] AHH: Primary data saved (39635 records). [2025-10-29T17:07:01.281562] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-29T17:07:01.283051] [INFO ] [MAIN ] Update Progress: 62/2367 symbols completed. AHH took 40.7s. Estimated remaining: 4h 19m 31s. Rate: 8.9 symbols/min [2025-10-29T17:07:01.480095] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:07:01.480290] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-29T17:07:01.480356] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-29T17:07:01.480518] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-29T17:07:01.480584] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-29T17:07:01.480637] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-29T17:07:01.480719] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-29T17:07:01.915473] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:07:01.993542] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-29T17:07:02.171354] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:07:02.171638] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-29T17:07:02.171776] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:07:02.171856] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-29T17:07:02.171952] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:07:02.172039] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-29T17:07:02.172137] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-29T17:07:02.172210] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-29T17:07:02.172270] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-29T17:07:02.172320] [INFO ] [MAIN ] Update Progress: 63/2367 symbols completed. AII took 0.9s. Estimated remaining: 4h 15m 50s. Rate: 9.0 symbols/min [2025-10-29T17:07:02.353202] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:07:02.378048] [DEBUG] [LOCAL ] AIN: Loaded 24147 existing records from primary storage. [2025-10-29T17:07:02.378389] [INFO ] [MAIN ] AIN: Loaded 24147 existing records. [2025-10-29T17:07:02.590889] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-29T17:07:02.594622] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:07:02.605159] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-29T17:07:02.605234] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-29T17:07:02.606006] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-29T17:07:02.606066] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-29T17:07:02.801236] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-29T17:07:02.967992] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:07:03.593606] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-29T17:07:04.393551] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-29T17:07:04.452163] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T17:07:04.538177] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-29T17:07:05.051604] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T17:07:05.193563] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-29T17:07:05.993579] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-29T17:07:06.632901] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T17:07:06.793581] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-29T17:07:06.911971] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-29T17:07:07.593564] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-29T17:07:07.615369] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T17:07:08.043091] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-29T17:07:08.393577] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-29T17:07:09.193556] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-29T17:07:09.993527] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-29T17:07:10.114441] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T17:07:10.191762] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-29T17:07:10.793593] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-29T17:07:11.483334] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-29T17:07:11.593561] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-29T17:07:12.358313] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T17:07:12.393576] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-29T17:07:12.730335] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-29T17:07:13.189879] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T17:07:13.193693] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-29T17:07:13.817457] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T17:07:13.819472] [INFO ] [REMOTE ] AHT: Full fetch complete (9058 records). [2025-10-29T17:07:13.819538] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-29T17:07:14.003807] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-29T17:07:14.189679] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-29T17:07:14.189758] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-29T17:07:14.189950] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-29T17:07:14.189986] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-29T17:07:14.190370] [DEBUG] [LOCAL ] AHT: Trimmed 9058 records to 6421 (keeping 200 days of data) [2025-10-29T17:07:14.224277] [DEBUG] [LOCAL ] AHT: Primary data saved (6421 records). [2025-10-29T17:07:14.224349] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-29T17:07:14.224431] [INFO ] [MAIN ] Update Progress: 64/2367 symbols completed. AHT took 32.2s. Estimated remaining: 4h 18m 57s. Rate: 8.9 symbols/min [2025-10-29T17:07:14.388699] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:07:14.401223] [DEBUG] [LOCAL ] AIO: Loaded 12744 existing records from primary storage. [2025-10-29T17:07:14.401390] [INFO ] [MAIN ] AIO: Loaded 12744 existing records. [2025-10-29T17:07:14.574448] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:07:14.574709] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-29T17:07:14.574766] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-29T17:07:14.574972] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-29T17:07:14.575011] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-29T17:07:14.805438] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-29T17:07:14.933263] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:07:14.951114] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T17:07:15.593542] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-29T17:07:16.393578] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-29T17:07:16.470603] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-29T17:07:16.616069] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-29T17:07:17.193592] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-29T17:07:17.259584] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T17:07:17.993634] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-29T17:07:18.558542] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T17:07:18.605955] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-29T17:07:18.793597] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-29T17:07:19.593610] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-29T17:07:20.393551] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-29T17:07:20.489736] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T17:07:20.495294] [INFO ] [REMOTE ] AIN: Full fetch complete (33608 records). [2025-10-29T17:07:20.495417] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-29T17:07:20.496133] [FATAL] [VALIDATOR ] AIN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:07:20.496260] [FATAL] [MAIN ] AIN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:07:20.496312] [WARN ] [MAIN ] AIN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:07:20.496354] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-29T17:07:20.496419] [DEBUG] [LOCAL ] AIN: No primary data file found to delete. [2025-10-29T17:07:20.496456] [INFO ] [LOCAL ] AIN: Starting deletion of derivative data. [2025-10-29T17:07:20.496855] [DEBUG] [LOCAL ] AIN: Deleted derivative data file. [2025-10-29T17:07:20.497202] [INFO ] [MAIN ] Update Progress: 65/2367 symbols completed. AIN took 18.3s. Estimated remaining: 4h 18m 34s. Rate: 8.9 symbols/min [2025-10-29T17:07:20.702077] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:07:20.730738] [DEBUG] [LOCAL ] AIR: Loaded 28331 existing records from primary storage. [2025-10-29T17:07:20.731038] [INFO ] [MAIN ] AIR: Loaded 28331 existing records. [2025-10-29T17:07:20.927133] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:07:20.927599] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-29T17:07:20.927702] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-29T17:07:20.938156] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-29T17:07:20.952404] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-29T17:07:21.005307] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-29T17:07:21.145192] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T17:07:21.200438] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-29T17:07:21.373370] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:07:21.880860] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-29T17:07:21.993575] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-29T17:07:22.793561] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-29T17:07:23.593599] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-29T17:07:23.672206] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T17:07:23.723456] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-29T17:07:24.241946] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-29T17:07:24.393713] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-29T17:07:25.193549] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-29T17:07:25.298287] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T17:07:25.958692] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-29T17:07:25.993567] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-29T17:07:26.610934] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T17:07:26.793545] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-29T17:07:27.593573] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-29T17:07:27.741236] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-29T17:07:28.393624] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-29T17:07:29.079330] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T17:07:29.193632] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-29T17:07:29.993538] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-29T17:07:30.051739] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-29T17:07:30.148352] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-29T17:07:30.159694] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-29T17:07:30.159851] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-29T17:07:30.572490] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-29T17:07:30.572604] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-29T17:07:30.573560] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-29T17:07:30.573634] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-29T17:07:30.575680] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53766 (keeping 200 days of data) [2025-10-29T17:07:30.795803] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-29T17:07:30.887849] [DEBUG] [LOCAL ] AI: Primary data saved (53766 records). [2025-10-29T17:07:30.887967] [INFO ] [MAIN ] AI: Full history saved. [2025-10-29T17:07:30.888041] [INFO ] [MAIN ] Update Progress: 66/2367 symbols completed. AI took 47.0s. Estimated remaining: 4h 20m 34s. Rate: 8.8 symbols/min [2025-10-29T17:07:31.061421] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:07:31.087198] [DEBUG] [LOCAL ] AIT: Loaded 26110 existing records from primary storage. [2025-10-29T17:07:31.087430] [INFO ] [MAIN ] AIT: Loaded 26110 existing records. [2025-10-29T17:07:31.265636] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:07:31.265908] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-29T17:07:31.266015] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-29T17:07:31.266415] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-29T17:07:31.266457] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-29T17:07:31.595581] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-29T17:07:31.644374] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-29T17:07:31.649845] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:07:31.673475] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T17:07:32.194699] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T17:07:32.393628] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-29T17:07:33.121840] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T17:07:33.193558] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-29T17:07:33.770860] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-29T17:07:33.993603] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-29T17:07:34.793681] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-29T17:07:35.320033] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T17:07:35.593588] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-29T17:07:35.813992] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-29T17:07:36.285514] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-29T17:07:36.289129] [INFO ] [REMOTE ] AIO: Full fetch complete (20081 records). [2025-10-29T17:07:36.289220] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-29T17:07:36.398830] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-29T17:07:36.656100] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-29T17:07:36.656182] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-29T17:07:36.656475] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-29T17:07:36.656513] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-29T17:07:36.657065] [DEBUG] [LOCAL ] AIO: Trimmed 20081 records to 12727 (keeping 200 days of data) [2025-10-29T17:07:36.735495] [DEBUG] [LOCAL ] AIO: Primary data saved (12727 records). [2025-10-29T17:07:36.735662] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-29T17:07:36.735762] [INFO ] [MAIN ] Update Progress: 67/2367 symbols completed. AIO took 22.5s. Estimated remaining: 4h 19m 55s. Rate: 8.8 symbols/min [2025-10-29T17:07:36.908954] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:07:36.943972] [DEBUG] [LOCAL ] AIV: Loaded 41743 existing records from primary storage. [2025-10-29T17:07:36.944244] [INFO ] [MAIN ] AIV: Loaded 41743 existing records. [2025-10-29T17:07:37.115718] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:07:37.115910] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-29T17:07:37.116002] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-29T17:07:37.116406] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-29T17:07:37.116447] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-29T17:07:37.197717] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-29T17:07:37.489001] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:07:37.505096] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:07:37.993556] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-29T17:07:38.701080] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T17:07:38.793596] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-29T17:07:39.318930] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T17:07:39.593539] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-29T17:07:40.246042] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T17:07:40.393543] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-29T17:07:40.580199] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T17:07:41.193606] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-29T17:07:41.395702] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:07:41.993524] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-29T17:07:42.175436] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T17:07:42.793581] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-29T17:07:43.280890] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T17:07:43.593524] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-29T17:07:43.841312] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T17:07:44.166914] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-29T17:07:44.177834] [INFO ] [REMOTE ] AIG: Full fetch complete (77558 records). [2025-10-29T17:07:44.177950] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-29T17:07:44.398810] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-29T17:07:44.574513] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-29T17:07:44.574611] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-29T17:07:44.575363] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-29T17:07:44.575416] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-29T17:07:44.576960] [DEBUG] [LOCAL ] AIG: Trimmed 77558 records to 53447 (keeping 200 days of data) [2025-10-29T17:07:44.901791] [DEBUG] [LOCAL ] AIG: Primary data saved (53447 records). [2025-10-29T17:07:44.901924] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-29T17:07:44.902706] [INFO ] [MAIN ] Update Progress: 68/2367 symbols completed. AIG took 49.7s. Estimated remaining: 4h 20m 35s. Rate: 8.8 symbols/min [2025-10-29T17:07:45.072145] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:07:45.098909] [DEBUG] [LOCAL ] AIZ: Loaded 28784 existing records from primary storage. [2025-10-29T17:07:45.099179] [INFO ] [MAIN ] AIZ: Loaded 28784 existing records. [2025-10-29T17:07:45.196966] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-29T17:07:45.280290] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:07:45.280591] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-29T17:07:45.280677] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-29T17:07:45.280979] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-29T17:07:45.281037] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-29T17:07:45.642113] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:07:45.663077] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T17:07:45.993557] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-29T17:07:46.543364] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T17:07:46.551459] [INFO ] [REMOTE ] AIR: Full fetch complete (40141 records). [2025-10-29T17:07:46.551557] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-29T17:07:46.799438] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-29T17:07:46.992429] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-29T17:07:46.992526] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-29T17:07:46.993011] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-29T17:07:46.993123] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-29T17:07:46.999619] [DEBUG] [LOCAL ] AIR: Trimmed 40141 records to 28373 (keeping 200 days of data) [2025-10-29T17:07:47.009506] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-29T17:07:47.194302] [DEBUG] [LOCAL ] AIR: Primary data saved (28373 records). [2025-10-29T17:07:47.194433] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-29T17:07:47.194532] [INFO ] [MAIN ] Update Progress: 69/2367 symbols completed. AIR took 26.7s. Estimated remaining: 4h 17m 58s. Rate: 8.9 symbols/min [2025-10-29T17:07:47.403631] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:07:47.409747] [DEBUG] [LOCAL ] AIZN: Loaded 3629 existing records from primary storage. [2025-10-29T17:07:47.409949] [INFO ] [MAIN ] AIZN: Loaded 3629 existing records. [2025-10-29T17:07:47.591236] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:07:47.591438] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-29T17:07:47.591532] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-29T17:07:47.591717] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-29T17:07:47.591773] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-29T17:07:47.602783] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-29T17:07:47.997037] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:07:48.020171] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T17:07:48.393565] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-29T17:07:48.834394] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:07:49.187336] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-29T17:07:49.195689] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-29T17:07:49.581919] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-29T17:07:49.993597] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-29T17:07:50.793569] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-29T17:07:51.097195] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T17:07:51.098458] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T17:07:51.593549] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-29T17:07:52.393590] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-29T17:07:52.766631] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T17:07:53.193611] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-29T17:07:53.307066] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T17:07:53.993570] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-29T17:07:54.021886] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-29T17:07:54.793553] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-29T17:07:55.180582] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T17:07:55.191181] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T17:07:55.593567] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-29T17:07:55.863196] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-29T17:07:56.393612] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-29T17:07:56.718050] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-29T17:07:57.193567] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-29T17:07:57.993569] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-29T17:07:58.165037] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T17:07:58.344546] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-29T17:07:58.793596] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-29T17:07:59.065486] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-29T17:07:59.593549] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-29T17:08:00.393526] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-29T17:08:00.585148] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T17:08:00.927168] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T17:08:01.193595] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-29T17:08:01.726943] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T17:08:01.993571] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-29T17:08:02.432297] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-29T17:08:02.433610] [INFO ] [REMOTE ] AIZN: Full fetch complete (5531 records). [2025-10-29T17:08:02.433707] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-29T17:08:02.793018] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-29T17:08:02.793112] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-29T17:08:02.793338] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-29T17:08:02.793386] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-29T17:08:02.793810] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-29T17:08:02.794398] [DEBUG] [LOCAL ] AIZN: Trimmed 5531 records to 3613 (keeping 200 days of data) [2025-10-29T17:08:02.826093] [DEBUG] [LOCAL ] AIZN: Primary data saved (3613 records). [2025-10-29T17:08:02.826246] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-29T17:08:02.826332] [INFO ] [MAIN ] Update Progress: 70/2367 symbols completed. AIZN took 15.6s. Estimated remaining: 4h 22m 43s. Rate: 8.7 symbols/min [2025-10-29T17:08:03.002923] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:08:03.044724] [DEBUG] [LOCAL ] AJG: Loaded 46201 existing records from primary storage. [2025-10-29T17:08:03.045041] [INFO ] [MAIN ] AJG: Loaded 46201 existing records. [2025-10-29T17:08:03.228248] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:08:03.228473] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-29T17:08:03.228520] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-29T17:08:03.229019] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-29T17:08:03.229076] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-29T17:08:03.596770] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:08:03.596855] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-29T17:08:03.779512] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T17:08:04.393557] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-29T17:08:04.620439] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-29T17:08:05.193560] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-29T17:08:05.752018] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T17:08:05.993555] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-29T17:08:06.160559] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-29T17:08:06.793620] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-29T17:08:07.467990] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-29T17:08:07.593529] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-29T17:08:07.778458] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T17:08:08.393547] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-29T17:08:08.889366] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T17:08:09.193561] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-29T17:08:09.598261] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T17:08:09.993564] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-29T17:08:10.641957] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T17:08:10.651880] [INFO ] [REMOTE ] AIV: Full fetch complete (60328 records). [2025-10-29T17:08:10.652007] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-29T17:08:10.798845] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-29T17:08:11.058902] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-29T17:08:11.059203] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-29T17:08:11.059856] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-29T17:08:11.059918] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-29T17:08:11.061302] [DEBUG] [LOCAL ] AIV: Trimmed 60328 records to 41758 (keeping 200 days of data) [2025-10-29T17:08:11.300448] [DEBUG] [LOCAL ] AIV: Primary data saved (41758 records). [2025-10-29T17:08:11.300619] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-29T17:08:11.300754] [INFO ] [MAIN ] Update Progress: 71/2367 symbols completed. AIV took 34.6s. Estimated remaining: 4h 23m 29s. Rate: 8.7 symbols/min [2025-10-29T17:08:11.475271] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:08:11.475482] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-29T17:08:11.475553] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-29T17:08:11.475760] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-29T17:08:11.475823] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-29T17:08:11.476000] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-29T17:08:11.476137] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-29T17:08:11.597777] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-29T17:08:11.891586] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:08:11.894668] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-29T17:08:11.920896] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T17:08:12.393562] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-29T17:08:12.587457] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T17:08:13.089332] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T17:08:13.193600] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-29T17:08:13.716519] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-29T17:08:13.993592] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-29T17:08:14.793571] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-29T17:08:15.195738] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T17:08:15.593538] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-29T17:08:15.709895] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T17:08:16.393580] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-29T17:08:16.882549] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T17:08:17.193610] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-29T17:08:17.328204] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T17:08:17.333206] [INFO ] [REMOTE ] AIT: Full fetch complete (38924 records). [2025-10-29T17:08:17.333293] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-29T17:08:17.517140] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-29T17:08:17.713483] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-29T17:08:17.713559] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-29T17:08:17.714043] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-29T17:08:17.714105] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-29T17:08:17.714946] [DEBUG] [LOCAL ] AIT: Trimmed 38924 records to 26097 (keeping 200 days of data) [2025-10-29T17:08:17.871632] [DEBUG] [LOCAL ] AIT: Primary data saved (26097 records). [2025-10-29T17:08:17.871780] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-29T17:08:17.871857] [INFO ] [MAIN ] Update Progress: 72/2367 symbols completed. AIT took 47.0s. Estimated remaining: 4h 23m 12s. Rate: 8.7 symbols/min [2025-10-29T17:08:18.008509] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-29T17:08:18.044584] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:08:18.089437] [DEBUG] [LOCAL ] AKR: Loaded 45895 existing records from primary storage. [2025-10-29T17:08:18.089884] [INFO ] [MAIN ] AKR: Loaded 45895 existing records. [2025-10-29T17:08:18.274405] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:08:18.274630] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-29T17:08:18.274710] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-29T17:08:18.275221] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-29T17:08:18.275279] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-29T17:08:18.621979] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:08:18.793528] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-29T17:08:18.901696] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T17:08:19.593619] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-29T17:08:20.090542] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T17:08:20.393620] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-29T17:08:20.519762] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T17:08:20.525507] [INFO ] [REMOTE ] AIZ: Full fetch complete (42594 records). [2025-10-29T17:08:20.525622] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-29T17:08:20.904539] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-29T17:08:20.904613] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-29T17:08:20.905079] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-29T17:08:20.905137] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-29T17:08:20.906010] [DEBUG] [LOCAL ] AIZ: Trimmed 42594 records to 28714 (keeping 200 days of data) [2025-10-29T17:08:21.077541] [DEBUG] [LOCAL ] AIZ: Primary data saved (28714 records). [2025-10-29T17:08:21.077695] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-29T17:08:21.077791] [INFO ] [MAIN ] Update Progress: 73/2367 symbols completed. AIZ took 36.2s. Estimated remaining: 4h 21m 9s. Rate: 8.8 symbols/min [2025-10-29T17:08:21.198903] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-29T17:08:21.267257] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:08:21.317474] [DEBUG] [LOCAL ] AL: Loaded 44696 existing records from primary storage. [2025-10-29T17:08:21.317958] [INFO ] [MAIN ] AL: Loaded 44696 existing records. [2025-10-29T17:08:21.508364] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:08:21.508716] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-29T17:08:21.508783] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-29T17:08:21.509148] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-29T17:08:21.509196] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-29T17:08:21.916434] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:08:21.944456] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T17:08:21.993562] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-29T17:08:22.138478] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T17:08:22.793617] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-29T17:08:23.123821] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T17:08:23.593555] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-29T17:08:23.838594] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T17:08:24.393585] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-29T17:08:24.772234] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T17:08:24.801389] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T17:08:25.193584] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-29T17:08:25.993583] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-29T17:08:26.273792] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-29T17:08:26.738073] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T17:08:26.750764] [INFO ] [REMOTE ] AJG: Full fetch complete (68704 records). [2025-10-29T17:08:26.750943] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-29T17:08:26.803488] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-29T17:08:27.158050] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-29T17:08:27.158136] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-29T17:08:27.158821] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-29T17:08:27.158884] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-29T17:08:27.160220] [DEBUG] [LOCAL ] AJG: Trimmed 68704 records to 46216 (keeping 200 days of data) [2025-10-29T17:08:27.258329] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-29T17:08:27.458465] [DEBUG] [LOCAL ] AJG: Primary data saved (46216 records). [2025-10-29T17:08:27.458605] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-29T17:08:27.459488] [INFO ] [MAIN ] Update Progress: 74/2367 symbols completed. AJG took 24.6s. Estimated remaining: 4h 20m 49s. Rate: 8.8 symbols/min [2025-10-29T17:08:27.605175] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-29T17:08:27.638526] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:08:27.689752] [DEBUG] [LOCAL ] ALB: Loaded 53356 existing records from primary storage. [2025-10-29T17:08:27.690072] [INFO ] [MAIN ] ALB: Loaded 53356 existing records. [2025-10-29T17:08:27.867569] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:08:27.867860] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-29T17:08:27.867926] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-29T17:08:27.868238] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-29T17:08:27.868299] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-29T17:08:28.245728] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:08:28.393559] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-29T17:08:28.664176] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-29T17:08:28.796725] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T17:08:29.193623] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-29T17:08:29.993600] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-29T17:08:30.372601] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T17:08:30.793624] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-29T17:08:31.035119] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-29T17:08:31.593542] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-29T17:08:31.625465] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-29T17:08:31.835217] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-29T17:08:32.393612] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-29T17:08:32.616867] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-29T17:08:33.193601] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-29T17:08:33.783323] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T17:08:33.784877] [INFO ] [REMOTE ] AKA: Full fetch complete (2824 records). [2025-10-29T17:08:33.784946] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-29T17:08:33.964005] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-29T17:08:33.964235] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:08:33.964339] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:08:33.964430] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-29T17:08:33.964517] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-29T17:08:33.964577] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-29T17:08:33.964670] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-29T17:08:33.964773] [INFO ] [MAIN ] Update Progress: 75/2367 symbols completed. AKA took 22.7s. Estimated remaining: 4h 20m 32s. Rate: 8.8 symbols/min [2025-10-29T17:08:33.999099] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-29T17:08:34.140040] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:08:34.140201] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-10-29T17:08:34.140237] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-10-29T17:08:34.140344] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-29T17:08:34.140384] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-29T17:08:34.140425] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-29T17:08:34.140455] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-29T17:08:34.492823] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:08:34.793607] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-29T17:08:35.479737] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-29T17:08:35.593543] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-29T17:08:35.983331] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T17:08:36.393555] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-29T17:08:37.005181] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T17:08:37.193563] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-29T17:08:37.411456] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-29T17:08:37.993544] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-29T17:08:38.430235] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T17:08:38.793615] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-29T17:08:39.060391] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T17:08:39.593559] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-29T17:08:40.393572] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-29T17:08:40.553230] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-29T17:08:40.733429] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T17:08:41.193549] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-29T17:08:41.619109] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T17:08:41.993610] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-29T17:08:42.273624] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T17:08:42.793607] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-29T17:08:43.256844] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T17:08:43.593606] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-29T17:08:44.393548] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-29T17:08:44.449472] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-29T17:08:44.725537] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T17:08:45.193570] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-29T17:08:45.546320] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:08:45.993559] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-29T17:08:46.291089] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T17:08:46.793550] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-29T17:08:47.352874] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-29T17:08:47.593607] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-29T17:08:48.050151] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T17:08:48.393538] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-29T17:08:49.193526] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-29T17:08:49.309262] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-29T17:08:49.856934] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T17:08:49.866640] [INFO ] [REMOTE ] AKR: Full fetch complete (65485 records). [2025-10-29T17:08:49.866806] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-29T17:08:50.005528] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-29T17:08:50.258068] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-29T17:08:50.258236] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-29T17:08:50.258951] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-29T17:08:50.259015] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-29T17:08:50.260267] [DEBUG] [LOCAL ] AKR: Trimmed 65485 records to 45938 (keeping 200 days of data) [2025-10-29T17:08:50.416505] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T17:08:50.578750] [DEBUG] [LOCAL ] AKR: Primary data saved (45938 records). [2025-10-29T17:08:50.578875] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-29T17:08:50.578950] [INFO ] [MAIN ] Update Progress: 76/2367 symbols completed. AKR took 32.7s. Estimated remaining: 4h 25m 21s. Rate: 8.6 symbols/min [2025-10-29T17:08:50.751448] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:08:50.781386] [DEBUG] [LOCAL ] ALE: Loaded 31763 existing records from primary storage. [2025-10-29T17:08:50.781675] [INFO ] [MAIN ] ALE: Loaded 31763 existing records. [2025-10-29T17:08:50.802174] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-29T17:08:50.959567] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:08:50.959810] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-29T17:08:50.959859] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-29T17:08:50.960148] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-29T17:08:50.960205] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-29T17:08:51.319047] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:08:51.344492] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T17:08:51.593571] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-29T17:08:52.393558] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-29T17:08:52.513382] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-29T17:08:52.761492] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T17:08:53.193545] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-29T17:08:53.278887] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-29T17:08:53.993582] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-29T17:08:54.562030] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T17:08:54.793564] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-29T17:08:55.268802] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:08:55.593614] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-29T17:08:56.393550] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-29T17:08:56.435058] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T17:08:56.447083] [INFO ] [REMOTE ] ALC: Full fetch complete (73950 records). [2025-10-29T17:08:56.447316] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-29T17:08:56.900738] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-29T17:08:56.900956] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-29T17:08:56.901867] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-29T17:08:56.901954] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-29T17:08:56.903859] [DEBUG] [LOCAL ] ALC: Trimmed 73950 records to 51123 (keeping 200 days of data) [2025-10-29T17:08:57.017581] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-29T17:08:57.217679] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-29T17:08:57.265897] [DEBUG] [LOCAL ] ALC: Primary data saved (51123 records). [2025-10-29T17:08:57.266038] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-29T17:08:57.266120] [INFO ] [MAIN ] Update Progress: 77/2367 symbols completed. ALC took 23.3s. Estimated remaining: 4h 25m 6s. Rate: 8.6 symbols/min [2025-10-29T17:08:57.993612] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-29T17:08:58.142186] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-29T17:08:58.255711] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T17:08:58.689131] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-29T17:08:58.793523] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-29T17:08:59.593535] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-29T17:09:00.322123] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T17:09:00.393557] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-29T17:09:00.665487] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T17:09:01.193534] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-29T17:09:01.993625] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-29T17:09:02.280457] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-29T17:09:02.509020] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-29T17:09:02.520410] [INFO ] [REMOTE ] ALB: Full fetch complete (77125 records). [2025-10-29T17:09:02.520592] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-29T17:09:02.796257] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-29T17:09:02.917371] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-29T17:09:02.917594] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-29T17:09:02.918545] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-29T17:09:02.918672] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-29T17:09:02.937820] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-29T17:09:02.945062] [DEBUG] [LOCAL ] ALB: Trimmed 77125 records to 53354 (keeping 200 days of data) [2025-10-29T17:09:03.263867] [DEBUG] [LOCAL ] ALB: Primary data saved (53354 records). [2025-10-29T17:09:03.264021] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-29T17:09:03.264616] [INFO ] [MAIN ] Update Progress: 78/2367 symbols completed. ALB took 35.8s. Estimated remaining: 4h 24m 31s. Rate: 8.7 symbols/min [2025-10-29T17:09:03.593621] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-29T17:09:04.178306] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:09:04.393590] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-29T17:09:04.523431] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T17:09:05.193556] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-29T17:09:05.987047] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T17:09:05.993511] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-29T17:09:06.051065] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T17:09:06.062717] [INFO ] [REMOTE ] AL: Full fetch complete (63895 records). [2025-10-29T17:09:06.062944] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-29T17:09:06.476662] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-29T17:09:06.476788] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-29T17:09:06.477683] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-29T17:09:06.477824] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-29T17:09:06.479996] [DEBUG] [LOCAL ] AL: Trimmed 63895 records to 44711 (keeping 200 days of data) [2025-10-29T17:09:06.789290] [DEBUG] [LOCAL ] AL: Primary data saved (44711 records). [2025-10-29T17:09:06.789486] [INFO ] [MAIN ] AL: Full history saved. [2025-10-29T17:09:06.790253] [INFO ] [MAIN ] Update Progress: 79/2367 symbols completed. AL took 45.7s. Estimated remaining: 4h 22m 45s. Rate: 8.7 symbols/min [2025-10-29T17:09:06.872037] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T17:09:06.880851] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-29T17:09:07.988383] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T17:09:07.996306] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-29T17:09:09.037441] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T17:09:09.049171] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-29T17:09:10.202981] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T17:09:10.211244] [INFO ] [REMOTE ] ALE: Full fetch complete (44372 records). [2025-10-29T17:09:10.211381] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-29T17:09:10.645790] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-29T17:09:10.645883] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-29T17:09:10.646466] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-29T17:09:10.646530] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-29T17:09:10.647506] [DEBUG] [LOCAL ] ALE: Trimmed 44372 records to 31738 (keeping 200 days of data) [2025-10-29T17:09:10.848033] [DEBUG] [LOCAL ] ALE: Primary data saved (31738 records). [2025-10-29T17:09:10.848167] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-29T17:09:10.848247] [INFO ] [MAIN ] Update Progress: 80/2367 symbols completed. ALE took 20.3s. Estimated remaining: 4h 21m 18s. Rate: 8.8 symbols/min [2025-10-29T17:09:11.577371] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:11.586854] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:11.610440] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:11.632901] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:11.633431] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-29T17:09:11.633487] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-29T17:09:11.633629] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-29T17:09:11.633745] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-29T17:09:11.633803] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-29T17:09:11.633837] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-29T17:09:11.756219] [DEBUG] [LOCAL ] ALG: Loaded 9482 existing records from primary storage. [2025-10-29T17:09:11.778949] [INFO ] [MAIN ] ALG: Loaded 9482 existing records. [2025-10-29T17:09:11.872423] [DEBUG] [LOCAL ] ALEX: Loaded 30222 existing records from primary storage. [2025-10-29T17:09:11.895216] [INFO ] [MAIN ] ALEX: Loaded 30222 existing records. [2025-10-29T17:09:12.043448] [DEBUG] [LOCAL ] ALIT: Loaded 52756 existing records from primary storage. [2025-10-29T17:09:12.114230] [INFO ] [MAIN ] ALIT: Loaded 52756 existing records. [2025-10-29T17:09:12.527403] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:09:12.565408] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:09:12.583010] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-29T17:09:12.583131] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-29T17:09:12.582914] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-29T17:09:12.583495] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-29T17:09:12.623096] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-29T17:09:12.633842] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:12.662915] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-29T17:09:12.682422] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-29T17:09:12.717359] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-29T17:09:12.724735] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-29T17:09:12.770226] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:09:12.816310] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-29T17:09:12.873318] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-29T17:09:12.913552] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-29T17:09:12.940867] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-29T17:09:12.988681] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:09:13.046969] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-29T17:09:13.201773] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:09:13.323571] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-29T17:09:13.416303] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:09:13.437175] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-29T17:09:13.527933] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-29T17:09:13.539165] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-29T17:09:13.696465] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-29T17:09:13.790108] [INFO ] [MAIN ] Update Progress: 81/2367 symbols completed. ALH took 2.9s. Estimated remaining: 4h 19m 20s. Rate: 8.8 symbols/min [2025-10-29T17:09:13.800935] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:13.806471] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-29T17:09:13.765695] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:13.822997] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-29T17:09:14.077577] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:14.094329] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-29T17:09:14.097419] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:14.145192] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-29T17:09:14.145549] [INFO ] [MAIN ] ALK: Loaded 53087 existing records. [2025-10-29T17:09:14.322883] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:09:14.323051] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-29T17:09:14.323099] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-29T17:09:14.323425] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-29T17:09:14.323465] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-29T17:09:14.701488] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T17:09:14.705446] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:14.709077] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-29T17:09:14.709295] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-29T17:09:14.903094] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T17:09:14.909159] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-29T17:09:15.415369] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:09:15.416397] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T17:09:15.426999] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-29T17:09:15.593517] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-29T17:09:15.689338] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T17:09:16.059183] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T17:09:16.316206] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T17:09:16.393525] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-29T17:09:16.482566] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T17:09:17.193559] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-29T17:09:17.502379] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:09:17.993599] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-29T17:09:18.241081] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-29T17:09:18.793553] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-29T17:09:19.262083] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T17:09:19.593687] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-29T17:09:20.057050] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T17:09:20.393538] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-29T17:09:20.424578] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T17:09:21.193592] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-29T17:09:21.479363] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T17:09:21.993596] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-29T17:09:22.223093] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T17:09:22.555917] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-29T17:09:22.793606] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-29T17:09:23.314692] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-29T17:09:23.593589] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-29T17:09:24.328691] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-29T17:09:24.393535] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-29T17:09:25.198718] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-29T17:09:25.211616] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T17:09:25.993565] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-29T17:09:26.478291] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T17:09:26.689790] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T17:09:26.793577] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-29T17:09:27.316230] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T17:09:27.593559] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-29T17:09:28.393676] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-29T17:09:29.114243] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-29T17:09:29.193593] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-29T17:09:29.916489] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-29T17:09:29.993715] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-29T17:09:30.340073] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:09:30.793609] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-29T17:09:31.252243] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:09:31.269162] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-29T17:09:31.593541] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-29T17:09:32.080662] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-29T17:09:32.393580] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-29T17:09:32.960158] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-29T17:09:32.962256] [INFO ] [REMOTE ] ALG: Full fetch complete (14944 records). [2025-10-29T17:09:32.962329] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-29T17:09:33.198749] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-29T17:09:33.344908] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-29T17:09:33.345003] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-29T17:09:33.345334] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-29T17:09:33.345384] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-29T17:09:33.346174] [DEBUG] [LOCAL ] ALG: Trimmed 14944 records to 9448 (keeping 200 days of data) [2025-10-29T17:09:33.406047] [DEBUG] [LOCAL ] ALG: Primary data saved (9448 records). [2025-10-29T17:09:33.406192] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-29T17:09:33.406274] [INFO ] [MAIN ] Update Progress: 82/2367 symbols completed. ALG took 22.5s. Estimated remaining: 4h 25m 10s. Rate: 8.6 symbols/min [2025-10-29T17:09:33.579892] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:33.625831] [DEBUG] [LOCAL ] ALL: Loaded 49407 existing records from primary storage. [2025-10-29T17:09:33.626167] [INFO ] [MAIN ] ALL: Loaded 49407 existing records. [2025-10-29T17:09:33.810747] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:09:33.810959] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-29T17:09:33.811006] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-29T17:09:33.811470] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-29T17:09:33.811509] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-29T17:09:33.999669] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-29T17:09:34.176186] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:34.536021] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T17:09:34.793593] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-29T17:09:34.867358] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T17:09:35.593566] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-29T17:09:36.187960] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T17:09:36.393550] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-29T17:09:37.134289] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T17:09:37.145406] [INFO ] [REMOTE ] ALIT: Full fetch complete (76622 records). [2025-10-29T17:09:37.145534] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-29T17:09:37.203706] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-29T17:09:37.565049] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-29T17:09:37.565163] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-29T17:09:37.566018] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-29T17:09:37.566228] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-29T17:09:37.568089] [DEBUG] [LOCAL ] ALIT: Trimmed 76622 records to 52758 (keeping 200 days of data) [2025-10-29T17:09:37.814702] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T17:09:37.934090] [DEBUG] [LOCAL ] ALIT: Primary data saved (52758 records). [2025-10-29T17:09:37.934226] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-29T17:09:37.934327] [INFO ] [MAIN ] Update Progress: 83/2367 symbols completed. ALIT took 27.1s. Estimated remaining: 4h 23m 56s. Rate: 8.7 symbols/min [2025-10-29T17:09:38.006569] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-29T17:09:38.129574] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:38.129795] [DEBUG] [LOCAL ] ALLE: No existing data file found in primary storage. [2025-10-29T17:09:38.129867] [WARN ] [MAIN ] ALLE: No existing data found, performing full refresh instead. [2025-10-29T17:09:38.130037] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-29T17:09:38.130088] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-29T17:09:38.130132] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-29T17:09:38.130174] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-29T17:09:38.545331] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:38.613249] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T17:09:38.793581] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-29T17:09:38.902912] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-29T17:09:39.593629] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-29T17:09:40.050491] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T17:09:40.393543] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-29T17:09:40.655609] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T17:09:41.193594] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-29T17:09:41.650523] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:09:41.993565] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-29T17:09:42.132489] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-29T17:09:42.793565] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-29T17:09:43.479288] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-29T17:09:43.593719] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-29T17:09:44.231137] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-29T17:09:44.393631] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-29T17:09:44.996597] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T17:09:45.193631] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-29T17:09:45.309265] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-29T17:09:45.316076] [INFO ] [REMOTE ] ALEX: Full fetch complete (44586 records). [2025-10-29T17:09:45.316222] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-29T17:09:45.695318] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-29T17:09:45.695405] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-29T17:09:45.695918] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-29T17:09:45.696012] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-29T17:09:45.697060] [DEBUG] [LOCAL ] ALEX: Trimmed 44586 records to 30183 (keeping 200 days of data) [2025-10-29T17:09:45.882806] [DEBUG] [LOCAL ] ALEX: Primary data saved (30183 records). [2025-10-29T17:09:45.883002] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-29T17:09:45.883111] [INFO ] [MAIN ] Update Progress: 84/2367 symbols completed. ALEX took 35.0s. Estimated remaining: 4h 24m 17s. Rate: 8.6 symbols/min [2025-10-29T17:09:45.998931] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-29T17:09:46.146633] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:46.200831] [DEBUG] [LOCAL ] ALLY: Loaded 53200 existing records from primary storage. [2025-10-29T17:09:46.201301] [INFO ] [MAIN ] ALLY: Loaded 53200 existing records. [2025-10-29T17:09:46.417442] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:09:46.418160] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-29T17:09:46.418302] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-29T17:09:46.418919] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-29T17:09:46.418998] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-29T17:09:46.631127] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-29T17:09:46.798805] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-29T17:09:46.862682] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:47.526489] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T17:09:47.538195] [INFO ] [REMOTE ] ALK: Full fetch complete (77041 records). [2025-10-29T17:09:47.538370] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-29T17:09:47.604379] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-29T17:09:47.937883] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-29T17:09:47.937973] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-29T17:09:47.938791] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-29T17:09:47.938859] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-29T17:09:47.940294] [DEBUG] [LOCAL ] ALK: Trimmed 77041 records to 53087 (keeping 200 days of data) [2025-10-29T17:09:48.248219] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-29T17:09:48.248524] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-29T17:09:48.248693] [INFO ] [MAIN ] Update Progress: 85/2367 symbols completed. ALK took 34.4s. Estimated remaining: 4h 22m 7s. Rate: 8.7 symbols/min [2025-10-29T17:09:48.400147] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-29T17:09:48.432209] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:09:48.470988] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-29T17:09:48.520592] [DEBUG] [LOCAL ] ALSN: Loaded 42985 existing records from primary storage. [2025-10-29T17:09:48.521044] [INFO ] [MAIN ] ALSN: Loaded 42985 existing records. [2025-10-29T17:09:48.733131] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:09:48.733400] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-29T17:09:48.733452] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-29T17:09:48.733910] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-29T17:09:48.733969] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-29T17:09:49.109309] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:09:49.176323] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-29T17:09:49.193534] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-29T17:09:49.862562] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-29T17:09:49.993586] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-29T17:09:50.306332] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T17:09:50.793562] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-29T17:09:51.168849] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T17:09:51.593570] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-29T17:09:51.888780] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T17:09:52.393560] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-29T17:09:52.754491] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-29T17:09:53.193554] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-29T17:09:53.585822] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T17:09:53.993557] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-29T17:09:54.293233] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T17:09:54.793592] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-29T17:09:55.190868] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T17:09:55.593544] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-29T17:09:55.928305] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T17:09:56.393556] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-29T17:09:56.751103] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T17:09:57.193580] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-29T17:09:57.602762] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T17:09:57.993592] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-29T17:09:58.237271] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T17:09:58.793575] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-29T17:09:59.374486] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T17:09:59.593564] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-29T17:10:00.034781] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:10:00.393560] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-29T17:10:01.193685] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-29T17:10:01.729933] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-29T17:10:01.834196] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T17:10:01.993552] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-29T17:10:02.608289] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T17:10:02.793557] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-29T17:10:03.369138] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T17:10:03.593573] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-29T17:10:04.208507] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-29T17:10:04.393568] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-29T17:10:05.193581] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-29T17:10:05.223379] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-29T17:10:05.232582] [INFO ] [REMOTE ] ALLE: Full fetch complete (64837 records). [2025-10-29T17:10:05.232751] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-29T17:10:05.619448] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-29T17:10:05.619518] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-29T17:10:05.620227] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-29T17:10:05.620293] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-29T17:10:05.621591] [DEBUG] [LOCAL ] ALLE: Trimmed 64837 records to 43704 (keeping 200 days of data) [2025-10-29T17:10:05.895213] [DEBUG] [LOCAL ] ALLE: Primary data saved (43704 records). [2025-10-29T17:10:05.895536] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-29T17:10:05.895617] [INFO ] [MAIN ] Update Progress: 86/2367 symbols completed. ALLE took 28.0s. Estimated remaining: 4h 26m 46s. Rate: 8.6 symbols/min [2025-10-29T17:10:05.997301] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-29T17:10:06.073470] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:06.099790] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-29T17:10:06.110061] [INFO ] [REMOTE ] ALL: Full fetch complete (71880 records). [2025-10-29T17:10:06.110280] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-29T17:10:06.116159] [FATAL] [VALIDATOR ] ALL: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:10:06.116342] [FATAL] [MAIN ] ALL: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:10:06.116386] [WARN ] [MAIN ] ALL: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:10:06.116424] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-29T17:10:06.116481] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-10-29T17:10:06.116515] [INFO ] [LOCAL ] ALL: Starting deletion of derivative data. [2025-10-29T17:10:06.116994] [DEBUG] [LOCAL ] ALL: Deleted derivative data file. [2025-10-29T17:10:06.117915] [INFO ] [MAIN ] Update Progress: 87/2367 symbols completed. ALL took 32.7s. Estimated remaining: 4h 23m 40s. Rate: 8.6 symbols/min [2025-10-29T17:10:06.198143] [DEBUG] [LOCAL ] ALTG: Loaded 22694 existing records from primary storage. [2025-10-29T17:10:06.221018] [INFO ] [MAIN ] ALTG: Loaded 22694 existing records. [2025-10-29T17:10:06.453612] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:06.491876] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:10:06.492494] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-29T17:10:06.492557] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-29T17:10:06.492804] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-29T17:10:06.492891] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-29T17:10:06.598771] [DEBUG] [LOCAL ] ALUR: Loaded 9120 existing records from primary storage. [2025-10-29T17:10:06.602540] [INFO ] [MAIN ] ALUR: Loaded 9120 existing records. [2025-10-29T17:10:07.028520] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:10:07.090598] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:07.091590] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-29T17:10:07.093200] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-29T17:10:07.091734] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-29T17:10:07.102174] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-29T17:10:07.103127] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-29T17:10:07.103191] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-29T17:10:07.475188] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:07.521478] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-29T17:10:07.593518] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-29T17:10:07.952069] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T17:10:08.393550] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-29T17:10:09.030101] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T17:10:09.161498] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-29T17:10:09.193549] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-29T17:10:09.993587] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-29T17:10:10.039808] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T17:10:10.793576] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-29T17:10:10.991482] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T17:10:11.599203] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-29T17:10:11.616844] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T17:10:12.393592] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-29T17:10:12.996293] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T17:10:13.193557] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-29T17:10:13.240147] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T17:10:13.993637] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-29T17:10:14.509826] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T17:10:14.793536] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-29T17:10:15.040166] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T17:10:15.593599] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-29T17:10:16.102389] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T17:10:16.393568] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-29T17:10:16.636056] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T17:10:17.164821] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T17:10:17.193581] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-29T17:10:17.976388] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T17:10:17.993550] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-29T17:10:18.485730] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-29T17:10:18.793570] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-29T17:10:19.593557] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-29T17:10:20.191072] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T17:10:20.202690] [INFO ] [REMOTE ] ALLY: Full fetch complete (77235 records). [2025-10-29T17:10:20.202837] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-29T17:10:20.403426] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-29T17:10:20.486875] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T17:10:20.693003] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-29T17:10:20.693094] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-29T17:10:20.693910] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-29T17:10:20.693977] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-29T17:10:20.695482] [DEBUG] [LOCAL ] ALLY: Trimmed 77235 records to 53190 (keeping 200 days of data) [2025-10-29T17:10:20.999265] [DEBUG] [LOCAL ] ALLY: Primary data saved (53190 records). [2025-10-29T17:10:20.999389] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-29T17:10:20.999464] [INFO ] [MAIN ] Update Progress: 88/2367 symbols completed. ALLY took 35.1s. Estimated remaining: 4h 26m 59s. Rate: 8.5 symbols/min [2025-10-29T17:10:21.165114] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:21.200488] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-29T17:10:21.203108] [DEBUG] [LOCAL ] ALV: Loaded 42070 existing records from primary storage. [2025-10-29T17:10:21.203478] [INFO ] [MAIN ] ALV: Loaded 42070 existing records. [2025-10-29T17:10:21.382551] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:10:21.382920] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-29T17:10:21.383064] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-29T17:10:21.389002] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-29T17:10:21.398753] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-29T17:10:21.421569] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-29T17:10:21.780564] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:21.993572] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-29T17:10:22.336895] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-29T17:10:22.793613] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-29T17:10:23.457417] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-29T17:10:23.497158] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T17:10:23.593559] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-29T17:10:24.393606] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-29T17:10:24.706507] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:10:25.193543] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-29T17:10:25.312807] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-29T17:10:25.993595] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-29T17:10:26.425247] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T17:10:26.793579] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-29T17:10:27.221956] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T17:10:27.593611] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-29T17:10:28.000523] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T17:10:28.221558] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-29T17:10:28.393582] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-29T17:10:28.915832] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-29T17:10:29.193604] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-29T17:10:29.600509] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-29T17:10:29.993589] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-29T17:10:30.793567] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-29T17:10:31.064623] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T17:10:31.451724] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T17:10:31.453755] [INFO ] [REMOTE ] ALUR: Full fetch complete (18097 records). [2025-10-29T17:10:31.453836] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-29T17:10:31.598748] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-29T17:10:31.871446] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-29T17:10:31.871526] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-29T17:10:31.871821] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-29T17:10:31.871883] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-29T17:10:31.872375] [DEBUG] [LOCAL ] ALUR: Trimmed 18097 records to 9094 (keeping 200 days of data) [2025-10-29T17:10:31.922779] [DEBUG] [LOCAL ] ALUR: Primary data saved (9094 records). [2025-10-29T17:10:31.922918] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-29T17:10:31.922999] [INFO ] [MAIN ] Update Progress: 89/2367 symbols completed. ALUR took 25.8s. Estimated remaining: 4h 28m 32s. Rate: 8.5 symbols/min [2025-10-29T17:10:32.088011] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:32.096723] [DEBUG] [LOCAL ] ALX: Loaded 7568 existing records from primary storage. [2025-10-29T17:10:32.096935] [INFO ] [MAIN ] ALX: Loaded 7568 existing records. [2025-10-29T17:10:32.270055] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:10:32.270275] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-29T17:10:32.270321] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-29T17:10:32.270468] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-29T17:10:32.270505] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-29T17:10:32.407567] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-29T17:10:32.649249] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:32.651000] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T17:10:33.193598] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-29T17:10:33.663104] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-29T17:10:33.687455] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T17:10:33.696772] [INFO ] [REMOTE ] ALSN: Full fetch complete (62868 records). [2025-10-29T17:10:33.696895] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-29T17:10:33.998726] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-29T17:10:34.089538] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-29T17:10:34.089638] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-29T17:10:34.090313] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-29T17:10:34.090407] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-29T17:10:34.091915] [DEBUG] [LOCAL ] ALSN: Trimmed 62868 records to 42990 (keeping 200 days of data) [2025-10-29T17:10:34.344564] [DEBUG] [LOCAL ] ALSN: Primary data saved (42990 records). [2025-10-29T17:10:34.344703] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-29T17:10:34.345402] [INFO ] [MAIN ] Update Progress: 90/2367 symbols completed. ALSN took 46.1s. Estimated remaining: 4h 26m 27s. Rate: 8.5 symbols/min [2025-10-29T17:10:34.423537] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-29T17:10:34.516936] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:34.517081] [DEBUG] [LOCAL ] AM: No existing data file found in primary storage. [2025-10-29T17:10:34.517117] [WARN ] [MAIN ] AM: No existing data found, performing full refresh instead. [2025-10-29T17:10:34.517221] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-29T17:10:34.517261] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-29T17:10:34.517301] [DEBUG] [LOCAL ] AM: No primary data file found to delete. [2025-10-29T17:10:34.517332] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-29T17:10:34.798942] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-29T17:10:34.881261] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:35.593728] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-29T17:10:35.913575] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-29T17:10:36.062138] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T17:10:36.393627] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-29T17:10:37.193570] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-29T17:10:37.863700] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T17:10:37.993572] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-29T17:10:38.376496] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T17:10:38.793609] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-29T17:10:39.123181] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T17:10:39.593536] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-29T17:10:39.784876] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T17:10:39.789635] [INFO ] [REMOTE ] ALTG: Full fetch complete (33319 records). [2025-10-29T17:10:39.789763] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-29T17:10:40.184180] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-29T17:10:40.184253] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-29T17:10:40.184819] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-29T17:10:40.184880] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-29T17:10:40.185562] [DEBUG] [LOCAL ] ALTG: Trimmed 33319 records to 22719 (keeping 200 days of data) [2025-10-29T17:10:40.305137] [DEBUG] [LOCAL ] ALTG: Primary data saved (22719 records). [2025-10-29T17:10:40.305254] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-29T17:10:40.305326] [INFO ] [MAIN ] Update Progress: 91/2367 symbols completed. ALTG took 34.4s. Estimated remaining: 4h 25m 54s. Rate: 8.6 symbols/min [2025-10-29T17:10:40.403896] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-29T17:10:40.476165] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:40.526868] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T17:10:40.539534] [DEBUG] [LOCAL ] AMBC: Loaded 35400 existing records from primary storage. [2025-10-29T17:10:40.540388] [INFO ] [MAIN ] AMBC: Loaded 35400 existing records. [2025-10-29T17:10:40.719669] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:10:40.719923] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-29T17:10:40.719980] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-29T17:10:40.720225] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-29T17:10:40.720262] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-29T17:10:40.826735] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-29T17:10:41.082710] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:41.193567] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-29T17:10:41.993546] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-29T17:10:42.074456] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T17:10:42.793581] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-29T17:10:43.282556] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T17:10:43.593545] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-29T17:10:43.620675] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T17:10:44.069151] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-29T17:10:44.393578] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-29T17:10:44.970301] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-29T17:10:45.193555] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-29T17:10:45.993603] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-29T17:10:46.218192] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T17:10:46.521495] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T17:10:46.793529] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-29T17:10:47.593554] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-29T17:10:47.822163] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T17:10:48.119817] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T17:10:48.393568] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-29T17:10:49.193566] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-29T17:10:49.616084] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T17:10:49.851555] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T17:10:49.993596] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-29T17:10:50.793555] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-29T17:10:51.093081] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T17:10:51.593560] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-29T17:10:52.038684] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:10:52.393563] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-29T17:10:52.907857] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-29T17:10:52.917211] [INFO ] [REMOTE ] ALV: Full fetch complete (62424 records). [2025-10-29T17:10:52.917350] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-29T17:10:53.198887] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-29T17:10:53.301571] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-29T17:10:53.301687] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-29T17:10:53.302390] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-29T17:10:53.302437] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-29T17:10:53.303806] [DEBUG] [LOCAL ] ALV: Trimmed 62424 records to 42004 (keeping 200 days of data) [2025-10-29T17:10:53.579900] [DEBUG] [LOCAL ] ALV: Primary data saved (42004 records). [2025-10-29T17:10:53.580095] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-29T17:10:53.580219] [INFO ] [MAIN ] Update Progress: 92/2367 symbols completed. ALV took 32.6s. Estimated remaining: 4h 28m 21s. Rate: 8.5 symbols/min [2025-10-29T17:10:53.721863] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T17:10:53.804191] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:53.851948] [DEBUG] [LOCAL ] AMBP: Loaded 44285 existing records from primary storage. [2025-10-29T17:10:53.852275] [INFO ] [MAIN ] AMBP: Loaded 44285 existing records. [2025-10-29T17:10:54.004695] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-29T17:10:54.046961] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:10:54.047450] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-29T17:10:54.047506] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-29T17:10:54.047806] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-29T17:10:54.047861] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-29T17:10:54.441623] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:54.473498] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T17:10:54.793670] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-29T17:10:54.798776] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T17:10:54.802000] [INFO ] [REMOTE ] ALX: Full fetch complete (8516 records). [2025-10-29T17:10:54.802073] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-29T17:10:55.157183] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-29T17:10:55.157263] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-29T17:10:55.157469] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-29T17:10:55.157507] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-29T17:10:55.157929] [DEBUG] [LOCAL ] ALX: Trimmed 8516 records to 7638 (keeping 200 days of data) [2025-10-29T17:10:55.203428] [DEBUG] [LOCAL ] ALX: Primary data saved (7638 records). [2025-10-29T17:10:55.203568] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-29T17:10:55.203670] [INFO ] [MAIN ] Update Progress: 93/2367 symbols completed. ALX took 23.3s. Estimated remaining: 4h 26m 1s. Rate: 8.5 symbols/min [2025-10-29T17:10:55.372963] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:55.373083] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-29T17:10:55.373136] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-29T17:10:55.373241] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-29T17:10:55.373282] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-29T17:10:55.373322] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-29T17:10:55.373351] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-29T17:10:55.598741] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-29T17:10:55.748432] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:56.266526] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T17:10:56.393594] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-29T17:10:56.540357] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:10:56.540814] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-29T17:10:56.540913] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:10:56.540962] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-29T17:10:56.541025] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:10:56.541102] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-29T17:10:56.541175] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-29T17:10:56.541214] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-29T17:10:56.541255] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-29T17:10:56.541309] [INFO ] [MAIN ] Update Progress: 94/2367 symbols completed. AMBQ took 1.3s. Estimated remaining: 4h 23m 37s. Rate: 8.6 symbols/min [2025-10-29T17:10:56.744028] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:10:56.765994] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:10:56.822191] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-29T17:10:56.822611] [INFO ] [MAIN ] AMC: Loaded 53766 existing records. [2025-10-29T17:10:57.010453] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:10:57.010717] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-29T17:10:57.010777] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-29T17:10:57.011035] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-29T17:10:57.011077] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-29T17:10:57.199705] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-29T17:10:57.372279] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:10:57.993572] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-29T17:10:58.494601] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T17:10:58.793593] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-29T17:10:59.593698] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-29T17:10:59.718861] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-29T17:11:00.091808] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T17:11:00.393614] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-29T17:11:00.877807] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T17:11:01.193789] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-29T17:11:01.993572] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-29T17:11:02.119623] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-29T17:11:02.793549] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-29T17:11:02.858464] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T17:11:02.869974] [INFO ] [REMOTE ] AM: Full fetch complete (75617 records). [2025-10-29T17:11:02.870149] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-29T17:11:03.284600] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-29T17:11:03.284792] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-29T17:11:03.285741] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-29T17:11:03.293294] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-29T17:11:03.307736] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T17:11:03.316997] [DEBUG] [LOCAL ] AM: Trimmed 75617 records to 51745 (keeping 200 days of data) [2025-10-29T17:11:03.604019] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-29T17:11:03.624587] [DEBUG] [LOCAL ] AM: Primary data saved (51745 records). [2025-10-29T17:11:03.625505] [INFO ] [MAIN ] AM: Full history saved. [2025-10-29T17:11:03.625588] [INFO ] [MAIN ] Update Progress: 95/2367 symbols completed. AM took 29.3s. Estimated remaining: 4h 23m 33s. Rate: 8.6 symbols/min [2025-10-29T17:11:03.797705] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:11:03.846130] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-29T17:11:03.846462] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-29T17:11:04.051883] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:11:04.052111] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-29T17:11:04.052160] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-29T17:11:04.052535] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-29T17:11:04.052593] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-29T17:11:04.398736] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-29T17:11:04.458155] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:11:04.562525] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-29T17:11:04.677534] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T17:11:05.193543] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-29T17:11:05.383388] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T17:11:05.993534] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-29T17:11:06.793577] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-29T17:11:07.003748] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-29T17:11:07.311623] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:11:07.593532] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-29T17:11:07.671587] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-29T17:11:08.393630] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-29T17:11:08.896070] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T17:11:09.193627] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-29T17:11:09.574323] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T17:11:09.993614] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-29T17:11:10.326306] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-29T17:11:10.340701] [INFO ] [REMOTE ] AMBC: Full fetch complete (51856 records). [2025-10-29T17:11:10.340999] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-29T17:11:10.794051] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-29T17:11:10.793733] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-29T17:11:10.794208] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-29T17:11:10.797019] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-29T17:11:10.797349] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-29T17:11:10.799471] [DEBUG] [LOCAL ] AMBC: Trimmed 51856 records to 35354 (keeping 200 days of data) [2025-10-29T17:11:11.011733] [DEBUG] [LOCAL ] AMBC: Primary data saved (35354 records). [2025-10-29T17:11:11.011897] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-29T17:11:11.011986] [INFO ] [MAIN ] Update Progress: 96/2367 symbols completed. AMBC took 30.7s. Estimated remaining: 4h 23m 36s. Rate: 8.6 symbols/min [2025-10-29T17:11:11.214581] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:11:11.260032] [DEBUG] [LOCAL ] AME: Loaded 48323 existing records from primary storage. [2025-10-29T17:11:11.260434] [INFO ] [MAIN ] AME: Loaded 48323 existing records. [2025-10-29T17:11:11.424431] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T17:11:11.502586] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:11:11.502842] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-29T17:11:11.502891] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-29T17:11:11.503214] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-29T17:11:11.503274] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-29T17:11:11.603104] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-29T17:11:11.867300] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:11:12.070537] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:11:12.393578] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-29T17:11:13.054056] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T17:11:13.193591] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-29T17:11:13.993587] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-29T17:11:14.170543] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-29T17:11:14.332810] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T17:11:14.793732] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-29T17:11:15.369510] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T17:11:15.593562] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-29T17:11:16.393544] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-29T17:11:16.645613] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-29T17:11:16.849403] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T17:11:17.193564] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-29T17:11:17.711735] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T17:11:17.993603] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-29T17:11:18.793568] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-29T17:11:18.987474] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-29T17:11:19.207340] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T17:11:19.593578] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-29T17:11:19.683853] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T17:11:20.393574] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-29T17:11:21.193519] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-29T17:11:21.376036] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-29T17:11:21.896068] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T17:11:21.993577] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-29T17:11:22.436032] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T17:11:22.793563] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-29T17:11:23.593597] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-29T17:11:23.790413] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-29T17:11:24.332501] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-29T17:11:24.393571] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-29T17:11:24.581839] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T17:11:25.193555] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-29T17:11:25.846987] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-29T17:11:25.993543] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-29T17:11:26.203108] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T17:11:26.793580] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-29T17:11:27.551498] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T17:11:27.563216] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-29T17:11:27.563392] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-29T17:11:27.598838] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-29T17:11:27.969693] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-29T17:11:27.969790] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-29T17:11:27.970535] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-29T17:11:27.970578] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-29T17:11:27.972057] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 53670 (keeping 200 days of data) [2025-10-29T17:11:28.284970] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-29T17:11:28.285121] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-29T17:11:28.285911] [INFO ] [MAIN ] Update Progress: 97/2367 symbols completed. AMCR took 24.7s. Estimated remaining: 4h 27m 30s. Rate: 8.5 symbols/min [2025-10-29T17:11:28.395423] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-29T17:11:28.467168] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:11:28.486538] [DEBUG] [LOCAL ] AMG: Loaded 19679 existing records from primary storage. [2025-10-29T17:11:28.486804] [INFO ] [MAIN ] AMG: Loaded 19679 existing records. [2025-10-29T17:11:28.666501] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:11:28.666765] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-29T17:11:28.666818] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-29T17:11:28.667091] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-29T17:11:28.667129] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-29T17:11:29.033601] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:11:29.070936] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-29T17:11:29.083471] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-29T17:11:29.083688] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-29T17:11:29.196853] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-29T17:11:29.492494] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-29T17:11:29.492688] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-29T17:11:29.493632] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-29T17:11:29.493744] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-29T17:11:29.522344] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-29T17:11:29.521000] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53768 (keeping 200 days of data) [2025-10-29T17:11:29.650978] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-29T17:11:29.662049] [INFO ] [REMOTE ] AMBP: Full fetch complete (64955 records). [2025-10-29T17:11:29.663247] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-29T17:11:29.998665] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-29T17:11:30.261635] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-29T17:11:30.261751] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-29T17:11:30.262955] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-29T17:11:30.263034] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-29T17:11:30.269914] [DEBUG] [LOCAL ] AMBP: Trimmed 64955 records to 44353 (keeping 200 days of data) [2025-10-29T17:11:30.269992] [DEBUG] [LOCAL ] AMC: Primary data saved (53768 records). [2025-10-29T17:11:30.270454] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-29T17:11:30.271345] [INFO ] [MAIN ] Update Progress: 98/2367 symbols completed. AMC took 33.7s. Estimated remaining: 4h 25m 25s. Rate: 8.5 symbols/min [2025-10-29T17:11:30.622567] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:11:30.624109] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T17:11:30.716917] [DEBUG] [LOCAL ] AMBP: Primary data saved (44353 records). [2025-10-29T17:11:30.717067] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-29T17:11:30.717160] [INFO ] [MAIN ] Update Progress: 99/2367 symbols completed. AMBP took 37.1s. Estimated remaining: 4h 22m 48s. Rate: 8.6 symbols/min [2025-10-29T17:11:30.799814] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-29T17:11:30.886451] [DEBUG] [LOCAL ] AMH: Loaded 51788 existing records from primary storage. [2025-10-29T17:11:30.912337] [INFO ] [MAIN ] AMH: Loaded 51788 existing records. [2025-10-29T17:11:30.978871] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:11:31.127173] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:11:31.127448] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-29T17:11:31.139698] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-29T17:11:31.140390] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-29T17:11:31.140462] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-29T17:11:31.312121] [DEBUG] [LOCAL ] AMN: Loaded 41432 existing records from primary storage. [2025-10-29T17:11:31.355446] [INFO ] [MAIN ] AMN: Loaded 41432 existing records. [2025-10-29T17:11:31.713419] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:11:31.745997] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:11:31.746822] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-29T17:11:31.746598] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-29T17:11:31.747026] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-29T17:11:31.748841] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-29T17:11:31.748967] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-29T17:11:31.821484] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-29T17:11:31.919762] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-29T17:11:32.185884] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:11:32.393553] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-29T17:11:33.064496] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:11:33.193569] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-29T17:11:33.496073] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T17:11:33.993615] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-29T17:11:34.748159] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-29T17:11:34.793564] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-29T17:11:35.199890] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T17:11:35.593604] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-29T17:11:35.916181] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-29T17:11:36.393538] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-29T17:11:36.448887] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T17:11:37.193675] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-29T17:11:37.388752] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:11:37.993590] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-29T17:11:38.473370] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:11:38.793611] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-29T17:11:39.007039] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T17:11:39.593563] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-29T17:11:40.223723] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T17:11:40.393553] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-29T17:11:40.595158] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-29T17:11:41.193570] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-29T17:11:41.529146] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T17:11:41.993604] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-29T17:11:42.550315] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T17:11:42.793564] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-29T17:11:43.221767] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T17:11:43.593613] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-29T17:11:43.922301] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T17:11:44.393563] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-29T17:11:44.810758] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T17:11:45.193596] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-29T17:11:45.625111] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T17:11:45.917872] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T17:11:45.993561] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-29T17:11:46.545875] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-29T17:11:46.793543] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-29T17:11:47.517484] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T17:11:47.593514] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-29T17:11:48.215894] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-29T17:11:48.393563] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-29T17:11:49.096517] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T17:11:49.193607] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-29T17:11:49.951059] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T17:11:49.955392] [INFO ] [REMOTE ] AMG: Full fetch complete (29385 records). [2025-10-29T17:11:49.955482] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-29T17:11:49.998825] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-29T17:11:50.331294] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-29T17:11:50.331376] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-29T17:11:50.331767] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-29T17:11:50.331830] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-29T17:11:50.332625] [DEBUG] [LOCAL ] AMG: Trimmed 29385 records to 19594 (keeping 200 days of data) [2025-10-29T17:11:50.452220] [DEBUG] [LOCAL ] AMG: Primary data saved (19594 records). [2025-10-29T17:11:50.452359] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-29T17:11:50.452434] [INFO ] [MAIN ] Update Progress: 100/2367 symbols completed. AMG took 22.2s. Estimated remaining: 4h 27m 31s. Rate: 8.5 symbols/min [2025-10-29T17:11:50.640834] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:11:50.672408] [DEBUG] [LOCAL ] AMP: Loaded 31273 existing records from primary storage. [2025-10-29T17:11:50.672698] [INFO ] [MAIN ] AMP: Loaded 31273 existing records. [2025-10-29T17:11:50.798782] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-29T17:11:50.853210] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:11:50.853399] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-29T17:11:50.853448] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-29T17:11:50.853908] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-29T17:11:50.853966] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-29T17:11:51.243295] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:11:51.273920] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T17:11:51.593580] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-29T17:11:52.317013] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T17:11:52.327062] [INFO ] [REMOTE ] AME: Full fetch complete (70322 records). [2025-10-29T17:11:52.327188] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-29T17:11:52.398706] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-29T17:11:52.743163] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-29T17:11:52.743371] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-29T17:11:52.744595] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-29T17:11:52.744842] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-29T17:11:52.747300] [DEBUG] [LOCAL ] AME: Trimmed 70322 records to 48315 (keeping 200 days of data) [2025-10-29T17:11:52.781358] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T17:11:53.121233] [DEBUG] [LOCAL ] AME: Primary data saved (48315 records). [2025-10-29T17:11:53.121494] [INFO ] [MAIN ] AME: Full history saved. [2025-10-29T17:11:53.121614] [INFO ] [MAIN ] Update Progress: 101/2367 symbols completed. AME took 42.1s. Estimated remaining: 4h 25m 45s. Rate: 8.5 symbols/min [2025-10-29T17:11:53.198713] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-29T17:11:53.317561] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:11:53.317849] [DEBUG] [LOCAL ] AMPX: No existing data file found in primary storage. [2025-10-29T17:11:53.317894] [WARN ] [MAIN ] AMPX: No existing data found, performing full refresh instead. [2025-10-29T17:11:53.318032] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-29T17:11:53.318075] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-29T17:11:53.318115] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-29T17:11:53.318149] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-29T17:11:53.716314] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:11:53.736906] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T17:11:53.993621] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-29T17:11:54.793559] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-29T17:11:54.864736] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T17:11:55.107740] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-29T17:11:55.121842] [INFO ] [REMOTE ] AMH: Full fetch complete (75140 records). [2025-10-29T17:11:55.122044] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-29T17:11:55.527995] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-29T17:11:55.528080] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-29T17:11:55.528846] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-29T17:11:55.528936] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-29T17:11:55.530395] [DEBUG] [LOCAL ] AMH: Trimmed 75140 records to 51790 (keeping 200 days of data) [2025-10-29T17:11:55.618269] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-29T17:11:55.874498] [DEBUG] [LOCAL ] AMH: Primary data saved (51790 records). [2025-10-29T17:11:55.875071] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-29T17:11:55.876144] [INFO ] [MAIN ] Update Progress: 102/2367 symbols completed. AMH took 25.6s. Estimated remaining: 4h 24m 2s. Rate: 8.6 symbols/min [2025-10-29T17:11:56.022199] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:11:56.202975] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:11:56.203194] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-10-29T17:11:56.203251] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-10-29T17:11:56.203491] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-29T17:11:56.203563] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-29T17:11:56.203632] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-29T17:11:56.203731] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-29T17:11:56.398904] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-29T17:11:56.741751] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:11:57.193322] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-29T17:11:57.193686] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-29T17:11:57.483561] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T17:11:57.993594] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-29T17:11:58.322898] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T17:11:58.775784] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T17:11:58.793553] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-29T17:11:59.511560] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T17:11:59.593564] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-29T17:12:00.393612] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-29T17:12:00.468708] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T17:12:01.193588] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-29T17:12:01.773580] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T17:12:01.993557] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-29T17:12:02.387933] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T17:12:02.793559] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-29T17:12:02.981409] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T17:12:03.593559] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-29T17:12:03.916224] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T17:12:04.393579] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-29T17:12:04.865866] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T17:12:05.193701] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-29T17:12:05.418750] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T17:12:05.993599] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-29T17:12:06.471767] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T17:12:06.793573] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-29T17:12:07.384769] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T17:12:07.593583] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-29T17:12:07.730154] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-29T17:12:08.393611] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-29T17:12:08.917453] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T17:12:09.193580] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-29T17:12:09.507282] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T17:12:09.993573] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-29T17:12:10.189938] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T17:12:10.793629] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-29T17:12:11.087204] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T17:12:11.593537] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-29T17:12:11.752927] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-29T17:12:12.393606] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-29T17:12:12.938020] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T17:12:12.946834] [INFO ] [REMOTE ] AMN: Full fetch complete (60200 records). [2025-10-29T17:12:12.946993] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-29T17:12:13.198859] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-29T17:12:13.345771] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-29T17:12:13.345922] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-29T17:12:13.346793] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-29T17:12:13.346950] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-29T17:12:13.355375] [DEBUG] [LOCAL ] AMN: Trimmed 60200 records to 41436 (keeping 200 days of data) [2025-10-29T17:12:13.368030] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T17:12:13.606543] [DEBUG] [LOCAL ] AMN: Primary data saved (41436 records). [2025-10-29T17:12:13.606703] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-29T17:12:13.606816] [INFO ] [MAIN ] Update Progress: 103/2367 symbols completed. AMN took 42.9s. Estimated remaining: 4h 27m 51s. Rate: 8.5 symbols/min [2025-10-29T17:12:13.791103] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:12:13.818860] [DEBUG] [LOCAL ] AMR: Loaded 28338 existing records from primary storage. [2025-10-29T17:12:13.819135] [INFO ] [MAIN ] AMR: Loaded 28338 existing records. [2025-10-29T17:12:13.999248] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-29T17:12:14.005776] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:12:14.006369] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-29T17:12:14.007115] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-29T17:12:14.007460] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-29T17:12:14.007520] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-29T17:12:14.388372] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:12:14.446900] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T17:12:14.793601] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-29T17:12:15.216221] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T17:12:15.222822] [INFO ] [REMOTE ] AMP: Full fetch complete (47213 records). [2025-10-29T17:12:15.222942] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-29T17:12:15.223582] [FATAL] [VALIDATOR ] AMP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:12:15.223699] [FATAL] [MAIN ] AMP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:12:15.223794] [WARN ] [MAIN ] AMP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:12:15.223879] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-29T17:12:15.223956] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-10-29T17:12:15.224007] [INFO ] [LOCAL ] AMP: Starting deletion of derivative data. [2025-10-29T17:12:15.224210] [DEBUG] [LOCAL ] AMP: Deleted derivative data file. [2025-10-29T17:12:15.224897] [INFO ] [MAIN ] Update Progress: 104/2367 symbols completed. AMP took 24.8s. Estimated remaining: 4h 25m 45s. Rate: 8.5 symbols/min [2025-10-29T17:12:15.408923] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:12:15.445758] [DEBUG] [LOCAL ] AMRC: Loaded 38167 existing records from primary storage. [2025-10-29T17:12:15.446077] [INFO ] [MAIN ] AMRC: Loaded 38167 existing records. [2025-10-29T17:12:15.603353] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-29T17:12:15.645176] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:12:15.645383] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-29T17:12:15.645446] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-29T17:12:15.645869] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-29T17:12:15.645952] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-29T17:12:16.053232] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T17:12:16.073067] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:12:16.393565] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-29T17:12:17.158817] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-29T17:12:17.193554] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-29T17:12:17.270854] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-29T17:12:17.993533] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-29T17:12:18.036443] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T17:12:18.793592] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-29T17:12:19.074884] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T17:12:19.593730] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-29T17:12:19.756622] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T17:12:20.393573] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-29T17:12:21.008806] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T17:12:21.193609] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-29T17:12:21.268935] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T17:12:21.993703] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-29T17:12:22.736883] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T17:12:22.747550] [INFO ] [REMOTE ] AMPY: Full fetch complete (53603 records). [2025-10-29T17:12:22.747760] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-29T17:12:22.767247] [FATAL] [VALIDATOR ] AMPY: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:12:22.767704] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:12:22.768196] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:12:22.769299] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T17:12:22.769498] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-29T17:12:22.776516] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-29T17:12:22.776604] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-10-29T17:12:22.776744] [DEBUG] [LOCAL ] AMPY: No derivative data file found to delete. [2025-10-29T17:12:22.776870] [INFO ] [MAIN ] Update Progress: 105/2367 symbols completed. AMPY took 26.9s. Estimated remaining: 4h 25m 49s. Rate: 8.5 symbols/min [2025-10-29T17:12:22.800067] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-29T17:12:22.966585] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:12:22.966823] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-29T17:12:22.966873] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-29T17:12:22.966984] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-29T17:12:22.967026] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-29T17:12:22.967068] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-29T17:12:22.967100] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-29T17:12:23.326011] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:12:23.593602] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-29T17:12:23.743815] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T17:12:23.754462] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:12:23.754779] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-29T17:12:23.754864] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:12:23.754909] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-29T17:12:23.754968] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:12:23.755035] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-29T17:12:23.755098] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-29T17:12:23.755132] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-29T17:12:23.755171] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-29T17:12:23.755216] [INFO ] [MAIN ] Update Progress: 106/2367 symbols completed. AMRZ took 1.0s. Estimated remaining: 4h 23m 32s. Rate: 8.6 symbols/min [2025-10-29T17:12:23.918771] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:12:23.982670] [DEBUG] [LOCAL ] AMT: Loaded 52408 existing records from primary storage. [2025-10-29T17:12:23.982980] [INFO ] [MAIN ] AMT: Loaded 52408 existing records. [2025-10-29T17:12:24.158420] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:12:24.158685] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-29T17:12:24.158741] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-29T17:12:24.159084] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-29T17:12:24.159121] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-29T17:12:24.398816] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-29T17:12:24.503783] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:12:25.193532] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-29T17:12:25.353187] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T17:12:25.993588] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-29T17:12:26.510105] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:12:26.793621] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-29T17:12:27.593527] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-29T17:12:27.757478] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-29T17:12:28.028369] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T17:12:28.393525] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-29T17:12:28.411367] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T17:12:29.193572] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-29T17:12:29.947636] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T17:12:29.993542] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-29T17:12:30.369355] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T17:12:30.793598] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-29T17:12:31.397545] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T17:12:31.598927] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-29T17:12:31.604632] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T17:12:32.393569] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-29T17:12:32.959479] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T17:12:33.193569] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-29T17:12:33.430785] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-29T17:12:33.993588] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-29T17:12:34.724949] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-29T17:12:34.793543] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-29T17:12:35.030026] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-29T17:12:35.593545] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-29T17:12:36.104863] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T17:12:36.393515] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-29T17:12:36.561469] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T17:12:37.193568] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-29T17:12:37.775749] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T17:12:37.965493] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T17:12:37.993524] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-29T17:12:38.793549] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-29T17:12:39.253057] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:12:39.593551] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-29T17:12:40.056511] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-29T17:12:40.062761] [INFO ] [REMOTE ] AMR: Full fetch complete (40297 records). [2025-10-29T17:12:40.062891] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-29T17:12:40.063761] [FATAL] [VALIDATOR ] AMR: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:12:40.063848] [FATAL] [MAIN ] AMR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:12:40.063922] [WARN ] [MAIN ] AMR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:12:40.064002] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-29T17:12:40.064080] [DEBUG] [LOCAL ] AMR: No primary data file found to delete. [2025-10-29T17:12:40.064122] [INFO ] [LOCAL ] AMR: Starting deletion of derivative data. [2025-10-29T17:12:40.064329] [DEBUG] [LOCAL ] AMR: Deleted derivative data file. [2025-10-29T17:12:40.064449] [INFO ] [MAIN ] Update Progress: 107/2367 symbols completed. AMR took 26.5s. Estimated remaining: 4h 26m 42s. Rate: 8.5 symbols/min [2025-10-29T17:12:40.247097] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:12:40.269225] [DEBUG] [LOCAL ] AMTB: Loaded 20507 existing records from primary storage. [2025-10-29T17:12:40.269550] [INFO ] [MAIN ] AMTB: Loaded 20507 existing records. [2025-10-29T17:12:40.399025] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-29T17:12:40.464187] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:12:40.464510] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-29T17:12:40.464580] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-29T17:12:40.464927] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-29T17:12:40.465007] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-29T17:12:40.987109] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:12:41.193550] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-29T17:12:41.486304] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-29T17:12:41.548541] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:12:41.993601] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-29T17:12:42.516294] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T17:12:42.793569] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-29T17:12:43.527140] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-29T17:12:43.593574] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-29T17:12:44.084174] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-29T17:12:44.095897] [INFO ] [REMOTE ] AMPX: Full fetch complete (75295 records). [2025-10-29T17:12:44.096072] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-29T17:12:44.398804] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-29T17:12:44.495989] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-29T17:12:44.496087] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-29T17:12:44.496945] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-29T17:12:44.497010] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-29T17:12:44.498530] [DEBUG] [LOCAL ] AMPX: Trimmed 75295 records to 52563 (keeping 200 days of data) [2025-10-29T17:12:44.792067] [DEBUG] [LOCAL ] AMPX: Primary data saved (52563 records). [2025-10-29T17:12:44.792207] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-29T17:12:44.792278] [INFO ] [MAIN ] Update Progress: 108/2367 symbols completed. AMPX took 51.7s. Estimated remaining: 4h 25m 46s. Rate: 8.5 symbols/min [2025-10-29T17:12:45.002747] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:12:45.018751] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T17:12:45.026452] [DEBUG] [LOCAL ] AMTD: Loaded 3803 existing records from primary storage. [2025-10-29T17:12:45.026705] [INFO ] [MAIN ] AMTD: Loaded 3803 existing records. [2025-10-29T17:12:45.198698] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-29T17:12:45.250736] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:12:45.251828] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-29T17:12:45.251912] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-29T17:12:45.252242] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-29T17:12:45.252319] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-29T17:12:45.704820] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-29T17:12:45.736724] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:12:45.737361] [INFO ] [REMOTE ] AMT: Full fetch complete (76160 records). [2025-10-29T17:12:45.737528] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-29T17:12:45.998810] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-29T17:12:46.167373] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-29T17:12:46.167548] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-29T17:12:46.168374] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-29T17:12:46.168491] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-29T17:12:46.187626] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T17:12:46.186631] [DEBUG] [LOCAL ] AMT: Trimmed 76160 records to 52411 (keeping 200 days of data) [2025-10-29T17:12:46.521382] [DEBUG] [LOCAL ] AMT: Primary data saved (52411 records). [2025-10-29T17:12:46.521531] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-29T17:12:46.524874] [INFO ] [MAIN ] Update Progress: 109/2367 symbols completed. AMT took 22.8s. Estimated remaining: 4h 23m 48s. Rate: 8.6 symbols/min [2025-10-29T17:12:46.631395] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-29T17:12:46.704734] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:12:46.757470] [DEBUG] [LOCAL ] AMTM: Loaded 50074 existing records from primary storage. [2025-10-29T17:12:46.757787] [INFO ] [MAIN ] AMTM: Loaded 50074 existing records. [2025-10-29T17:12:46.798868] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-29T17:12:46.938052] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:12:46.938280] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-29T17:12:46.938328] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-29T17:12:46.938752] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-29T17:12:46.938810] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-29T17:12:47.328219] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:12:47.593557] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-29T17:12:47.783638] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T17:12:48.393563] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-29T17:12:49.193533] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-29T17:12:49.300043] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-29T17:12:49.568201] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T17:12:49.569857] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T17:12:49.993556] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-29T17:12:50.726823] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T17:12:50.793559] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-29T17:12:51.153468] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-29T17:12:51.593571] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-29T17:12:52.389387] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T17:12:52.394209] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-29T17:12:53.193528] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-29T17:12:53.584974] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T17:12:53.969874] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-29T17:12:53.993561] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-29T17:12:54.793570] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-29T17:12:55.095461] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T17:12:55.593552] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-29T17:12:56.175999] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:12:56.185043] [INFO ] [REMOTE ] AMRC: Full fetch complete (54687 records). [2025-10-29T17:12:56.185195] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-29T17:12:56.401456] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-29T17:12:56.592993] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-29T17:12:56.593080] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-29T17:12:56.593703] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-29T17:12:56.593767] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-29T17:12:56.594980] [DEBUG] [LOCAL ] AMRC: Trimmed 54687 records to 38154 (keeping 200 days of data) [2025-10-29T17:12:56.815560] [DEBUG] [LOCAL ] AMRC: Primary data saved (38154 records). [2025-10-29T17:12:56.815723] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-29T17:12:56.816532] [INFO ] [MAIN ] Update Progress: 110/2367 symbols completed. AMRC took 41.6s. Estimated remaining: 4h 24m 49s. Rate: 8.5 symbols/min [2025-10-29T17:12:56.929239] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T17:12:57.007014] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:12:57.018238] [DEBUG] [LOCAL ] AMWL: Loaded 9959 existing records from primary storage. [2025-10-29T17:12:57.018579] [INFO ] [MAIN ] AMWL: Loaded 9959 existing records. [2025-10-29T17:12:57.198549] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-29T17:12:57.222028] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:12:57.242693] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-29T17:12:57.242780] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-29T17:12:57.244833] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-29T17:12:57.255567] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-29T17:12:57.256431] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-29T17:12:57.618672] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:12:57.773085] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-29T17:12:57.993552] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-29T17:12:58.793567] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-29T17:12:59.123437] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T17:12:59.280161] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T17:12:59.593562] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-29T17:12:59.988558] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T17:13:00.393555] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-29T17:13:00.788540] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-29T17:13:01.193576] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-29T17:13:01.553314] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T17:13:01.993590] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-29T17:13:02.450606] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-29T17:13:02.793590] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-29T17:13:03.273761] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-29T17:13:03.275186] [INFO ] [REMOTE ] AMTD: Full fetch complete (5369 records). [2025-10-29T17:13:03.275258] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-29T17:13:03.606336] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-29T17:13:03.651107] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-29T17:13:03.651220] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-29T17:13:03.651555] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-29T17:13:03.651599] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-29T17:13:03.652078] [DEBUG] [LOCAL ] AMTD: Trimmed 5369 records to 3811 (keeping 200 days of data) [2025-10-29T17:13:03.674834] [DEBUG] [LOCAL ] AMTD: Primary data saved (3811 records). [2025-10-29T17:13:03.675001] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-29T17:13:03.675104] [INFO ] [MAIN ] Update Progress: 111/2367 symbols completed. AMTD took 18.9s. Estimated remaining: 4h 24m 38s. Rate: 8.5 symbols/min [2025-10-29T17:13:03.848385] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:13:03.898610] [DEBUG] [LOCAL ] AMX: Loaded 49047 existing records from primary storage. [2025-10-29T17:13:03.899068] [INFO ] [MAIN ] AMX: Loaded 49047 existing records. [2025-10-29T17:13:04.088976] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:13:04.089314] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-29T17:13:04.089384] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-29T17:13:04.089850] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-29T17:13:04.089911] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-29T17:13:04.398800] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-29T17:13:04.614923] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:13:04.635569] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T17:13:05.193617] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-29T17:13:05.369527] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T17:13:05.993572] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-29T17:13:06.463032] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T17:13:06.681924] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-29T17:13:06.793562] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-29T17:13:07.593571] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-29T17:13:08.037265] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:13:08.100985] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T17:13:08.393605] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-29T17:13:08.843380] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T17:13:09.193560] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-29T17:13:09.656294] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-29T17:13:09.993540] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-29T17:13:10.462441] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T17:13:10.793583] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-29T17:13:11.593546] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-29T17:13:12.142426] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T17:13:12.226536] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T17:13:12.393551] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-29T17:13:12.843499] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T17:13:13.193573] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-29T17:13:13.688687] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-29T17:13:13.993712] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-29T17:13:14.500999] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T17:13:14.793583] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-29T17:13:15.593601] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-29T17:13:15.761751] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-29T17:13:15.766731] [INFO ] [REMOTE ] AMTB: Full fetch complete (29892 records). [2025-10-29T17:13:15.766811] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-29T17:13:16.138773] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-29T17:13:16.138844] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-29T17:13:16.139203] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-29T17:13:16.139241] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-29T17:13:16.139922] [DEBUG] [LOCAL ] AMTB: Trimmed 29892 records to 20547 (keeping 200 days of data) [2025-10-29T17:13:16.255468] [DEBUG] [LOCAL ] AMTB: Primary data saved (20547 records). [2025-10-29T17:13:16.255583] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-29T17:13:16.255676] [INFO ] [MAIN ] Update Progress: 112/2367 symbols completed. AMTB took 36.2s. Estimated remaining: 4h 26m 23s. Rate: 8.5 symbols/min [2025-10-29T17:13:16.395544] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-29T17:13:16.427952] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:13:16.457302] [DEBUG] [LOCAL ] AN: Loaded 30898 existing records from primary storage. [2025-10-29T17:13:16.457600] [INFO ] [MAIN ] AN: Loaded 30898 existing records. [2025-10-29T17:13:16.630490] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:13:16.630711] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-29T17:13:16.630767] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-29T17:13:16.631084] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-29T17:13:16.631145] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-29T17:13:17.000285] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:13:17.031260] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T17:13:17.123969] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T17:13:17.193611] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-29T17:13:17.993535] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-29T17:13:18.367440] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T17:13:18.581674] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T17:13:18.585411] [INFO ] [REMOTE ] AMWL: Full fetch complete (14807 records). [2025-10-29T17:13:18.585480] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-29T17:13:18.798863] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-29T17:13:18.964913] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-29T17:13:18.965016] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-29T17:13:18.965381] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-29T17:13:18.965425] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-29T17:13:18.966233] [DEBUG] [LOCAL ] AMWL: Trimmed 14807 records to 9987 (keeping 200 days of data) [2025-10-29T17:13:19.026407] [DEBUG] [LOCAL ] AMWL: Primary data saved (9987 records). [2025-10-29T17:13:19.026596] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-29T17:13:19.026718] [INFO ] [MAIN ] Update Progress: 113/2367 symbols completed. AMWL took 22.2s. Estimated remaining: 4h 24m 49s. Rate: 8.5 symbols/min [2025-10-29T17:13:19.215446] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:13:19.281408] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-29T17:13:19.281899] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-29T17:13:19.469620] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:13:19.469973] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-29T17:13:19.470060] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-29T17:13:19.470715] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-29T17:13:19.470778] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-29T17:13:19.598742] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-29T17:13:19.851176] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:13:20.000829] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T17:13:20.393551] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-29T17:13:20.926777] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T17:13:21.193579] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-29T17:13:21.491388] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-29T17:13:21.993673] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-29T17:13:22.793598] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-29T17:13:23.106639] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-29T17:13:23.427183] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-29T17:13:23.593603] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-29T17:13:23.701966] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T17:13:24.393598] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-29T17:13:24.708154] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T17:13:25.193622] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-29T17:13:25.993540] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-29T17:13:26.035401] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-29T17:13:26.325017] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T17:13:26.793566] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-29T17:13:27.016878] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T17:13:27.593631] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-29T17:13:27.927193] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T17:13:28.393613] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-29T17:13:28.577627] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-29T17:13:29.193690] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-29T17:13:29.865504] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-29T17:13:29.875770] [INFO ] [REMOTE ] AMTM: Full fetch complete (73393 records). [2025-10-29T17:13:29.875920] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-29T17:13:29.998812] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-29T17:13:30.268512] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-29T17:13:30.268601] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-29T17:13:30.269334] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-29T17:13:30.269400] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-29T17:13:30.270908] [DEBUG] [LOCAL ] AMTM: Trimmed 73393 records to 50043 (keeping 200 days of data) [2025-10-29T17:13:30.562864] [DEBUG] [LOCAL ] AMTM: Primary data saved (50043 records). [2025-10-29T17:13:30.562987] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-29T17:13:30.563063] [INFO ] [MAIN ] Update Progress: 114/2367 symbols completed. AMTM took 44.0s. Estimated remaining: 4h 26m 11s. Rate: 8.5 symbols/min [2025-10-29T17:13:30.733407] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:13:30.780354] [DEBUG] [LOCAL ] ANF: Loaded 51983 existing records from primary storage. [2025-10-29T17:13:30.780701] [INFO ] [MAIN ] ANF: Loaded 51983 existing records. [2025-10-29T17:13:30.812184] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-29T17:13:30.967618] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:13:30.968028] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-29T17:13:30.968163] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-29T17:13:30.968392] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-29T17:13:30.968432] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-29T17:13:31.368257] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:13:31.371679] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T17:13:31.412572] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-29T17:13:31.593583] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-29T17:13:32.235086] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-29T17:13:32.393623] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-29T17:13:33.193595] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-29T17:13:33.382381] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-29T17:13:34.002152] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-29T17:13:34.025411] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-29T17:13:34.061874] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T17:13:34.793627] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-29T17:13:35.285070] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T17:13:35.593560] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-29T17:13:36.090163] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T17:13:36.393596] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-29T17:13:36.740674] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T17:13:37.193536] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-29T17:13:37.352422] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T17:13:37.993608] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-29T17:13:38.476487] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T17:13:38.793617] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-29T17:13:39.583723] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T17:13:39.593567] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-29T17:13:39.595072] [INFO ] [REMOTE ] AMX: Full fetch complete (71054 records). [2025-10-29T17:13:39.595181] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-29T17:13:40.023164] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-29T17:13:40.023295] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-29T17:13:40.024095] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-29T17:13:40.024313] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-29T17:13:40.026071] [DEBUG] [LOCAL ] AMX: Trimmed 71054 records to 49045 (keeping 200 days of data) [2025-10-29T17:13:40.270179] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T17:13:40.364073] [DEBUG] [LOCAL ] AMX: Primary data saved (49045 records). [2025-10-29T17:13:40.364211] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-29T17:13:40.364291] [INFO ] [MAIN ] Update Progress: 115/2367 symbols completed. AMX took 36.7s. Estimated remaining: 4h 26m 57s. Rate: 8.4 symbols/min [2025-10-29T17:13:40.398717] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-29T17:13:40.549245] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:13:40.549401] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-29T17:13:40.549437] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-29T17:13:40.549571] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-29T17:13:40.549665] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-29T17:13:40.549734] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-29T17:13:40.549789] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-29T17:13:40.895825] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:13:41.193569] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-29T17:13:41.544844] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-29T17:13:41.774928] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T17:13:41.867409] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-29T17:13:41.993558] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-29T17:13:42.793558] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-29T17:13:43.348479] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T17:13:43.593557] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-29T17:13:43.733332] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:13:43.733627] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-29T17:13:43.733733] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:13:43.733777] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-29T17:13:43.733809] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:13:43.733844] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-29T17:13:43.733897] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-29T17:13:43.733932] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-29T17:13:43.733969] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-29T17:13:43.734013] [INFO ] [MAIN ] Update Progress: 116/2367 symbols completed. ANGX took 3.4s. Estimated remaining: 4h 25m 37s. Rate: 8.5 symbols/min [2025-10-29T17:13:43.900457] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:13:43.918864] [DEBUG] [LOCAL ] ANRO: Loaded 19705 existing records from primary storage. [2025-10-29T17:13:43.919097] [INFO ] [MAIN ] ANRO: Loaded 19705 existing records. [2025-10-29T17:13:44.096021] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:13:44.096236] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-29T17:13:44.096282] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-29T17:13:44.096514] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-29T17:13:44.096569] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-29T17:13:44.398797] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-29T17:13:44.451439] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:13:44.644573] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-29T17:13:45.193695] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-29T17:13:45.843274] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T17:13:45.994978] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-29T17:13:45.996701] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-29T17:13:46.793633] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-29T17:13:47.456989] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-29T17:13:47.593519] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-29T17:13:47.810538] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-29T17:13:48.393526] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-29T17:13:48.431110] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-29T17:13:49.193601] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-29T17:13:49.762787] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-29T17:13:49.926579] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-29T17:13:49.993567] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-29T17:13:50.625376] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T17:13:50.793555] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-29T17:13:51.593577] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-29T17:13:52.109131] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T17:13:52.394880] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-29T17:13:52.397907] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T17:13:53.193610] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-29T17:13:53.797855] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-29T17:13:53.993575] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-29T17:13:54.183139] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-29T17:13:54.436478] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-29T17:13:54.793560] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-29T17:13:55.593550] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-29T17:13:55.705034] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T17:13:56.393639] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-29T17:13:57.193589] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-29T17:13:57.232503] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T17:13:57.244560] [INFO ] [REMOTE ] ANF: Full fetch complete (75790 records). [2025-10-29T17:13:57.244775] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-29T17:13:57.663345] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-29T17:13:57.663454] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-29T17:13:57.664512] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-29T17:13:57.664585] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-29T17:13:57.666682] [DEBUG] [LOCAL ] ANF: Trimmed 75790 records to 51976 (keeping 200 days of data) [2025-10-29T17:13:57.864808] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T17:13:57.994846] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-29T17:13:58.021180] [DEBUG] [LOCAL ] ANF: Primary data saved (51976 records). [2025-10-29T17:13:58.021467] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-29T17:13:58.024709] [INFO ] [MAIN ] Update Progress: 117/2367 symbols completed. ANF took 27.5s. Estimated remaining: 4h 27m 49s. Rate: 8.4 symbols/min [2025-10-29T17:13:58.058839] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-29T17:13:58.793598] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-29T17:13:59.068321] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-29T17:13:59.075865] [INFO ] [REMOTE ] AN: Full fetch complete (47222 records). [2025-10-29T17:13:59.076075] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-29T17:13:59.524678] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-29T17:13:59.524921] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-29T17:13:59.525980] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-29T17:13:59.526067] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-29T17:13:59.527512] [DEBUG] [LOCAL ] AN: Trimmed 47222 records to 30883 (keeping 200 days of data) [2025-10-29T17:13:59.616815] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-29T17:13:59.761512] [DEBUG] [LOCAL ] AN: Primary data saved (30883 records). [2025-10-29T17:13:59.765113] [INFO ] [MAIN ] AN: Full history saved. [2025-10-29T17:13:59.765307] [INFO ] [MAIN ] Update Progress: 118/2367 symbols completed. AN took 43.5s. Estimated remaining: 4h 25m 59s. Rate: 8.5 symbols/min [2025-10-29T17:13:59.767576] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-29T17:13:59.779980] [INFO ] [REMOTE ] ANET: Full fetch complete (77943 records). [2025-10-29T17:13:59.780218] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-29T17:14:00.236874] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-29T17:14:00.236984] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-29T17:14:00.237958] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-29T17:14:00.238025] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-29T17:14:00.240136] [DEBUG] [LOCAL ] ANET: Trimmed 77943 records to 53764 (keeping 200 days of data) [2025-10-29T17:14:00.593363] [DEBUG] [LOCAL ] ANET: Primary data saved (53764 records). [2025-10-29T17:14:00.593557] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-29T17:14:00.594874] [INFO ] [MAIN ] Update Progress: 119/2367 symbols completed. ANET took 41.6s. Estimated remaining: 4h 23m 53s. Rate: 8.5 symbols/min [2025-10-29T17:14:00.952597] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T17:14:00.960219] [INFO ] [REMOTE ] ANRO: Full fetch complete (30992 records). [2025-10-29T17:14:00.960339] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-29T17:14:01.359351] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-29T17:14:01.359463] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-29T17:14:01.360081] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-29T17:14:01.360148] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-29T17:14:01.361312] [DEBUG] [LOCAL ] ANRO: Trimmed 30992 records to 19933 (keeping 200 days of data) [2025-10-29T17:14:01.480935] [DEBUG] [LOCAL ] ANRO: Primary data saved (19933 records). [2025-10-29T17:14:01.481167] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-29T17:14:01.481297] [INFO ] [MAIN ] Update Progress: 120/2367 symbols completed. ANRO took 17.7s. Estimated remaining: 4h 21m 51s. Rate: 8.6 symbols/min [2025-10-29T17:14:02.069460] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:02.271313] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:02.317595] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-29T17:14:02.311959] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:02.317800] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-29T17:14:02.318016] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-29T17:14:02.318461] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-29T17:14:02.318757] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-29T17:14:02.317200] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:02.318992] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-29T17:14:02.505549] [DEBUG] [LOCAL ] AOMR: Loaded 16020 existing records from primary storage. [2025-10-29T17:14:02.499564] [DEBUG] [LOCAL ] ANVS: Loaded 24020 existing records from primary storage. [2025-10-29T17:14:02.542713] [DEBUG] [LOCAL ] AOD: Loaded 30529 existing records from primary storage. [2025-10-29T17:14:02.562856] [INFO ] [MAIN ] ANVS: Loaded 24020 existing records. [2025-10-29T17:14:02.549705] [INFO ] [MAIN ] AOMR: Loaded 16020 existing records. [2025-10-29T17:14:02.594969] [INFO ] [MAIN ] AOD: Loaded 30529 existing records. [2025-10-29T17:14:03.394476] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:03.397842] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:03.441813] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:03.446920] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-29T17:14:03.447046] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-29T17:14:03.451432] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:03.446614] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-29T17:14:03.452781] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-29T17:14:03.452900] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-29T17:14:03.453281] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-29T17:14:03.453243] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-29T17:14:03.453401] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-29T17:14:03.459036] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-29T17:14:03.458801] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-29T17:14:03.467565] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-29T17:14:03.554882] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-29T17:14:03.611387] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-29T17:14:03.659069] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:14:03.780630] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-29T17:14:03.791996] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:14:03.792303] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-29T17:14:03.828880] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:14:03.898094] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-29T17:14:04.036408] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-29T17:14:04.151028] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-29T17:14:04.228323] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-29T17:14:04.355674] [INFO ] [MAIN ] Update Progress: 121/2367 symbols completed. AOMD took 2.9s. Estimated remaining: 4h 20m 28s. Rate: 8.6 symbols/min [2025-10-29T17:14:04.764964] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:04.819211] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-29T17:14:04.818881] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:04.915898] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-29T17:14:04.983926] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:04.992092] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:04.992854] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-29T17:14:05.063145] [DEBUG] [LOCAL ] AON: Loaded 44821 existing records from primary storage. [2025-10-29T17:14:05.063597] [INFO ] [MAIN ] AON: Loaded 44821 existing records. [2025-10-29T17:14:05.271067] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:05.271425] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-29T17:14:05.271486] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-29T17:14:05.271885] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-29T17:14:05.271942] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-29T17:14:05.605313] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-29T17:14:05.625076] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-29T17:14:05.693725] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:05.694101] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-29T17:14:06.064054] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-29T17:14:06.072308] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-29T17:14:06.091879] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T17:14:06.097969] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-29T17:14:06.350234] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-29T17:14:06.755799] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T17:14:06.793579] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-29T17:14:06.861034] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T17:14:07.075425] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T17:14:07.330416] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T17:14:07.593578] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-29T17:14:08.393584] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-29T17:14:08.453678] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T17:14:09.193612] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-29T17:14:09.555701] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T17:14:09.993587] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-29T17:14:10.038622] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T17:14:10.793603] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-29T17:14:11.074034] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-29T17:14:11.593568] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-29T17:14:12.205273] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T17:14:12.393588] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-29T17:14:12.466347] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-29T17:14:13.193591] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-29T17:14:13.728578] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T17:14:13.993621] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-29T17:14:14.179543] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-29T17:14:14.716142] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T17:14:14.793587] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-29T17:14:15.593619] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-29T17:14:15.845834] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-29T17:14:16.393554] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-29T17:14:16.502421] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T17:14:17.193591] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-29T17:14:17.977635] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-29T17:14:17.993522] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-29T17:14:18.601263] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T17:14:18.793588] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-29T17:14:19.041933] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T17:14:19.593602] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-29T17:14:19.894302] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T17:14:20.393598] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-29T17:14:20.599443] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T17:14:20.967570] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-29T17:14:21.193614] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-29T17:14:21.993553] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-29T17:14:22.144802] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T17:14:22.793546] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-29T17:14:22.967850] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T17:14:23.593587] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-29T17:14:24.298359] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T17:14:24.393565] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-29T17:14:24.500064] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T17:14:24.938149] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-29T17:14:25.193684] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-29T17:14:25.752534] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-29T17:14:25.993633] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-29T17:14:26.643295] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-29T17:14:26.793621] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-29T17:14:27.593579] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-29T17:14:28.045593] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T17:14:28.053979] [INFO ] [REMOTE ] ANVS: Full fetch complete (36811 records). [2025-10-29T17:14:28.054195] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-29T17:14:28.397161] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-29T17:14:28.491687] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-29T17:14:28.491823] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-29T17:14:28.492711] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-29T17:14:28.492796] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-29T17:14:28.513987] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T17:14:28.514180] [DEBUG] [LOCAL ] ANVS: Trimmed 36811 records to 24184 (keeping 200 days of data) [2025-10-29T17:14:28.668169] [DEBUG] [LOCAL ] ANVS: Primary data saved (24184 records). [2025-10-29T17:14:28.668347] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-29T17:14:28.668453] [INFO ] [MAIN ] Update Progress: 122/2367 symbols completed. ANVS took 27.2s. Estimated remaining: 4h 25m 40s. Rate: 8.5 symbols/min [2025-10-29T17:14:28.889298] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:28.919306] [DEBUG] [LOCAL ] AORT: Loaded 28553 existing records from primary storage. [2025-10-29T17:14:28.919708] [INFO ] [MAIN ] AORT: Loaded 28553 existing records. [2025-10-29T17:14:29.116302] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:29.116593] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-29T17:14:29.116671] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-29T17:14:29.116927] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-29T17:14:29.116987] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-29T17:14:29.198787] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-29T17:14:29.521845] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:29.576277] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-29T17:14:29.584359] [INFO ] [REMOTE ] AOD: Full fetch complete (44652 records). [2025-10-29T17:14:29.584550] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-29T17:14:29.926946] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T17:14:29.998112] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-29T17:14:30.009354] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-29T17:14:30.010551] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-29T17:14:30.011158] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-29T17:14:30.011226] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-29T17:14:30.012473] [DEBUG] [LOCAL ] AOD: Trimmed 44652 records to 30356 (keeping 200 days of data) [2025-10-29T17:14:30.188531] [DEBUG] [LOCAL ] AOD: Primary data saved (30356 records). [2025-10-29T17:14:30.188716] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-29T17:14:30.188809] [INFO ] [MAIN ] Update Progress: 123/2367 symbols completed. AOD took 28.7s. Estimated remaining: 4h 23m 51s. Rate: 8.5 symbols/min [2025-10-29T17:14:30.356407] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:30.396955] [DEBUG] [LOCAL ] AOS: Loaded 48563 existing records from primary storage. [2025-10-29T17:14:30.397279] [INFO ] [MAIN ] AOS: Loaded 48563 existing records. [2025-10-29T17:14:30.576789] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:30.577038] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-29T17:14:30.577102] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-29T17:14:30.577438] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-29T17:14:30.577512] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-29T17:14:30.802632] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-29T17:14:30.927762] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:31.244411] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-29T17:14:31.593575] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-29T17:14:31.777179] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T17:14:32.393562] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-29T17:14:32.948000] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T17:14:33.193529] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-29T17:14:33.916828] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-29T17:14:33.993536] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-29T17:14:34.242499] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T17:14:34.793571] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-29T17:14:35.298808] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T17:14:35.593567] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-29T17:14:35.669128] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-29T17:14:35.672477] [INFO ] [REMOTE ] AOMR: Full fetch complete (23187 records). [2025-10-29T17:14:35.672574] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-29T17:14:36.069251] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-29T17:14:36.069356] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-29T17:14:36.069894] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-29T17:14:36.069962] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-29T17:14:36.070753] [DEBUG] [LOCAL ] AOMR: Trimmed 23187 records to 15986 (keeping 200 days of data) [2025-10-29T17:14:36.177168] [DEBUG] [LOCAL ] AOMR: Primary data saved (15986 records). [2025-10-29T17:14:36.177321] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-29T17:14:36.177412] [INFO ] [MAIN ] Update Progress: 124/2367 symbols completed. AOMR took 34.7s. Estimated remaining: 4h 23m 25s. Rate: 8.5 symbols/min [2025-10-29T17:14:36.385738] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:36.395538] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-29T17:14:36.395901] [DEBUG] [LOCAL ] AP: Loaded 7489 existing records from primary storage. [2025-10-29T17:14:36.396803] [INFO ] [MAIN ] AP: Loaded 7489 existing records. [2025-10-29T17:14:36.614507] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:36.614961] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-29T17:14:36.615048] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-29T17:14:36.615389] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-29T17:14:36.615508] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-29T17:14:36.768423] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T17:14:37.041981] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:37.193571] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-29T17:14:37.636621] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T17:14:37.779817] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:14:37.790295] [INFO ] [REMOTE ] AON: Full fetch complete (65286 records). [2025-10-29T17:14:37.790535] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-29T17:14:37.993834] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-29T17:14:38.247848] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-29T17:14:38.248001] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-29T17:14:38.249016] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-29T17:14:38.249087] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-29T17:14:38.251547] [DEBUG] [LOCAL ] AON: Trimmed 65286 records to 44821 (keeping 200 days of data) [2025-10-29T17:14:38.552179] [DEBUG] [LOCAL ] AON: Primary data saved (44821 records). [2025-10-29T17:14:38.552369] [INFO ] [MAIN ] AON: Full history saved. [2025-10-29T17:14:38.555831] [INFO ] [MAIN ] Update Progress: 125/2367 symbols completed. AON took 34.1s. Estimated remaining: 4h 21m 54s. Rate: 8.6 symbols/min [2025-10-29T17:14:38.785336] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:38.793721] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-29T17:14:38.842093] [DEBUG] [LOCAL ] APAM: Loaded 35260 existing records from primary storage. [2025-10-29T17:14:38.842533] [INFO ] [MAIN ] APAM: Loaded 35260 existing records. [2025-10-29T17:14:39.055542] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:39.055862] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-29T17:14:39.055917] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-29T17:14:39.056363] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-29T17:14:39.056410] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-29T17:14:39.161025] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T17:14:39.473997] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:39.503546] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-29T17:14:39.593554] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-29T17:14:40.041187] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T17:14:40.393576] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-29T17:14:41.193613] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-29T17:14:41.834184] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T17:14:41.993588] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-29T17:14:42.242221] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T17:14:42.793567] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-29T17:14:43.297379] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:14:43.598353] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-29T17:14:43.599890] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-29T17:14:44.042583] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-29T17:14:44.393625] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-29T17:14:45.193630] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-29T17:14:45.353714] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-29T17:14:45.993532] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-29T17:14:46.175222] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T17:14:46.793551] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-29T17:14:46.920231] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-29T17:14:47.593577] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-29T17:14:48.393597] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-29T17:14:48.538546] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-29T17:14:48.739806] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T17:14:49.193594] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-29T17:14:49.648016] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T17:14:49.861168] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T17:14:49.993555] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-29T17:14:50.592445] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-29T17:14:50.793555] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-29T17:14:51.457057] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-29T17:14:51.593542] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-29T17:14:52.039371] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-29T17:14:52.393611] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-29T17:14:53.193572] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-29T17:14:53.551706] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T17:14:53.652948] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-29T17:14:53.993554] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-29T17:14:54.793619] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-29T17:14:55.383682] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T17:14:55.593539] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-29T17:14:55.915717] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T17:14:56.393567] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-29T17:14:56.820779] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T17:14:57.193557] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-29T17:14:57.243360] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-29T17:14:57.685089] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-29T17:14:57.687046] [INFO ] [REMOTE ] AP: Full fetch complete (9256 records). [2025-10-29T17:14:57.687116] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-29T17:14:57.998771] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-29T17:14:58.054401] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-29T17:14:58.054471] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-29T17:14:58.054713] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-29T17:14:58.054776] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-29T17:14:58.055187] [DEBUG] [LOCAL ] AP: Trimmed 9256 records to 7529 (keeping 200 days of data) [2025-10-29T17:14:58.096587] [DEBUG] [LOCAL ] AP: Primary data saved (7529 records). [2025-10-29T17:14:58.096737] [INFO ] [MAIN ] AP: Full history saved. [2025-10-29T17:14:58.096823] [INFO ] [MAIN ] Update Progress: 126/2367 symbols completed. AP took 21.9s. Estimated remaining: 4h 25m 30s. Rate: 8.4 symbols/min [2025-10-29T17:14:58.264387] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:14:58.303290] [DEBUG] [LOCAL ] APD: Loaded 45249 existing records from primary storage. [2025-10-29T17:14:58.303564] [INFO ] [MAIN ] APD: Loaded 45249 existing records. [2025-10-29T17:14:58.476362] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:14:58.476567] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-29T17:14:58.476612] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-29T17:14:58.477002] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-29T17:14:58.477053] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-29T17:14:58.798802] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-29T17:14:58.826996] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:14:59.037177] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T17:14:59.593511] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-29T17:14:59.720349] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-29T17:15:00.393544] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-29T17:15:00.861374] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T17:15:01.193605] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-29T17:15:01.999424] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-29T17:15:02.003028] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-29T17:15:02.793598] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-29T17:15:03.051272] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T17:15:03.088538] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-29T17:15:03.098928] [INFO ] [REMOTE ] AOS: Full fetch complete (71133 records). [2025-10-29T17:15:03.099069] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-29T17:15:03.481878] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-29T17:15:03.481985] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-29T17:15:03.482721] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-29T17:15:03.482785] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-29T17:15:03.484163] [DEBUG] [LOCAL ] AOS: Trimmed 71133 records to 48556 (keeping 200 days of data) [2025-10-29T17:15:03.599101] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-29T17:15:03.626465] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T17:15:03.688465] [INFO ] [REMOTE ] AORT: Full fetch complete (42396 records). [2025-10-29T17:15:03.714237] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-29T17:15:03.981041] [DEBUG] [LOCAL ] AOS: Primary data saved (48556 records). [2025-10-29T17:15:03.994444] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-29T17:15:04.033027] [INFO ] [MAIN ] Update Progress: 127/2367 symbols completed. AOS took 33.8s. Estimated remaining: 4h 25m 2s. Rate: 8.5 symbols/min [2025-10-29T17:15:04.346058] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-29T17:15:04.345973] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:15:04.346428] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-29T17:15:04.346984] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-29T17:15:04.347062] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-29T17:15:04.348217] [DEBUG] [LOCAL ] AORT: Trimmed 42396 records to 28551 (keeping 200 days of data) [2025-10-29T17:15:04.394478] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-29T17:15:04.531442] [DEBUG] [LOCAL ] AORT: Primary data saved (28551 records). [2025-10-29T17:15:04.531582] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-29T17:15:04.531693] [INFO ] [MAIN ] Update Progress: 128/2367 symbols completed. AORT took 35.9s. Estimated remaining: 4h 22m 60s. Rate: 8.5 symbols/min [2025-10-29T17:15:04.661485] [DEBUG] [LOCAL ] APG: Loaded 50596 existing records from primary storage. [2025-10-29T17:15:04.677958] [INFO ] [MAIN ] APG: Loaded 50596 existing records. [2025-10-29T17:15:04.788713] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:15:04.950424] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:15:04.951317] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-29T17:15:04.951383] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-29T17:15:04.951949] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-29T17:15:04.952019] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-29T17:15:05.101204] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-29T17:15:05.183861] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-29T17:15:05.194291] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-29T17:15:05.219471] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-29T17:15:05.600621] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:15:05.606961] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-29T17:15:05.607145] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-29T17:15:05.642966] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-29T17:15:05.648786] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:15:05.648908] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-29T17:15:06.003891] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:15:06.003983] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-29T17:15:06.164210] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-29T17:15:06.490232] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T17:15:06.793578] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-29T17:15:07.099150] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T17:15:07.593608] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-29T17:15:07.631075] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T17:15:08.393636] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-29T17:15:09.153879] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-29T17:15:09.193557] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-29T17:15:09.561146] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T17:15:09.993565] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-29T17:15:10.607051] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-29T17:15:10.793559] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-29T17:15:10.899744] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T17:15:10.906984] [INFO ] [REMOTE ] APAM: Full fetch complete (51938 records). [2025-10-29T17:15:10.907137] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-29T17:15:11.276157] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-29T17:15:11.276238] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-29T17:15:11.276804] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-29T17:15:11.276865] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-29T17:15:11.277947] [DEBUG] [LOCAL ] APAM: Trimmed 51938 records to 35248 (keeping 200 days of data) [2025-10-29T17:15:11.491663] [DEBUG] [LOCAL ] APAM: Primary data saved (35248 records). [2025-10-29T17:15:11.491826] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-29T17:15:11.491914] [INFO ] [MAIN ] Update Progress: 129/2367 symbols completed. APAM took 32.9s. Estimated remaining: 4h 22m 51s. Rate: 8.5 symbols/min [2025-10-29T17:15:11.593702] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-29T17:15:11.665389] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:15:11.714184] [DEBUG] [LOCAL ] APLE: Loaded 51897 existing records from primary storage. [2025-10-29T17:15:11.714550] [INFO ] [MAIN ] APLE: Loaded 51897 existing records. [2025-10-29T17:15:11.902600] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:15:11.903007] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-29T17:15:11.903135] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-29T17:15:11.903602] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-29T17:15:11.903693] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-29T17:15:12.221012] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T17:15:12.311256] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:15:12.393577] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-29T17:15:13.010366] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T17:15:13.193585] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-29T17:15:13.993530] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-29T17:15:14.188265] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-29T17:15:14.423822] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:15:14.793566] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-29T17:15:15.195784] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T17:15:15.593556] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-29T17:15:16.009803] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T17:15:16.393617] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-29T17:15:17.132149] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-29T17:15:17.193518] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-29T17:15:17.732037] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T17:15:17.993575] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-29T17:15:18.507060] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T17:15:18.793580] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-29T17:15:19.291431] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:15:19.593588] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-29T17:15:20.393601] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-29T17:15:20.436043] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T17:15:20.757498] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T17:15:21.193553] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-29T17:15:21.622189] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T17:15:21.993638] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-29T17:15:22.584016] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T17:15:22.793555] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-29T17:15:23.107693] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T17:15:23.593582] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-29T17:15:24.206670] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T17:15:24.393542] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-29T17:15:24.887814] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T17:15:25.193565] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-29T17:15:25.846344] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T17:15:25.993550] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-29T17:15:26.361968] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T17:15:26.793569] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-29T17:15:27.357224] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T17:15:27.593590] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-29T17:15:28.134456] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-29T17:15:28.393633] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-29T17:15:28.801210] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T17:15:29.193592] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-29T17:15:29.993599] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-29T17:15:30.314400] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T17:15:30.355328] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-29T17:15:30.366731] [INFO ] [REMOTE ] APH: Full fetch complete (77871 records). [2025-10-29T17:15:30.366871] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-29T17:15:30.776986] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-29T17:15:30.777072] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-29T17:15:30.777848] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-29T17:15:30.777913] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-29T17:15:30.779325] [DEBUG] [LOCAL ] APH: Trimmed 77871 records to 53691 (keeping 200 days of data) [2025-10-29T17:15:30.832860] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-29T17:15:31.103247] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-29T17:15:31.103381] [INFO ] [MAIN ] APH: Full history saved. [2025-10-29T17:15:31.104041] [INFO ] [MAIN ] Update Progress: 130/2367 symbols completed. APH took 26.6s. Estimated remaining: 4h 26m 20s. Rate: 8.4 symbols/min [2025-10-29T17:15:31.282462] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:15:31.327831] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:15:31.389820] [DEBUG] [LOCAL ] APO: Loaded 53369 existing records from primary storage. [2025-10-29T17:15:31.390215] [INFO ] [MAIN ] APO: Loaded 53369 existing records. [2025-10-29T17:15:31.598776] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-29T17:15:31.657032] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:15:31.657479] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-29T17:15:31.657552] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-29T17:15:31.657874] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-29T17:15:31.657949] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-29T17:15:32.290098] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:15:32.327420] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T17:15:32.393634] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-29T17:15:32.980486] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:15:32.991274] [INFO ] [REMOTE ] APG: Full fetch complete (72294 records). [2025-10-29T17:15:32.991419] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-29T17:15:33.203958] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-29T17:15:33.379015] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-29T17:15:33.379100] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-29T17:15:33.379924] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-29T17:15:33.379989] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-29T17:15:33.381380] [DEBUG] [LOCAL ] APG: Trimmed 72294 records to 50611 (keeping 200 days of data) [2025-10-29T17:15:33.678831] [DEBUG] [LOCAL ] APG: Primary data saved (50611 records). [2025-10-29T17:15:33.678970] [INFO ] [MAIN ] APG: Full history saved. [2025-10-29T17:15:33.679052] [INFO ] [MAIN ] Update Progress: 131/2367 symbols completed. APG took 29.6s. Estimated remaining: 4h 24m 55s. Rate: 8.4 symbols/min [2025-10-29T17:15:33.855521] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:15:33.892212] [DEBUG] [LOCAL ] APOS: Loaded 6792 existing records from primary storage. [2025-10-29T17:15:33.892486] [INFO ] [MAIN ] APOS: Loaded 6792 existing records. [2025-10-29T17:15:33.979686] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T17:15:33.998083] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-29T17:15:34.032950] [INFO ] [REMOTE ] APD: Full fetch complete (67189 records). [2025-10-29T17:15:34.056993] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-29T17:15:34.164964] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:15:34.187718] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-29T17:15:34.198564] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-29T17:15:34.198939] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-29T17:15:34.209522] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-29T17:15:34.839562] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-29T17:15:34.872753] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-29T17:15:34.906185] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:15:34.907386] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-29T17:15:34.907816] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-29T17:15:34.908931] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-29T17:15:34.910901] [DEBUG] [LOCAL ] APD: Trimmed 67189 records to 45249 (keeping 200 days of data) [2025-10-29T17:15:35.046171] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-29T17:15:35.253687] [DEBUG] [LOCAL ] APD: Primary data saved (45249 records). [2025-10-29T17:15:35.253840] [INFO ] [MAIN ] APD: Full history saved. [2025-10-29T17:15:35.253925] [INFO ] [MAIN ] Update Progress: 132/2367 symbols completed. APD took 37.2s. Estimated remaining: 4h 23m 14s. Rate: 8.5 symbols/min [2025-10-29T17:15:35.437265] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:15:35.438697] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-29T17:15:35.490058] [DEBUG] [LOCAL ] APTV: Loaded 51726 existing records from primary storage. [2025-10-29T17:15:35.490391] [INFO ] [MAIN ] APTV: Loaded 51726 existing records. [2025-10-29T17:15:35.598826] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-29T17:15:35.679327] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:15:35.679712] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-29T17:15:35.679810] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-29T17:15:35.680247] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-29T17:15:35.680306] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-29T17:15:36.075180] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-29T17:15:36.081044] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:15:36.097248] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T17:15:36.393560] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-29T17:15:37.193562] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-29T17:15:37.712607] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:15:37.993579] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-29T17:15:38.632508] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T17:15:38.793589] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-29T17:15:39.402498] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T17:15:39.593577] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-29T17:15:40.294274] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-29T17:15:40.393578] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-29T17:15:40.899254] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T17:15:40.975084] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T17:15:41.193633] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-29T17:15:41.653854] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-29T17:15:41.993554] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-29T17:15:42.457908] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-29T17:15:42.793561] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-29T17:15:43.593559] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-29T17:15:44.025289] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T17:15:44.393578] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-29T17:15:44.934401] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T17:15:45.193560] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-29T17:15:45.640624] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T17:15:45.993555] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-29T17:15:46.436703] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T17:15:46.793562] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-29T17:15:47.106626] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-29T17:15:47.593604] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-29T17:15:48.393553] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-29T17:15:48.482733] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-29T17:15:48.493685] [INFO ] [REMOTE ] APLE: Full fetch complete (74802 records). [2025-10-29T17:15:48.493844] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-29T17:15:48.897787] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-29T17:15:48.898033] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-29T17:15:48.899017] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-29T17:15:48.899088] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-29T17:15:48.900677] [DEBUG] [LOCAL ] APLE: Trimmed 74802 records to 51888 (keeping 200 days of data) [2025-10-29T17:15:49.208637] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-29T17:15:49.273974] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-29T17:15:49.277952] [DEBUG] [LOCAL ] APLE: Primary data saved (51888 records). [2025-10-29T17:15:49.278293] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-29T17:15:49.294868] [INFO ] [MAIN ] Update Progress: 133/2367 symbols completed. APLE took 37.8s. Estimated remaining: 4h 25m 4s. Rate: 8.4 symbols/min [2025-10-29T17:15:49.521561] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:15:49.566748] [DEBUG] [LOCAL ] AQN: Loaded 51564 existing records from primary storage. [2025-10-29T17:15:49.567065] [INFO ] [MAIN ] AQN: Loaded 51564 existing records. [2025-10-29T17:15:49.752568] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:15:49.753059] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-29T17:15:49.753245] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-29T17:15:49.753719] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-29T17:15:49.753797] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-29T17:15:49.866729] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T17:15:49.958137] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-29T17:15:49.994729] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-29T17:15:50.191226] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:15:50.710278] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T17:15:50.793574] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-29T17:15:51.186105] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T17:15:51.593556] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-29T17:15:52.393561] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-29T17:15:52.825296] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-29T17:15:52.910314] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:15:53.193611] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-29T17:15:53.993608] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-29T17:15:54.490392] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T17:15:54.793593] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-29T17:15:55.094130] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T17:15:55.593589] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-29T17:15:56.043164] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T17:15:56.393539] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-29T17:15:56.845262] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T17:15:57.193600] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-29T17:15:57.857779] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T17:15:57.993592] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-29T17:15:58.503136] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T17:15:58.793562] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-29T17:15:59.399835] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-29T17:15:59.593601] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-29T17:16:00.190560] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T17:16:00.393632] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-29T17:16:01.193624] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-29T17:16:01.871470] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-29T17:16:01.994227] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-29T17:16:02.007824] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-29T17:16:02.019203] [INFO ] [REMOTE ] APTV: Full fetch complete (75334 records). [2025-10-29T17:16:02.019390] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-29T17:16:02.020280] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:16:02.020825] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:16:02.020906] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:16:02.020991] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-29T17:16:02.021074] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-29T17:16:02.021122] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-29T17:16:02.021323] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-10-29T17:16:02.021426] [INFO ] [MAIN ] Update Progress: 134/2367 symbols completed. APTV took 26.8s. Estimated remaining: 4h 26m 31s. Rate: 8.4 symbols/min [2025-10-29T17:16:02.215439] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:02.247877] [DEBUG] [LOCAL ] AQNB: Loaded 3742 existing records from primary storage. [2025-10-29T17:16:02.248361] [INFO ] [MAIN ] AQNB: Loaded 3742 existing records. [2025-10-29T17:16:02.283214] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-29T17:16:02.445953] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:16:02.446198] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-29T17:16:02.446267] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-29T17:16:02.446399] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-29T17:16:02.446438] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-29T17:16:02.797928] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-29T17:16:02.822628] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:03.286931] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T17:16:03.566973] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T17:16:03.568784] [INFO ] [REMOTE ] APOS: Full fetch complete (10122 records). [2025-10-29T17:16:03.568892] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-29T17:16:03.569353] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:16:03.569462] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:16:03.569507] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:16:03.569551] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-29T17:16:03.569613] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-29T17:16:03.569691] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-29T17:16:03.569904] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-10-29T17:16:03.570004] [INFO ] [MAIN ] Update Progress: 135/2367 symbols completed. APOS took 29.9s. Estimated remaining: 4h 24m 51s. Rate: 8.4 symbols/min [2025-10-29T17:16:03.598715] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-29T17:16:03.794401] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:03.794714] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-29T17:16:03.794790] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-29T17:16:03.794943] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-29T17:16:03.794989] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-29T17:16:03.795033] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-29T17:16:03.795068] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-29T17:16:04.281565] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:04.393566] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-29T17:16:05.015358] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-29T17:16:05.193588] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-29T17:16:05.550117] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-29T17:16:05.993603] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-29T17:16:06.556449] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T17:16:06.793572] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-29T17:16:07.390154] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T17:16:07.392049] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-29T17:16:07.593585] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-29T17:16:08.393607] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-29T17:16:08.690823] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T17:16:09.193542] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-29T17:16:09.295383] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-29T17:16:09.306827] [INFO ] [REMOTE ] APO: Full fetch complete (77448 records). [2025-10-29T17:16:09.306980] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-29T17:16:09.702186] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-29T17:16:09.702284] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-29T17:16:09.703165] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-29T17:16:09.703252] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-29T17:16:09.704798] [DEBUG] [LOCAL ] APO: Trimmed 77448 records to 53366 (keeping 200 days of data) [2025-10-29T17:16:09.993997] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-29T17:16:10.036604] [DEBUG] [LOCAL ] APO: Primary data saved (53366 records). [2025-10-29T17:16:10.036752] [INFO ] [MAIN ] APO: Full history saved. [2025-10-29T17:16:10.037603] [INFO ] [MAIN ] Update Progress: 136/2367 symbols completed. APO took 38.9s. Estimated remaining: 4h 24m 33s. Rate: 8.4 symbols/min [2025-10-29T17:16:10.207273] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:10.247986] [DEBUG] [LOCAL ] ARCO: Loaded 43944 existing records from primary storage. [2025-10-29T17:16:10.248293] [INFO ] [MAIN ] ARCO: Loaded 43944 existing records. [2025-10-29T17:16:10.430758] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:16:10.431398] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-29T17:16:10.431450] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-29T17:16:10.431777] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-29T17:16:10.431835] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-29T17:16:10.796037] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-29T17:16:10.815635] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:10.818957] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-29T17:16:11.072232] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T17:16:11.195252] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T17:16:11.593555] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-29T17:16:12.393572] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-29T17:16:12.529972] [DEBUG] [REMOTE ] AQNB: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-29T17:16:12.530338] [WARN ] [REMOTE ] AQNB: No data returned for month 2025-04 [2025-10-29T17:16:12.530450] [FATAL] [REMOTE ] AQNB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:16:12.530573] [FATAL] [MAIN ] AQNB: Failed to fetch primary data. [2025-10-29T17:16:12.530684] [WARN ] [MAIN ] AQNB: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:16:12.530769] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-29T17:16:12.530856] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-10-29T17:16:12.530925] [INFO ] [LOCAL ] AQNB: Starting deletion of derivative data. [2025-10-29T17:16:12.531098] [DEBUG] [LOCAL ] AQNB: Deleted derivative data file. [2025-10-29T17:16:12.531194] [INFO ] [MAIN ] Update Progress: 137/2367 symbols completed. AQNB took 10.5s. Estimated remaining: 4h 23m 10s. Rate: 8.5 symbols/min [2025-10-29T17:16:12.736781] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:12.751817] [DEBUG] [LOCAL ] ARDC: Loaded 14875 existing records from primary storage. [2025-10-29T17:16:12.752090] [INFO ] [MAIN ] ARDC: Loaded 14875 existing records. [2025-10-29T17:16:12.935542] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:16:12.935953] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-29T17:16:12.936033] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-29T17:16:12.936351] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-29T17:16:12.936559] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-29T17:16:13.198739] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-29T17:16:13.209928] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-29T17:16:13.339709] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:13.993574] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-29T17:16:14.563809] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T17:16:14.793605] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-29T17:16:14.987730] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T17:16:15.593570] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-29T17:16:16.393608] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-29T17:16:16.527527] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-29T17:16:16.870220] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:16:17.193536] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-29T17:16:17.429783] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T17:16:17.993585] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-29T17:16:18.552634] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-29T17:16:18.640302] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-29T17:16:18.793548] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-29T17:16:19.593555] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-29T17:16:20.178145] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T17:16:20.393680] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-29T17:16:20.894806] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-29T17:16:20.905734] [INFO ] [REMOTE ] AQN: Full fetch complete (75292 records). [2025-10-29T17:16:20.905888] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-29T17:16:21.198937] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-29T17:16:21.312819] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-29T17:16:21.312905] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-29T17:16:21.313638] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-29T17:16:21.313725] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-29T17:16:21.315217] [DEBUG] [LOCAL ] AQN: Trimmed 75292 records to 51558 (keeping 200 days of data) [2025-10-29T17:16:21.634737] [DEBUG] [LOCAL ] AQN: Primary data saved (51558 records). [2025-10-29T17:16:21.645132] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-29T17:16:21.645671] [INFO ] [MAIN ] Update Progress: 138/2367 symbols completed. AQN took 32.3s. Estimated remaining: 4h 23m 36s. Rate: 8.5 symbols/min [2025-10-29T17:16:21.646536] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-29T17:16:21.847596] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-29T17:16:21.859288] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:21.860332] [DEBUG] [LOCAL ] ARDT: No existing data file found in primary storage. [2025-10-29T17:16:21.860379] [WARN ] [MAIN ] ARDT: No existing data found, performing full refresh instead. [2025-10-29T17:16:21.860487] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-29T17:16:21.860529] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-29T17:16:21.860569] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-10-29T17:16:21.860601] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-29T17:16:22.004284] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-29T17:16:22.229059] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:22.793567] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-29T17:16:23.446830] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T17:16:23.593569] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-29T17:16:24.007114] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T17:16:24.100771] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T17:16:24.393582] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-29T17:16:25.193567] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-29T17:16:25.450097] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T17:16:25.993695] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-29T17:16:26.534462] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T17:16:26.793584] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-29T17:16:26.948881] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T17:16:27.593569] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-29T17:16:28.057228] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T17:16:28.393544] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-29T17:16:28.687187] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T17:16:29.193566] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-29T17:16:29.961379] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-29T17:16:29.972722] [INFO ] [REMOTE ] AR: Full fetch complete (77346 records). [2025-10-29T17:16:29.972923] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-29T17:16:29.973874] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:16:29.973956] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:16:29.974022] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:16:29.974097] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-29T17:16:29.974175] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-29T17:16:29.974213] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-29T17:16:29.974253] [DEBUG] [LOCAL ] AR: No derivative data file found to delete. [2025-10-29T17:16:29.974308] [INFO ] [MAIN ] Update Progress: 139/2367 symbols completed. AR took 26.4s. Estimated remaining: 4h 23m 49s. Rate: 8.4 symbols/min [2025-10-29T17:16:30.003370] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-29T17:16:30.147257] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:30.162338] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-10-29T17:16:30.162486] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-10-29T17:16:30.163632] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T17:16:30.163128] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-29T17:16:30.165687] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-29T17:16:30.169765] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-29T17:16:30.169817] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-29T17:16:30.517456] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:30.793590] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-29T17:16:31.175082] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T17:16:31.593544] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-29T17:16:32.015992] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T17:16:32.393527] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-29T17:16:32.686689] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T17:16:33.193604] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-29T17:16:33.408493] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T17:16:33.993534] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-29T17:16:34.039743] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T17:16:34.793600] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-29T17:16:35.546282] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-29T17:16:35.593538] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-29T17:16:36.076660] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-29T17:16:36.393571] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-29T17:16:36.595868] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-29T17:16:37.193603] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-29T17:16:37.789886] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T17:16:37.993551] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-29T17:16:38.516375] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-29T17:16:38.578423] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:16:38.587476] [INFO ] [REMOTE ] ARCO: Full fetch complete (64612 records). [2025-10-29T17:16:38.587620] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-29T17:16:38.798730] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-29T17:16:38.992055] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-29T17:16:38.992137] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-29T17:16:38.992837] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-29T17:16:38.992902] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-29T17:16:38.994246] [DEBUG] [LOCAL ] ARCO: Trimmed 64612 records to 43879 (keeping 200 days of data) [2025-10-29T17:16:39.246551] [DEBUG] [LOCAL ] ARCO: Primary data saved (43879 records). [2025-10-29T17:16:39.246723] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-29T17:16:39.247343] [INFO ] [MAIN ] Update Progress: 140/2367 symbols completed. ARCO took 29.2s. Estimated remaining: 4h 24m 16s. Rate: 8.4 symbols/min [2025-10-29T17:16:39.423335] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:39.478106] [DEBUG] [LOCAL ] ARES: Loaded 49590 existing records from primary storage. [2025-10-29T17:16:39.478714] [INFO ] [MAIN ] ARES: Loaded 49590 existing records. [2025-10-29T17:16:39.598832] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-29T17:16:39.740224] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:16:39.740693] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-29T17:16:39.740894] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-29T17:16:39.741201] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-29T17:16:39.741347] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-29T17:16:39.904305] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T17:16:40.363339] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:40.393580] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-29T17:16:40.946766] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-29T17:16:41.024982] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T17:16:41.193537] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-29T17:16:41.913689] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T17:16:41.993556] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-29T17:16:42.452045] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-29T17:16:42.793577] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-29T17:16:43.593560] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-29T17:16:44.010449] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T17:16:44.105384] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-29T17:16:44.393556] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-29T17:16:45.109098] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T17:16:45.193588] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-29T17:16:45.993570] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-29T17:16:46.148480] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T17:16:46.153243] [INFO ] [REMOTE ] ARDC: Full fetch complete (21634 records). [2025-10-29T17:16:46.153395] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-29T17:16:46.541125] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-29T17:16:46.541208] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-29T17:16:46.541517] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-29T17:16:46.541557] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-29T17:16:46.542246] [DEBUG] [LOCAL ] ARDC: Trimmed 21634 records to 14841 (keeping 200 days of data) [2025-10-29T17:16:46.634226] [DEBUG] [LOCAL ] ARDC: Primary data saved (14841 records). [2025-10-29T17:16:46.634410] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-29T17:16:46.634543] [INFO ] [MAIN ] Update Progress: 141/2367 symbols completed. ARDC took 34.1s. Estimated remaining: 4h 24m 13s. Rate: 8.4 symbols/min [2025-10-29T17:16:46.796270] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-29T17:16:46.807252] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:46.849218] [DEBUG] [LOCAL ] ARI: Loaded 43095 existing records from primary storage. [2025-10-29T17:16:46.849696] [INFO ] [MAIN ] ARI: Loaded 43095 existing records. [2025-10-29T17:16:46.971885] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T17:16:47.054832] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:16:47.055063] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-29T17:16:47.055111] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-29T17:16:47.055288] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-29T17:16:47.055326] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-29T17:16:47.399156] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:47.593558] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-29T17:16:48.229694] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-29T17:16:48.393545] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-29T17:16:48.920075] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T17:16:49.193555] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-29T17:16:49.780145] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T17:16:49.993555] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-29T17:16:50.308941] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T17:16:50.793582] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-29T17:16:51.311957] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T17:16:51.577961] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T17:16:51.593508] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-29T17:16:52.369359] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T17:16:52.393523] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-29T17:16:53.193681] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-29T17:16:54.004708] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-29T17:16:54.007740] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-29T17:16:54.308508] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T17:16:54.793612] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-29T17:16:55.525490] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T17:16:55.535997] [INFO ] [REMOTE ] ARE: Full fetch complete (72679 records). [2025-10-29T17:16:55.536147] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-29T17:16:55.536942] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:16:55.537030] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:16:55.537072] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:16:55.537110] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-29T17:16:55.537164] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-29T17:16:55.537199] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-29T17:16:55.537236] [DEBUG] [LOCAL ] ARE: No derivative data file found to delete. [2025-10-29T17:16:55.537289] [INFO ] [MAIN ] Update Progress: 142/2367 symbols completed. ARE took 25.6s. Estimated remaining: 4h 24m 34s. Rate: 8.4 symbols/min [2025-10-29T17:16:55.601712] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-29T17:16:55.712105] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:55.751168] [DEBUG] [LOCAL ] ARLO: Loaded 43466 existing records from primary storage. [2025-10-29T17:16:55.751452] [INFO ] [MAIN ] ARLO: Loaded 43466 existing records. [2025-10-29T17:16:55.926330] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:16:55.926631] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-29T17:16:55.926717] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-29T17:16:55.926949] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-29T17:16:55.927004] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-29T17:16:56.284826] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:56.313281] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-29T17:16:56.393561] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-29T17:16:56.702845] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-29T17:16:56.709784] [INFO ] [REMOTE ] ARDT: Full fetch complete (41853 records). [2025-10-29T17:16:56.709940] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-29T17:16:57.092773] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-29T17:16:57.092849] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-29T17:16:57.093312] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-29T17:16:57.093350] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-29T17:16:57.094277] [DEBUG] [LOCAL ] ARDT: Trimmed 41853 records to 27314 (keeping 200 days of data) [2025-10-29T17:16:57.195517] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-29T17:16:57.253253] [DEBUG] [LOCAL ] ARDT: Primary data saved (27314 records). [2025-10-29T17:16:57.253379] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-29T17:16:57.253446] [INFO ] [MAIN ] Update Progress: 143/2367 symbols completed. ARDT took 35.6s. Estimated remaining: 4h 23m 3s. Rate: 8.5 symbols/min [2025-10-29T17:16:57.427186] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:16:57.468779] [DEBUG] [LOCAL ] ARMK: Loaded 50219 existing records from primary storage. [2025-10-29T17:16:57.469111] [INFO ] [MAIN ] ARMK: Loaded 50219 existing records. [2025-10-29T17:16:57.618374] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T17:16:57.677425] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:16:57.677672] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-29T17:16:57.677733] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-29T17:16:57.678018] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-29T17:16:57.678072] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-29T17:16:57.998771] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-29T17:16:58.035555] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:16:58.194536] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:16:58.793591] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-29T17:16:58.904732] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T17:16:59.593616] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-29T17:17:00.281022] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-29T17:17:00.393550] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-29T17:17:00.747225] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T17:17:01.193766] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-29T17:17:01.993707] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-29T17:17:02.247062] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-29T17:17:02.520959] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:17:02.793555] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-29T17:17:03.593739] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-29T17:17:03.650452] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-29T17:17:03.919584] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T17:17:04.393562] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-29T17:17:04.546099] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-29T17:17:05.193572] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-29T17:17:05.702827] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T17:17:05.993551] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-29T17:17:06.399507] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T17:17:06.793595] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-29T17:17:07.235115] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T17:17:07.593581] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-29T17:17:07.937353] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T17:17:08.393591] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-29T17:17:09.001691] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T17:17:09.193571] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-29T17:17:09.758067] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T17:17:09.993608] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-29T17:17:10.435828] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T17:17:10.793589] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-29T17:17:11.452517] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T17:17:11.593542] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-29T17:17:11.959334] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T17:17:12.393611] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-29T17:17:13.008180] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-29T17:17:13.193543] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-29T17:17:13.601216] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T17:17:13.993610] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-29T17:17:14.340568] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T17:17:14.793695] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-29T17:17:15.344566] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T17:17:15.593561] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-29T17:17:16.139829] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T17:17:16.393585] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-29T17:17:16.934270] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T17:17:17.193551] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-29T17:17:17.776810] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:17:17.993568] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-29T17:17:18.447914] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T17:17:18.457023] [INFO ] [REMOTE ] ARI: Full fetch complete (62162 records). [2025-10-29T17:17:18.457238] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-29T17:17:18.803688] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-29T17:17:18.841339] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-29T17:17:18.841580] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-29T17:17:18.842280] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-29T17:17:18.842359] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-29T17:17:18.843606] [DEBUG] [LOCAL ] ARI: Trimmed 62162 records to 43052 (keeping 200 days of data) [2025-10-29T17:17:19.089260] [DEBUG] [LOCAL ] ARI: Primary data saved (43052 records). [2025-10-29T17:17:19.089378] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-29T17:17:19.089449] [INFO ] [MAIN ] Update Progress: 144/2367 symbols completed. ARI took 32.5s. Estimated remaining: 4h 26m 43s. Rate: 8.3 symbols/min [2025-10-29T17:17:19.278534] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:17:19.318565] [DEBUG] [LOCAL ] AROC: Loaded 48992 existing records from primary storage. [2025-10-29T17:17:19.318949] [INFO ] [MAIN ] AROC: Loaded 48992 existing records. [2025-10-29T17:17:19.502117] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:17:19.502445] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-29T17:17:19.502558] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-29T17:17:19.502973] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-29T17:17:19.503149] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-29T17:17:19.595790] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-29T17:17:19.890807] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-29T17:17:19.919728] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:17:19.920741] [INFO ] [REMOTE ] ARES: Full fetch complete (71842 records). [2025-10-29T17:17:19.920822] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-29T17:17:20.314129] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-29T17:17:20.314323] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-29T17:17:20.315153] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-29T17:17:20.315364] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-29T17:17:20.316873] [DEBUG] [LOCAL ] ARES: Trimmed 71842 records to 49566 (keeping 200 days of data) [2025-10-29T17:17:20.405513] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-29T17:17:20.559266] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-29T17:17:20.592316] [INFO ] [REMOTE ] ARLO: Full fetch complete (63279 records). [2025-10-29T17:17:20.597150] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-29T17:17:20.783563] [DEBUG] [LOCAL ] ARES: Primary data saved (49566 records). [2025-10-29T17:17:20.812422] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-29T17:17:20.824852] [INFO ] [MAIN ] Update Progress: 145/2367 symbols completed. ARES took 41.6s. Estimated remaining: 4h 25m 12s. Rate: 8.4 symbols/min [2025-10-29T17:17:21.157116] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:17:21.191529] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-29T17:17:21.209226] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-29T17:17:21.242965] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-29T17:17:21.246159] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-29T17:17:21.246264] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-29T17:17:21.246365] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-29T17:17:21.246555] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-29T17:17:21.246466] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-29T17:17:21.247269] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-29T17:17:21.267940] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-29T17:17:21.349522] [DEBUG] [LOCAL ] ARLO: Trimmed 63279 records to 43539 (keeping 200 days of data) [2025-10-29T17:17:21.632133] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-29T17:17:21.760976] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-29T17:17:21.918391] [DEBUG] [LOCAL ] ARLO: Primary data saved (43539 records). [2025-10-29T17:17:21.920709] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-29T17:17:21.924897] [INFO ] [MAIN ] Update Progress: 146/2367 symbols completed. ARLO took 26.4s. Estimated remaining: 4h 23m 33s. Rate: 8.4 symbols/min [2025-10-29T17:17:21.924776] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:17:21.994948] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-29T17:17:22.122166] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:17:22.124242] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-29T17:17:22.161925] [DEBUG] [LOCAL ] ARW: Loaded 32848 existing records from primary storage. [2025-10-29T17:17:22.162203] [INFO ] [MAIN ] ARW: Loaded 32848 existing records. [2025-10-29T17:17:22.356888] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:17:22.357167] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-29T17:17:22.357215] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-29T17:17:22.357406] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-29T17:17:22.357443] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-29T17:17:22.714828] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:17:22.793599] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-29T17:17:23.115950] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T17:17:23.516903] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-29T17:17:23.593519] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-29T17:17:23.961559] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T17:17:24.393608] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-29T17:17:24.738913] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T17:17:25.193618] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-29T17:17:25.760250] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T17:17:25.993525] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-29T17:17:26.568395] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T17:17:26.793601] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-29T17:17:26.947562] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T17:17:27.593568] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-29T17:17:27.948549] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T17:17:28.393572] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-29T17:17:29.035823] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T17:17:29.193576] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-29T17:17:29.714810] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T17:17:29.993531] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-29T17:17:30.091922] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T17:17:30.793626] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-29T17:17:31.250555] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:17:31.593556] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-29T17:17:32.069464] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:17:32.393583] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-29T17:17:32.898859] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T17:17:33.193583] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-29T17:17:33.993615] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-29T17:17:34.090385] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-29T17:17:34.191829] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T17:17:34.793564] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-29T17:17:35.130934] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T17:17:35.593576] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-29T17:17:36.117495] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T17:17:36.128982] [INFO ] [REMOTE ] ARMK: Full fetch complete (72549 records). [2025-10-29T17:17:36.129215] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-29T17:17:36.130101] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:17:36.130194] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:17:36.130240] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:17:36.130289] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-29T17:17:36.130374] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-29T17:17:36.130431] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-10-29T17:17:36.130617] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-10-29T17:17:36.130752] [INFO ] [MAIN ] Update Progress: 147/2367 symbols completed. ARMK took 38.9s. Estimated remaining: 4h 25m 13s. Rate: 8.4 symbols/min [2025-10-29T17:17:36.337069] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:17:36.337274] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-29T17:17:36.337332] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-29T17:17:36.337445] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-29T17:17:36.337490] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-29T17:17:36.337558] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-29T17:17:36.337601] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-29T17:17:36.401703] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-29T17:17:36.714060] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:17:36.998242] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T17:17:37.193614] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-29T17:17:37.411198] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:17:37.411499] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-29T17:17:37.411589] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:17:37.411637] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-29T17:17:37.411723] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:17:37.411797] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-29T17:17:37.411860] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-29T17:17:37.411898] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-29T17:17:37.411939] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-29T17:17:37.411987] [INFO ] [MAIN ] Update Progress: 148/2367 symbols completed. ARX took 1.3s. Estimated remaining: 4h 23m 37s. Rate: 8.4 symbols/min [2025-10-29T17:17:37.592873] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:17:37.621069] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T17:17:37.673163] [DEBUG] [LOCAL ] AS: Loaded 53194 existing records from primary storage. [2025-10-29T17:17:37.673471] [INFO ] [MAIN ] AS: Loaded 53194 existing records. [2025-10-29T17:17:37.855523] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:17:37.855764] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-29T17:17:37.855816] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-29T17:17:37.856107] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-29T17:17:37.856166] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-29T17:17:37.999414] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-29T17:17:38.231454] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:17:38.793569] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-29T17:17:39.374960] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T17:17:39.593607] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-29T17:17:39.899146] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T17:17:40.393551] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-29T17:17:40.853674] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T17:17:41.193571] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-29T17:17:41.373846] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T17:17:41.993556] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-29T17:17:42.676851] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-29T17:17:42.793551] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-29T17:17:43.135515] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T17:17:43.593571] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-29T17:17:44.277611] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-29T17:17:44.393563] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-29T17:17:44.784396] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T17:17:45.193525] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-29T17:17:45.392408] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-29T17:17:45.993605] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-29T17:17:46.493942] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T17:17:46.793538] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-29T17:17:46.943933] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T17:17:47.593550] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-29T17:17:47.948118] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T17:17:48.393602] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-29T17:17:48.521130] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T17:17:49.193618] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-29T17:17:49.575604] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-29T17:17:49.585909] [INFO ] [REMOTE ] AROC: Full fetch complete (71080 records). [2025-10-29T17:17:49.586093] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-29T17:17:49.586890] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:17:49.586979] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:17:49.587021] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:17:49.587066] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-29T17:17:49.587151] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-29T17:17:49.587204] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-10-29T17:17:49.587416] [DEBUG] [LOCAL ] AROC: Deleted derivative data file. [2025-10-29T17:17:49.587526] [INFO ] [MAIN ] Update Progress: 149/2367 symbols completed. AROC took 30.5s. Estimated remaining: 4h 24m 45s. Rate: 8.4 symbols/min [2025-10-29T17:17:49.753263] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:17:49.769621] [DEBUG] [LOCAL ] ASA: Loaded 15914 existing records from primary storage. [2025-10-29T17:17:49.769926] [INFO ] [MAIN ] ASA: Loaded 15914 existing records. [2025-10-29T17:17:49.961886] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:17:49.962118] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-29T17:17:49.962166] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-29T17:17:49.962323] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-29T17:17:49.962363] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-29T17:17:49.998899] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-29T17:17:50.344758] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:17:50.591678] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T17:17:50.793610] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-29T17:17:51.372365] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T17:17:51.481236] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T17:17:51.593590] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-29T17:17:52.393616] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-29T17:17:52.994243] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T17:17:53.193588] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-29T17:17:53.970595] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T17:17:53.981162] [INFO ] [REMOTE ] ARR: Full fetch complete (75136 records). [2025-10-29T17:17:53.981301] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-29T17:17:53.983945] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:17:53.984067] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:17:53.984113] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:17:53.984152] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-29T17:17:53.984206] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-29T17:17:53.984241] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-29T17:17:53.984279] [DEBUG] [LOCAL ] ARR: No derivative data file found to delete. [2025-10-29T17:17:53.984333] [INFO ] [MAIN ] Update Progress: 150/2367 symbols completed. ARR took 33.1s. Estimated remaining: 4h 23m 57s. Rate: 8.4 symbols/min [2025-10-29T17:17:53.998709] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-29T17:17:54.152821] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:17:54.212684] [DEBUG] [LOCAL ] ASAN: Loaded 52705 existing records from primary storage. [2025-10-29T17:17:54.213005] [INFO ] [MAIN ] ASAN: Loaded 52705 existing records. [2025-10-29T17:17:54.399887] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:17:54.400354] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-29T17:17:54.400483] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-29T17:17:54.400841] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-29T17:17:54.400915] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-29T17:17:54.732012] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-29T17:17:54.806570] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-29T17:17:54.811578] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:17:55.191191] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T17:17:55.201803] [INFO ] [REMOTE ] ARW: Full fetch complete (48454 records). [2025-10-29T17:17:55.201976] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-29T17:17:55.202757] [FATAL] [VALIDATOR ] ARW: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:17:55.202878] [FATAL] [MAIN ] ARW: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:17:55.202958] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:17:55.203051] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-29T17:17:55.203150] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-29T17:17:55.203227] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-10-29T17:17:55.203544] [DEBUG] [LOCAL ] ARW: Deleted derivative data file. [2025-10-29T17:17:55.203691] [INFO ] [MAIN ] Update Progress: 151/2367 symbols completed. ARW took 33.3s. Estimated remaining: 4h 22m 23s. Rate: 8.4 symbols/min [2025-10-29T17:17:55.375624] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:17:55.416040] [DEBUG] [LOCAL ] ASB: Loaded 49640 existing records from primary storage. [2025-10-29T17:17:55.416333] [INFO ] [MAIN ] ASB: Loaded 49640 existing records. [2025-10-29T17:17:55.589670] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:17:55.589905] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-29T17:17:55.589952] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-29T17:17:55.590258] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-29T17:17:55.590316] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-29T17:17:55.601393] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-29T17:17:55.938898] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:17:56.109800] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T17:17:56.393582] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-29T17:17:56.861332] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-29T17:17:57.086416] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-29T17:17:57.193539] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-29T17:17:57.993565] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-29T17:17:58.509634] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-29T17:17:58.793605] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-29T17:17:59.151519] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T17:17:59.593616] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-29T17:18:00.152440] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T17:18:00.393608] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-29T17:18:00.618068] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-29T17:18:01.193548] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-29T17:18:01.919400] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T17:18:01.993523] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-29T17:18:02.473737] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T17:18:02.793612] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-29T17:18:03.374532] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T17:18:03.593570] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-29T17:18:04.133289] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T17:18:04.393622] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-29T17:18:04.810878] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T17:18:05.193551] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-29T17:18:05.993625] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-29T17:18:06.003037] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-29T17:18:06.697107] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-29T17:18:06.714173] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T17:18:06.793575] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-29T17:18:07.593537] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-29T17:18:07.905593] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T17:18:08.393562] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-29T17:18:09.003116] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T17:18:09.193594] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-29T17:18:09.568669] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T17:18:09.993569] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-29T17:18:10.793547] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-29T17:18:10.856117] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T17:18:10.867163] [INFO ] [REMOTE ] AS: Full fetch complete (76558 records). [2025-10-29T17:18:10.867350] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-29T17:18:10.868222] [FATAL] [VALIDATOR ] AS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:18:10.868318] [FATAL] [MAIN ] AS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:18:10.868361] [WARN ] [MAIN ] AS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:18:10.868431] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-29T17:18:10.868510] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-10-29T17:18:10.868567] [INFO ] [LOCAL ] AS: Starting deletion of derivative data. [2025-10-29T17:18:10.869028] [DEBUG] [LOCAL ] AS: Deleted derivative data file. [2025-10-29T17:18:10.869125] [INFO ] [MAIN ] Update Progress: 152/2367 symbols completed. AS took 33.5s. Estimated remaining: 4h 24m 21s. Rate: 8.4 symbols/min [2025-10-29T17:18:11.041465] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:18:11.046572] [DEBUG] [LOCAL ] ASBA: Loaded 3412 existing records from primary storage. [2025-10-29T17:18:11.046832] [INFO ] [MAIN ] ASBA: Loaded 3412 existing records. [2025-10-29T17:18:11.225275] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:18:11.225513] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-29T17:18:11.225561] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-29T17:18:11.225748] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-29T17:18:11.225808] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-29T17:18:11.596675] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-29T17:18:11.596577] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:18:11.636057] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T17:18:12.058014] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:18:12.233745] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-29T17:18:12.393540] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-29T17:18:13.193602] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-29T17:18:13.781433] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T17:18:13.993635] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-29T17:18:14.467090] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T17:18:14.526508] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T17:18:14.793583] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-29T17:18:15.205686] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-29T17:18:15.593608] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-29T17:18:16.393571] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-29T17:18:16.785308] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-29T17:18:17.129317] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T17:18:17.140452] [INFO ] [REMOTE ] ASB: Full fetch complete (72340 records). [2025-10-29T17:18:17.140622] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-29T17:18:17.203270] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-29T17:18:17.535160] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-29T17:18:17.535244] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-29T17:18:17.535977] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-29T17:18:17.536040] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-29T17:18:17.537418] [DEBUG] [LOCAL ] ASB: Trimmed 72340 records to 49645 (keeping 200 days of data) [2025-10-29T17:18:17.829851] [DEBUG] [LOCAL ] ASB: Primary data saved (49645 records). [2025-10-29T17:18:17.830007] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-29T17:18:17.830107] [INFO ] [MAIN ] Update Progress: 153/2367 symbols completed. ASB took 22.6s. Estimated remaining: 4h 24m 11s. Rate: 8.4 symbols/min [2025-10-29T17:18:17.994058] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-29T17:18:17.995681] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:18:18.030838] [DEBUG] [LOCAL ] ASC: Loaded 36901 existing records from primary storage. [2025-10-29T17:18:18.031204] [INFO ] [MAIN ] ASC: Loaded 36901 existing records. [2025-10-29T17:18:18.205981] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:18:18.206186] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-29T17:18:18.206234] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-29T17:18:18.206450] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-29T17:18:18.206504] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-29T17:18:18.582706] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:18:18.678279] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T17:18:18.730398] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-29T17:18:18.793562] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-29T17:18:19.593693] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-29T17:18:20.393638] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-29T17:18:20.731706] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-29T17:18:20.841095] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-29T17:18:20.852318] [INFO ] [REMOTE ] ASAN: Full fetch complete (76228 records). [2025-10-29T17:18:20.875012] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-29T17:18:20.877378] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T17:18:20.877669] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:18:20.886631] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:18:20.886735] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:18:20.886809] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-29T17:18:20.886873] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-29T17:18:20.886911] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-10-29T17:18:20.887074] [DEBUG] [LOCAL ] ASAN: Deleted derivative data file. [2025-10-29T17:18:20.887489] [INFO ] [MAIN ] Update Progress: 154/2367 symbols completed. ASAN took 26.9s. Estimated remaining: 4h 23m 5s. Rate: 8.4 symbols/min [2025-10-29T17:18:21.058660] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:18:21.076997] [DEBUG] [LOCAL ] ASG: Loaded 19022 existing records from primary storage. [2025-10-29T17:18:21.077235] [INFO ] [MAIN ] ASG: Loaded 19022 existing records. [2025-10-29T17:18:21.198685] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-29T17:18:21.257824] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:18:21.257997] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-29T17:18:21.258044] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-29T17:18:21.258197] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-29T17:18:21.258236] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-29T17:18:21.625708] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:18:21.701431] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-29T17:18:21.993577] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-29T17:18:22.793552] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-29T17:18:23.107457] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:18:23.549772] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T17:18:23.593522] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-29T17:18:24.393631] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-29T17:18:24.664521] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T17:18:25.193611] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-29T17:18:25.336715] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T17:18:25.836694] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T17:18:25.993616] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-29T17:18:26.427152] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-29T17:18:26.793595] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-29T17:18:27.593571] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-29T17:18:27.827427] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T17:18:27.852810] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-29T17:18:28.393596] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-29T17:18:28.885292] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-29T17:18:29.193562] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-29T17:18:29.568370] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-29T17:18:29.993601] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-29T17:18:30.773905] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T17:18:30.793568] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-29T17:18:31.204734] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-29T17:18:31.593592] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-29T17:18:32.078828] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-29T17:18:32.080205] [INFO ] [REMOTE ] ASBA: Full fetch complete (5116 records). [2025-10-29T17:18:32.080275] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-29T17:18:32.398740] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-29T17:18:32.473044] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-29T17:18:32.473119] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-29T17:18:32.473276] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-29T17:18:32.473314] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-29T17:18:32.473720] [DEBUG] [LOCAL ] ASBA: Trimmed 5116 records to 3421 (keeping 200 days of data) [2025-10-29T17:18:32.494277] [DEBUG] [LOCAL ] ASBA: Primary data saved (3421 records). [2025-10-29T17:18:32.494372] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-29T17:18:32.494864] [INFO ] [MAIN ] Update Progress: 155/2367 symbols completed. ASBA took 21.6s. Estimated remaining: 4h 24m 2s. Rate: 8.4 symbols/min [2025-10-29T17:18:32.665391] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:18:32.686961] [DEBUG] [LOCAL ] ASGI: Loaded 22642 existing records from primary storage. [2025-10-29T17:18:32.687209] [INFO ] [MAIN ] ASGI: Loaded 22642 existing records. [2025-10-29T17:18:32.872598] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:18:32.872843] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-29T17:18:32.872890] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-29T17:18:32.873068] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-29T17:18:32.873105] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-29T17:18:33.199316] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-29T17:18:33.239512] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:18:33.607598] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T17:18:33.830139] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T17:18:33.993558] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-29T17:18:34.793586] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-29T17:18:35.103533] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T17:18:35.593556] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-29T17:18:35.714345] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-29T17:18:35.719723] [INFO ] [REMOTE ] ASA: Full fetch complete (21070 records). [2025-10-29T17:18:35.719814] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-29T17:18:36.079050] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-29T17:18:36.079146] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-29T17:18:36.079457] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-29T17:18:36.079495] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-29T17:18:36.080256] [DEBUG] [LOCAL ] ASA: Trimmed 21070 records to 15903 (keeping 200 days of data) [2025-10-29T17:18:36.171241] [DEBUG] [LOCAL ] ASA: Primary data saved (15903 records). [2025-10-29T17:18:36.171373] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-29T17:18:36.171449] [INFO ] [MAIN ] Update Progress: 156/2367 symbols completed. ASA took 46.6s. Estimated remaining: 4h 23m 5s. Rate: 8.4 symbols/min [2025-10-29T17:18:36.341848] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:18:36.374337] [DEBUG] [LOCAL ] ASGN: Loaded 36761 existing records from primary storage. [2025-10-29T17:18:36.374765] [INFO ] [MAIN ] ASGN: Loaded 36761 existing records. [2025-10-29T17:18:36.403284] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-29T17:18:36.509114] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T17:18:36.601327] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:18:36.601555] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-29T17:18:36.601605] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-29T17:18:36.601848] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-29T17:18:36.601902] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-29T17:18:37.010368] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:18:37.193546] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-29T17:18:37.408902] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T17:18:37.993560] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-29T17:18:38.141854] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T17:18:38.793563] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-29T17:18:39.085695] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T17:18:39.593541] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-29T17:18:39.879509] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T17:18:40.393592] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-29T17:18:40.565746] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T17:18:41.036905] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T17:18:41.193559] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-29T17:18:41.854946] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-29T17:18:41.993555] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-29T17:18:42.697875] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-29T17:18:42.793555] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-29T17:18:43.593564] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-29T17:18:43.885120] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T17:18:44.328249] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T17:18:44.393555] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-29T17:18:45.193560] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-29T17:18:45.993558] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-29T17:18:46.230538] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T17:18:46.793545] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-29T17:18:47.147535] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T17:18:47.593538] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-29T17:18:47.691119] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-29T17:18:47.942427] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (3.55 seconds). [2025-10-29T17:18:48.393581] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-29T17:18:48.727944] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-29T17:18:48.736049] [INFO ] [REMOTE ] ASC: Full fetch complete (55790 records). [2025-10-29T17:18:48.736205] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-29T17:18:49.136006] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-29T17:18:49.136545] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-29T17:18:49.137788] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T17:18:49.137233] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-29T17:18:49.142055] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-29T17:18:49.143240] [DEBUG] [LOCAL ] ASC: Trimmed 55790 records to 36904 (keeping 200 days of data) [2025-10-29T17:18:49.193619] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-29T17:18:49.357928] [DEBUG] [LOCAL ] ASC: Primary data saved (36904 records). [2025-10-29T17:18:49.358056] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-29T17:18:49.358132] [INFO ] [MAIN ] Update Progress: 157/2367 symbols completed. ASC took 31.5s. Estimated remaining: 4h 24m 23s. Rate: 8.4 symbols/min [2025-10-29T17:18:49.993571] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-29T17:18:50.325598] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T17:18:50.703941] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T17:18:50.793551] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-29T17:18:51.593568] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-29T17:18:51.794912] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-29T17:18:52.393544] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-29T17:18:52.477199] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T17:18:53.089089] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-29T17:18:53.193535] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-29T17:18:53.848491] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T17:18:53.993550] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-29T17:18:54.762273] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T17:18:54.793516] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-29T17:18:55.467237] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-29T17:18:55.593557] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-29T17:18:56.311726] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-29T17:18:56.393547] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-29T17:18:57.193539] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-29T17:18:57.227138] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T17:18:57.232231] [INFO ] [REMOTE ] ASGI: Full fetch complete (32567 records). [2025-10-29T17:18:57.232317] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-29T17:18:57.622364] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-29T17:18:57.622440] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-29T17:18:57.622887] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-29T17:18:57.622962] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-29T17:18:57.623842] [DEBUG] [LOCAL ] ASGI: Trimmed 32567 records to 22616 (keeping 200 days of data) [2025-10-29T17:18:57.757294] [DEBUG] [LOCAL ] ASGI: Primary data saved (22616 records). [2025-10-29T17:18:57.757409] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-29T17:18:57.757482] [INFO ] [MAIN ] Update Progress: 158/2367 symbols completed. ASGI took 25.3s. Estimated remaining: 4h 24m 33s. Rate: 8.4 symbols/min [2025-10-29T17:18:57.993587] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-29T17:18:58.207117] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T17:18:58.793605] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-29T17:18:58.890860] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T17:18:58.895351] [INFO ] [REMOTE ] ASG: Full fetch complete (30605 records). [2025-10-29T17:18:58.895486] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-29T17:18:59.322730] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-29T17:18:59.322814] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-29T17:18:59.323277] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-29T17:18:59.323339] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-29T17:18:59.324073] [DEBUG] [LOCAL ] ASG: Trimmed 30605 records to 19053 (keeping 200 days of data) [2025-10-29T17:18:59.437731] [DEBUG] [LOCAL ] ASG: Primary data saved (19053 records). [2025-10-29T17:18:59.437893] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-29T17:18:59.437999] [INFO ] [MAIN ] Update Progress: 159/2367 symbols completed. ASG took 38.6s. Estimated remaining: 4h 23m 9s. Rate: 8.4 symbols/min [2025-10-29T17:18:59.698697] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-29T17:18:59.707216] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-29T17:19:00.922618] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T17:19:00.932331] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-29T17:19:02.146328] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T17:19:02.155877] [INFO ] [REMOTE ] ASGN: Full fetch complete (53723 records). [2025-10-29T17:19:02.156049] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-29T17:19:02.156786] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:19:02.156871] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:19:02.156914] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:19:02.156952] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-29T17:19:02.157007] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-29T17:19:02.157041] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-10-29T17:19:02.157202] [DEBUG] [LOCAL ] ASGN: Deleted derivative data file. [2025-10-29T17:19:02.157271] [INFO ] [MAIN ] Update Progress: 160/2367 symbols completed. ASGN took 26.0s. Estimated remaining: 4h 22m 1s. Rate: 8.4 symbols/min [2025-10-29T17:19:02.848987] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:19:02.921752] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:19:02.920862] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:19:02.947433] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:19:02.947614] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-10-29T17:19:02.948049] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-10-29T17:19:02.948743] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-29T17:19:02.948817] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-29T17:19:02.948872] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-29T17:19:02.948911] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-29T17:19:03.180134] [DEBUG] [LOCAL ] ASH: Loaded 37028 existing records from primary storage. [2025-10-29T17:19:03.227831] [DEBUG] [LOCAL ] ASIX: Loaded 22656 existing records from primary storage. [2025-10-29T17:19:03.228100] [INFO ] [MAIN ] ASH: Loaded 37028 existing records. [2025-10-29T17:19:03.228941] [DEBUG] [LOCAL ] ASPN: Loaded 49760 existing records from primary storage. [2025-10-29T17:19:03.239945] [INFO ] [MAIN ] ASPN: Loaded 49760 existing records. [2025-10-29T17:19:03.285815] [INFO ] [MAIN ] ASIX: Loaded 22656 existing records. [2025-10-29T17:19:03.871128] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:19:03.933416] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-29T17:19:03.937289] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:19:03.992876] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-29T17:19:04.014227] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-29T17:19:04.033759] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-29T17:19:04.014055] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:19:04.040570] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:19:04.041256] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-29T17:19:04.041701] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-29T17:19:04.041943] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-29T17:19:04.042102] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-29T17:19:04.041823] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-29T17:19:04.047703] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-29T17:19:04.047750] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-29T17:19:04.088260] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-29T17:19:04.088400] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-29T17:19:05.042436] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:19:05.102908] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-29T17:19:05.120503] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T17:19:05.124242] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:19:05.126247] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-29T17:19:05.127199] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-29T17:19:05.207768] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:19:05.208214] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-29T17:19:05.643216] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T17:19:05.645200] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-29T17:19:05.787590] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-29T17:19:05.993582] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-29T17:19:06.094387] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T17:19:06.458106] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T17:19:06.498282] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T17:19:06.526862] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T17:19:06.793624] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-29T17:19:07.375502] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T17:19:07.593611] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-29T17:19:08.317455] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T17:19:08.393571] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-29T17:19:09.193569] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-29T17:19:09.364744] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T17:19:09.993603] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-29T17:19:10.491158] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T17:19:10.793583] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-29T17:19:11.097342] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T17:19:11.597079] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-29T17:19:11.598364] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T17:19:12.124095] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-29T17:19:12.393563] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-29T17:19:13.193551] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-29T17:19:13.258052] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-29T17:19:13.993561] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-29T17:19:14.422104] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:19:14.442057] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T17:19:14.793623] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-29T17:19:15.483165] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T17:19:15.593582] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-29T17:19:16.393553] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-29T17:19:17.027194] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T17:19:17.193603] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-29T17:19:17.413920] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-29T17:19:17.993604] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-29T17:19:18.403064] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T17:19:18.649887] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-29T17:19:18.793575] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-29T17:19:19.265900] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-29T17:19:19.593586] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-29T17:19:20.393565] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-29T17:19:20.889727] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:19:21.002765] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-29T17:19:21.193563] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-29T17:19:21.993548] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-29T17:19:22.339552] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T17:19:22.762499] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T17:19:22.765059] [INFO ] [REMOTE ] ASR: Full fetch complete (12646 records). [2025-10-29T17:19:22.765136] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-29T17:19:22.799762] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-29T17:19:23.179022] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-29T17:19:23.179113] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-29T17:19:23.179367] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-29T17:19:23.179412] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-29T17:19:23.179896] [DEBUG] [LOCAL ] ASR: Trimmed 12646 records to 9402 (keeping 200 days of data) [2025-10-29T17:19:23.237353] [DEBUG] [LOCAL ] ASR: Primary data saved (9402 records). [2025-10-29T17:19:23.237487] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-29T17:19:23.237556] [INFO ] [MAIN ] Update Progress: 161/2367 symbols completed. ASR took 21.1s. Estimated remaining: 4h 25m 5s. Rate: 8.3 symbols/min [2025-10-29T17:19:23.402107] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:19:23.448255] [DEBUG] [LOCAL ] ASX: Loaded 52851 existing records from primary storage. [2025-10-29T17:19:23.448563] [INFO ] [MAIN ] ASX: Loaded 52851 existing records. [2025-10-29T17:19:23.597701] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-29T17:19:23.626098] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:19:23.627002] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-29T17:19:23.627050] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-29T17:19:23.627568] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-29T17:19:23.627624] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-29T17:19:23.997713] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:19:24.082207] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-29T17:19:24.393566] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-29T17:19:24.768974] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T17:19:25.137950] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T17:19:25.193520] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-29T17:19:25.900037] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T17:19:25.993567] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-29T17:19:26.793714] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-29T17:19:27.542328] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T17:19:27.593599] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-29T17:19:27.779972] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T17:19:28.393554] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-29T17:19:29.120528] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-29T17:19:29.193507] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-29T17:19:29.366932] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-29T17:19:29.993575] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-29T17:19:30.507236] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T17:19:30.793574] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-29T17:19:31.091211] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T17:19:31.593629] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-29T17:19:32.093586] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T17:19:32.393565] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-29T17:19:33.025600] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-29T17:19:33.193564] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-29T17:19:33.441536] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T17:19:33.993557] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-29T17:19:34.327342] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T17:19:34.793531] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-29T17:19:34.844772] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-29T17:19:34.850113] [INFO ] [REMOTE ] ASIX: Full fetch complete (31111 records). [2025-10-29T17:19:34.850213] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-29T17:19:35.223869] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-29T17:19:35.223942] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-29T17:19:35.224328] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-29T17:19:35.224366] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-29T17:19:35.225065] [DEBUG] [LOCAL ] ASIX: Trimmed 31111 records to 22683 (keeping 200 days of data) [2025-10-29T17:19:35.355567] [DEBUG] [LOCAL ] ASIX: Primary data saved (22683 records). [2025-10-29T17:19:35.355712] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-29T17:19:35.355795] [INFO ] [MAIN ] Update Progress: 162/2367 symbols completed. ASIX took 33.2s. Estimated remaining: 4h 26m 5s. Rate: 8.3 symbols/min [2025-10-29T17:19:35.521678] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:19:35.554169] [DEBUG] [LOCAL ] ATEN: Loaded 37208 existing records from primary storage. [2025-10-29T17:19:35.554430] [INFO ] [MAIN ] ATEN: Loaded 37208 existing records. [2025-10-29T17:19:35.598775] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-29T17:19:35.730961] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:19:35.731208] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-29T17:19:35.731255] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-29T17:19:35.731494] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-29T17:19:35.731531] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-29T17:19:36.076429] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:19:36.398724] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-29T17:19:36.416614] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-29T17:19:36.428082] [INFO ] [REMOTE ] ASPN: Full fetch complete (72536 records). [2025-10-29T17:19:36.428247] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-29T17:19:36.816577] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-29T17:19:36.816688] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-29T17:19:36.817397] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-29T17:19:36.817438] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-29T17:19:36.818807] [DEBUG] [LOCAL ] ASPN: Trimmed 72536 records to 49744 (keeping 200 days of data) [2025-10-29T17:19:37.117262] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T17:19:37.119326] [DEBUG] [LOCAL ] ASPN: Primary data saved (49744 records). [2025-10-29T17:19:37.127962] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-29T17:19:37.128448] [INFO ] [MAIN ] Update Progress: 163/2367 symbols completed. ASPN took 35.0s. Estimated remaining: 4h 24m 43s. Rate: 8.3 symbols/min [2025-10-29T17:19:37.161892] [INFO ] [REMOTE ] ASH: Full fetch complete (55567 records). [2025-10-29T17:19:37.196254] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-29T17:19:37.196492] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-29T17:19:37.419283] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:19:37.663508] [DEBUG] [LOCAL ] ATGE: Loaded 29751 existing records from primary storage. [2025-10-29T17:19:37.674842] [INFO ] [MAIN ] ATGE: Loaded 29751 existing records. [2025-10-29T17:19:37.899850] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-29T17:19:37.900167] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-29T17:19:37.901059] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-29T17:19:37.915323] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-29T17:19:37.958859] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:19:37.959637] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-29T17:19:37.960011] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-29T17:19:37.960311] [DEBUG] [LOCAL ] ASH: Trimmed 55567 records to 36975 (keeping 200 days of data) [2025-10-29T17:19:37.960580] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-29T17:19:37.961385] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-29T17:19:38.439987] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-29T17:19:38.542498] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-29T17:19:38.635541] [DEBUG] [LOCAL ] ASH: Primary data saved (36975 records). [2025-10-29T17:19:38.657347] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-29T17:19:38.657214] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:19:38.665808] [INFO ] [MAIN ] Update Progress: 164/2367 symbols completed. ASH took 36.5s. Estimated remaining: 4h 23m 20s. Rate: 8.4 symbols/min [2025-10-29T17:19:38.726562] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-29T17:19:38.798771] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-29T17:19:38.863508] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:19:38.891102] [DEBUG] [LOCAL ] ATHM: Loaded 30483 existing records from primary storage. [2025-10-29T17:19:38.891367] [INFO ] [MAIN ] ATHM: Loaded 30483 existing records. [2025-10-29T17:19:39.064856] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:19:39.065094] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-29T17:19:39.065142] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-29T17:19:39.065439] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-29T17:19:39.065500] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-29T17:19:39.408779] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:19:39.593546] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-29T17:19:39.828579] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-29T17:19:40.041465] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-29T17:19:40.393547] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-29T17:19:40.610054] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-29T17:19:41.193574] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-29T17:19:41.884066] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T17:19:41.978245] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T17:19:41.993519] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-29T17:19:42.793566] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-29T17:19:43.012293] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T17:19:43.593560] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-29T17:19:43.693868] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T17:19:44.393536] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-29T17:19:44.593061] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:19:45.193559] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-29T17:19:45.396428] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-29T17:19:45.993536] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-29T17:19:46.624798] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-29T17:19:46.793724] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-29T17:19:47.014288] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T17:19:47.593626] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-29T17:19:47.956279] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T17:19:48.393689] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-29T17:19:48.731795] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T17:19:49.193546] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-29T17:19:49.471176] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-29T17:19:49.993532] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-29T17:19:50.124727] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T17:19:50.793581] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-29T17:19:51.128508] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T17:19:51.593608] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-29T17:19:52.093283] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T17:19:52.393589] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-29T17:19:52.636436] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T17:19:53.193604] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-29T17:19:53.445676] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-29T17:19:53.993582] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-29T17:19:54.115580] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-29T17:19:54.768174] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T17:19:54.793517] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-29T17:19:55.593518] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-29T17:19:55.699570] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-29T17:19:56.393534] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-29T17:19:56.485482] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T17:19:57.163695] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T17:19:57.193532] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-29T17:19:57.952098] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T17:19:57.993564] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-29T17:19:58.787608] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-29T17:19:58.793531] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-29T17:19:59.593681] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-29T17:19:59.902152] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T17:20:00.393572] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-29T17:20:00.708823] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T17:20:01.193579] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-29T17:20:01.506060] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T17:20:01.511511] [INFO ] [REMOTE ] ATGE: Full fetch complete (45380 records). [2025-10-29T17:20:01.511597] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-29T17:20:01.943835] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-29T17:20:01.943945] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-29T17:20:01.944635] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-29T17:20:01.944739] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-29T17:20:01.946176] [DEBUG] [LOCAL ] ATGE: Trimmed 45380 records to 29806 (keeping 200 days of data) [2025-10-29T17:20:02.016996] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-29T17:20:02.186280] [DEBUG] [LOCAL ] ATGE: Primary data saved (29806 records). [2025-10-29T17:20:02.186496] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-29T17:20:02.186628] [INFO ] [MAIN ] Update Progress: 165/2367 symbols completed. ATGE took 25.1s. Estimated remaining: 4h 26m 51s. Rate: 8.3 symbols/min [2025-10-29T17:20:02.404121] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:02.411217] [DEBUG] [LOCAL ] ATHS: Loaded 6279 existing records from primary storage. [2025-10-29T17:20:02.411379] [INFO ] [MAIN ] ATHS: Loaded 6279 existing records. [2025-10-29T17:20:02.539901] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T17:20:02.577737] [INFO ] [REMOTE ] ATHM: Full fetch complete (48933 records). [2025-10-29T17:20:02.600697] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-29T17:20:02.664751] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:02.702549] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-29T17:20:02.722163] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-29T17:20:02.776933] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-29T17:20:02.788822] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-29T17:20:02.799591] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-29T17:20:03.341789] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-29T17:20:03.353280] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-29T17:20:03.380350] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-29T17:20:03.391729] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-29T17:20:03.430555] [DEBUG] [LOCAL ] ATHM: Trimmed 48933 records to 30389 (keeping 200 days of data) [2025-10-29T17:20:03.556018] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:03.600883] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-29T17:20:03.679700] [DEBUG] [LOCAL ] ATHM: Primary data saved (30389 records). [2025-10-29T17:20:03.679829] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-29T17:20:03.679913] [INFO ] [MAIN ] Update Progress: 166/2367 symbols completed. ATHM took 25.0s. Estimated remaining: 4h 25m 27s. Rate: 8.3 symbols/min [2025-10-29T17:20:03.865064] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:03.910761] [DEBUG] [LOCAL ] ATI: Loaded 51276 existing records from primary storage. [2025-10-29T17:20:03.911147] [INFO ] [MAIN ] ATI: Loaded 51276 existing records. [2025-10-29T17:20:04.155264] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-29T17:20:04.173368] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:04.173997] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-29T17:20:04.175049] [INFO ] [REMOTE ] ASX: Full fetch complete (76787 records). [2025-10-29T17:20:04.174911] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-29T17:20:04.180451] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-29T17:20:04.181441] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T17:20:04.181738] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-29T17:20:04.196616] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-29T17:20:04.398026] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-29T17:20:04.712445] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-29T17:20:05.024151] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-29T17:20:05.020346] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:05.030572] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-29T17:20:05.031382] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-29T17:20:05.032183] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-29T17:20:05.032072] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T17:20:05.036110] [DEBUG] [LOCAL ] ASX: Trimmed 76787 records to 52851 (keeping 200 days of data) [2025-10-29T17:20:05.201321] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-29T17:20:05.347377] [DEBUG] [LOCAL ] ASX: Primary data saved (52851 records). [2025-10-29T17:20:05.347513] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-29T17:20:05.347593] [INFO ] [MAIN ] Update Progress: 167/2367 symbols completed. ASX took 42.1s. Estimated remaining: 4h 24m 7s. Rate: 8.3 symbols/min [2025-10-29T17:20:05.525760] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:05.557826] [DEBUG] [LOCAL ] ATKR: Loaded 34337 existing records from primary storage. [2025-10-29T17:20:05.558093] [INFO ] [MAIN ] ATKR: Loaded 34337 existing records. [2025-10-29T17:20:05.742662] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:05.742906] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-29T17:20:05.742961] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-29T17:20:05.743197] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-29T17:20:05.743260] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-29T17:20:05.998699] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-29T17:20:06.153463] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:06.439734] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T17:20:06.793557] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-29T17:20:07.015155] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-29T17:20:07.593636] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-29T17:20:07.857037] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T17:20:08.393569] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-29T17:20:08.640719] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-29T17:20:08.647187] [INFO ] [REMOTE ] ATEN: Full fetch complete (56189 records). [2025-10-29T17:20:08.647298] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-29T17:20:08.647917] [FATAL] [VALIDATOR ] ATEN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:20:08.648014] [FATAL] [MAIN ] ATEN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:20:08.648056] [WARN ] [MAIN ] ATEN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:20:08.648118] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-29T17:20:08.648179] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-10-29T17:20:08.648214] [INFO ] [LOCAL ] ATEN: Starting deletion of derivative data. [2025-10-29T17:20:08.648388] [DEBUG] [LOCAL ] ATEN: Deleted derivative data file. [2025-10-29T17:20:08.648493] [INFO ] [MAIN ] Update Progress: 168/2367 symbols completed. ATEN took 33.3s. Estimated remaining: 4h 23m 8s. Rate: 8.4 symbols/min [2025-10-29T17:20:08.833964] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:08.867479] [DEBUG] [LOCAL ] ATMU: Loaded 38125 existing records from primary storage. [2025-10-29T17:20:08.867795] [INFO ] [MAIN ] ATMU: Loaded 38125 existing records. [2025-10-29T17:20:09.043071] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:09.043311] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-29T17:20:09.043401] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-29T17:20:09.043610] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-29T17:20:09.043698] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-29T17:20:09.201689] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-29T17:20:09.410794] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:09.613996] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T17:20:09.993619] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-29T17:20:10.418362] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T17:20:10.477443] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T17:20:10.793592] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-29T17:20:11.593567] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-29T17:20:11.844628] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-29T17:20:12.393572] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-29T17:20:13.193620] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-29T17:20:13.531943] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T17:20:13.577942] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-29T17:20:13.993577] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-29T17:20:14.793530] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-29T17:20:14.845415] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (3.25 seconds). [2025-10-29T17:20:15.189291] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T17:20:15.392661] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T17:20:15.593816] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-29T17:20:16.393597] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-29T17:20:16.485021] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T17:20:17.193542] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-29T17:20:17.221890] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T17:20:17.993569] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-29T17:20:18.184484] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T17:20:18.438909] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T17:20:18.793560] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-29T17:20:19.593606] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-29T17:20:19.819361] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T17:20:20.393561] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-29T17:20:20.918526] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T17:20:21.193529] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-29T17:20:21.257442] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-29T17:20:21.682826] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-29T17:20:21.993579] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-29T17:20:22.793563] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-29T17:20:23.242013] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:20:23.593571] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-29T17:20:23.873850] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T17:20:24.393590] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-29T17:20:24.615196] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T17:20:25.193561] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-29T17:20:25.486408] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T17:20:25.657988] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-29T17:20:25.993594] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-29T17:20:26.793578] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-29T17:20:27.007093] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T17:20:27.015877] [INFO ] [REMOTE ] ATKR: Full fetch complete (52854 records). [2025-10-29T17:20:27.016127] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-29T17:20:27.456409] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-29T17:20:27.456541] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-29T17:20:27.457460] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-29T17:20:27.457534] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-29T17:20:27.459382] [DEBUG] [LOCAL ] ATKR: Trimmed 52854 records to 34257 (keeping 200 days of data) [2025-10-29T17:20:27.596167] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-29T17:20:27.690080] [DEBUG] [LOCAL ] ATKR: Primary data saved (34257 records). [2025-10-29T17:20:27.690293] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-29T17:20:27.690398] [INFO ] [MAIN ] Update Progress: 169/2367 symbols completed. ATKR took 22.3s. Estimated remaining: 4h 25m 35s. Rate: 8.3 symbols/min [2025-10-29T17:20:27.905208] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:27.956296] [DEBUG] [LOCAL ] ATO: Loaded 41194 existing records from primary storage. [2025-10-29T17:20:27.957079] [INFO ] [MAIN ] ATO: Loaded 41194 existing records. [2025-10-29T17:20:28.126194] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T17:20:28.151903] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T17:20:28.256974] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:28.257283] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-29T17:20:28.257335] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-29T17:20:28.257758] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-29T17:20:28.257819] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-29T17:20:28.398724] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-29T17:20:28.667193] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:29.193579] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-29T17:20:29.719499] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T17:20:29.993572] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-29T17:20:30.332242] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T17:20:30.793569] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-29T17:20:31.400319] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T17:20:31.422166] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T17:20:31.423985] [INFO ] [REMOTE ] ATHS: Full fetch complete (9501 records). [2025-10-29T17:20:31.424058] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-29T17:20:31.603023] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-29T17:20:31.814672] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-29T17:20:31.814756] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-29T17:20:31.814979] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-29T17:20:31.815015] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-29T17:20:31.815410] [DEBUG] [LOCAL ] ATHS: Trimmed 9501 records to 6258 (keeping 200 days of data) [2025-10-29T17:20:31.851713] [DEBUG] [LOCAL ] ATHS: Primary data saved (6258 records). [2025-10-29T17:20:31.851830] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-29T17:20:31.851905] [INFO ] [MAIN ] Update Progress: 170/2367 symbols completed. ATHS took 29.7s. Estimated remaining: 4h 24m 48s. Rate: 8.3 symbols/min [2025-10-29T17:20:32.020202] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:32.050047] [DEBUG] [LOCAL ] ATR: Loaded 30316 existing records from primary storage. [2025-10-29T17:20:32.050319] [INFO ] [MAIN ] ATR: Loaded 30316 existing records. [2025-10-29T17:20:32.226771] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:32.227010] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-29T17:20:32.227056] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-29T17:20:32.227346] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-29T17:20:32.227401] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-29T17:20:32.396867] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-29T17:20:32.583299] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:32.948601] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T17:20:33.193601] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-29T17:20:33.477847] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-29T17:20:33.993585] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-29T17:20:34.574193] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:20:34.584805] [INFO ] [REMOTE ] ATI: Full fetch complete (74243 records). [2025-10-29T17:20:34.584965] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-29T17:20:34.798852] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-29T17:20:34.986153] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-29T17:20:34.986240] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-29T17:20:34.986978] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-29T17:20:34.987232] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-29T17:20:34.988589] [DEBUG] [LOCAL ] ATI: Trimmed 74243 records to 51265 (keeping 200 days of data) [2025-10-29T17:20:35.289405] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T17:20:35.311027] [DEBUG] [LOCAL ] ATI: Primary data saved (51265 records). [2025-10-29T17:20:35.311129] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-29T17:20:35.311202] [INFO ] [MAIN ] Update Progress: 171/2367 symbols completed. ATI took 31.6s. Estimated remaining: 4h 23m 53s. Rate: 8.3 symbols/min [2025-10-29T17:20:35.504254] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:35.518681] [DEBUG] [LOCAL ] ATS: Loaded 16453 existing records from primary storage. [2025-10-29T17:20:35.518885] [INFO ] [MAIN ] ATS: Loaded 16453 existing records. [2025-10-29T17:20:35.596134] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-29T17:20:35.701396] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:35.701615] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-29T17:20:35.701808] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-29T17:20:35.702066] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-29T17:20:35.702168] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-29T17:20:35.851895] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T17:20:36.084816] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:36.393577] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-29T17:20:36.688959] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T17:20:37.152304] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T17:20:37.193544] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-29T17:20:37.812913] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T17:20:37.993585] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-29T17:20:38.793593] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-29T17:20:39.042584] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T17:20:39.441243] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-29T17:20:39.593575] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-29T17:20:40.393543] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-29T17:20:40.881369] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T17:20:41.193542] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-29T17:20:41.351493] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T17:20:41.953336] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-29T17:20:41.993539] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-29T17:20:42.597875] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T17:20:42.793591] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-29T17:20:43.593565] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-29T17:20:44.051553] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T17:20:44.100807] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-29T17:20:44.393582] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-29T17:20:45.193557] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-29T17:20:45.243390] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T17:20:45.906379] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T17:20:45.993522] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-29T17:20:46.732505] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T17:20:46.793521] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-29T17:20:47.593528] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-29T17:20:47.653897] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-29T17:20:48.393555] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-29T17:20:48.810747] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T17:20:49.193628] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-29T17:20:49.269749] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T17:20:49.907939] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T17:20:49.993590] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-29T17:20:50.793712] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-29T17:20:51.222617] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T17:20:51.593564] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-29T17:20:51.936064] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T17:20:52.393567] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-29T17:20:52.457955] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T17:20:53.193527] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-29T17:20:53.408716] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T17:20:53.993551] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-29T17:20:54.209365] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-29T17:20:54.793565] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-29T17:20:55.178433] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T17:20:55.593526] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-29T17:20:55.797083] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-29T17:20:56.393578] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-29T17:20:56.710938] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T17:20:56.718409] [INFO ] [REMOTE ] ATMU: Full fetch complete (56561 records). [2025-10-29T17:20:56.718497] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-29T17:20:57.101719] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-29T17:20:57.101803] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-29T17:20:57.102426] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-29T17:20:57.102466] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-29T17:20:57.103618] [DEBUG] [LOCAL ] ATMU: Trimmed 56561 records to 38046 (keeping 200 days of data) [2025-10-29T17:20:57.198790] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-29T17:20:57.327286] [DEBUG] [LOCAL ] ATMU: Primary data saved (38046 records). [2025-10-29T17:20:57.327415] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-29T17:20:57.329584] [INFO ] [MAIN ] Update Progress: 172/2367 symbols completed. ATMU took 48.7s. Estimated remaining: 4h 26m 54s. Rate: 8.2 symbols/min [2025-10-29T17:20:57.502902] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:57.548259] [DEBUG] [LOCAL ] ATUS: Loaded 49952 existing records from primary storage. [2025-10-29T17:20:57.570711] [INFO ] [MAIN ] ATUS: Loaded 49952 existing records. [2025-10-29T17:20:57.671693] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T17:20:57.770898] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:57.771365] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-29T17:20:57.771437] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-29T17:20:57.771738] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-29T17:20:57.771799] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-29T17:20:57.973499] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T17:20:57.999346] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-29T17:20:58.020418] [INFO ] [REMOTE ] ATS: Full fetch complete (25116 records). [2025-10-29T17:20:58.041065] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-29T17:20:58.364927] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:58.570527] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-29T17:20:58.570608] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-29T17:20:58.571022] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-29T17:20:58.571086] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-29T17:20:58.571876] [DEBUG] [LOCAL ] ATS: Trimmed 25116 records to 16477 (keeping 200 days of data) [2025-10-29T17:20:58.668259] [DEBUG] [LOCAL ] ATS: Primary data saved (16477 records). [2025-10-29T17:20:58.668404] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-29T17:20:58.668495] [INFO ] [MAIN ] Update Progress: 173/2367 symbols completed. ATS took 23.4s. Estimated remaining: 4h 25m 32s. Rate: 8.3 symbols/min [2025-10-29T17:20:58.798728] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-29T17:20:58.857232] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:20:58.904128] [DEBUG] [LOCAL ] AU: Loaded 53074 existing records from primary storage. [2025-10-29T17:20:58.904428] [INFO ] [MAIN ] AU: Loaded 53074 existing records. [2025-10-29T17:20:59.084774] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:20:59.085146] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-29T17:20:59.085207] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-29T17:20:59.085627] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-29T17:20:59.085705] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-29T17:20:59.446629] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:20:59.469875] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-29T17:20:59.593569] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-29T17:20:59.902458] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T17:21:00.393591] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-29T17:21:00.807825] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T17:21:00.817093] [INFO ] [REMOTE ] ATO: Full fetch complete (60522 records). [2025-10-29T17:21:00.817264] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-29T17:21:01.200328] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-29T17:21:01.238111] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-29T17:21:01.238186] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-29T17:21:01.238843] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-29T17:21:01.238905] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-29T17:21:01.240238] [DEBUG] [LOCAL ] ATO: Trimmed 60522 records to 41182 (keeping 200 days of data) [2025-10-29T17:21:01.495733] [DEBUG] [LOCAL ] ATO: Primary data saved (41182 records). [2025-10-29T17:21:01.495855] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-29T17:21:01.495955] [INFO ] [MAIN ] Update Progress: 174/2367 symbols completed. ATO took 33.8s. Estimated remaining: 4h 24m 28s. Rate: 8.3 symbols/min [2025-10-29T17:21:01.672509] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:21:01.725583] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T17:21:01.752430] [DEBUG] [LOCAL ] AUB: Loaded 45626 existing records from primary storage. [2025-10-29T17:21:01.752779] [INFO ] [MAIN ] AUB: Loaded 45626 existing records. [2025-10-29T17:21:01.933483] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:21:01.933742] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-29T17:21:01.933806] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-29T17:21:01.934179] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-29T17:21:01.934218] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-29T17:21:01.998757] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-29T17:21:02.306570] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:21:02.424623] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T17:21:02.434813] [INFO ] [REMOTE ] ATR: Full fetch complete (44040 records). [2025-10-29T17:21:02.435004] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-29T17:21:02.801314] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-29T17:21:03.021304] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-29T17:21:03.021423] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-29T17:21:03.022386] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-29T17:21:03.022476] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-29T17:21:03.025411] [DEBUG] [LOCAL ] ATR: Trimmed 44040 records to 30454 (keeping 200 days of data) [2025-10-29T17:21:03.337914] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T17:21:03.369040] [DEBUG] [LOCAL ] ATR: Primary data saved (30454 records). [2025-10-29T17:21:03.369196] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-29T17:21:03.369281] [INFO ] [MAIN ] Update Progress: 175/2367 symbols completed. ATR took 31.5s. Estimated remaining: 4h 23m 14s. Rate: 8.3 symbols/min [2025-10-29T17:21:03.574346] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:21:03.574535] [DEBUG] [LOCAL ] AUNA: No existing data file found in primary storage. [2025-10-29T17:21:03.574601] [WARN ] [MAIN ] AUNA: No existing data found, performing full refresh instead. [2025-10-29T17:21:03.574771] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-29T17:21:03.574822] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-29T17:21:03.574873] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-10-29T17:21:03.574916] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-29T17:21:03.601622] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-29T17:21:03.983515] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:21:04.289036] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-29T17:21:04.393566] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-29T17:21:04.734547] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T17:21:05.193578] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-29T17:21:05.490724] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T17:21:05.993604] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-29T17:21:06.340110] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T17:21:06.520448] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-29T17:21:06.793566] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-29T17:21:07.593537] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-29T17:21:07.957242] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T17:21:08.031375] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T17:21:08.393566] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-29T17:21:08.760351] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-29T17:21:09.193577] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-29T17:21:09.555901] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-29T17:21:09.993624] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-29T17:21:10.338367] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-29T17:21:10.793598] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-29T17:21:11.593594] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-29T17:21:12.214520] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T17:21:12.393566] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-29T17:21:12.824078] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T17:21:13.193582] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-29T17:21:13.586610] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T17:21:13.852136] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-29T17:21:13.993567] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-29T17:21:14.793561] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-29T17:21:15.603801] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-29T17:21:15.625277] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-29T17:21:15.743119] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T17:21:15.970517] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-29T17:21:16.393608] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-29T17:21:17.193577] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-29T17:21:17.658375] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-29T17:21:17.855184] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-29T17:21:17.993548] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-29T17:21:18.476719] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-29T17:21:18.793559] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-29T17:21:19.593697] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-29T17:21:19.939774] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T17:21:20.393592] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-29T17:21:21.193544] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-29T17:21:21.354043] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-29T17:21:21.706171] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T17:21:21.993559] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-29T17:21:22.335776] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T17:21:22.793589] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-29T17:21:23.297527] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T17:21:23.593595] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-29T17:21:24.114531] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T17:21:24.393618] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-29T17:21:24.949918] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-29T17:21:24.952406] [INFO ] [REMOTE ] AUNA: Full fetch complete (7912 records). [2025-10-29T17:21:24.952505] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-29T17:21:25.194834] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-29T17:21:25.208392] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-29T17:21:25.402352] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-29T17:21:25.402429] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-29T17:21:25.402680] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-29T17:21:25.402742] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-29T17:21:25.403141] [DEBUG] [LOCAL ] AUNA: Trimmed 7912 records to 5412 (keeping 200 days of data) [2025-10-29T17:21:25.432488] [DEBUG] [LOCAL ] AUNA: Primary data saved (5412 records). [2025-10-29T17:21:25.432626] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-29T17:21:25.432734] [INFO ] [MAIN ] Update Progress: 176/2367 symbols completed. AUNA took 22.1s. Estimated remaining: 4h 26m 12s. Rate: 8.2 symbols/min [2025-10-29T17:21:25.604272] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:21:25.641999] [DEBUG] [LOCAL ] AVA: Loaded 37896 existing records from primary storage. [2025-10-29T17:21:25.642271] [INFO ] [MAIN ] AVA: Loaded 37896 existing records. [2025-10-29T17:21:25.840167] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:21:25.840387] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-29T17:21:25.840436] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-29T17:21:25.840621] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-29T17:21:25.840712] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-29T17:21:25.998729] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-29T17:21:26.216049] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:21:26.468518] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T17:21:26.793572] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-29T17:21:27.593713] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-29T17:21:27.644257] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-29T17:21:27.967997] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T17:21:28.393608] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-29T17:21:28.703099] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T17:21:29.193609] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-29T17:21:29.215304] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-29T17:21:29.993557] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-29T17:21:30.402992] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T17:21:30.413552] [INFO ] [REMOTE ] ATUS: Full fetch complete (71453 records). [2025-10-29T17:21:30.413700] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-29T17:21:30.820209] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-29T17:21:30.820336] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-29T17:21:30.798547] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-29T17:21:30.822361] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-29T17:21:30.822534] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-29T17:21:30.823971] [DEBUG] [LOCAL ] ATUS: Trimmed 71453 records to 49981 (keeping 200 days of data) [2025-10-29T17:21:31.117669] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-29T17:21:31.134188] [DEBUG] [LOCAL ] ATUS: Primary data saved (49981 records). [2025-10-29T17:21:31.134298] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-29T17:21:31.135193] [INFO ] [MAIN ] Update Progress: 177/2367 symbols completed. ATUS took 33.8s. Estimated remaining: 4h 25m 45s. Rate: 8.2 symbols/min [2025-10-29T17:21:31.300125] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:21:31.310632] [DEBUG] [LOCAL ] AVAL: Loaded 8308 existing records from primary storage. [2025-10-29T17:21:31.310867] [INFO ] [MAIN ] AVAL: Loaded 8308 existing records. [2025-10-29T17:21:31.482766] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:21:31.483017] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-29T17:21:31.483064] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-29T17:21:31.483203] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-29T17:21:31.483239] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-29T17:21:31.598786] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-29T17:21:31.847329] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:21:31.945173] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T17:21:32.393556] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-29T17:21:32.627091] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T17:21:33.193578] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-29T17:21:33.444734] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T17:21:33.993579] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-29T17:21:34.201019] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T17:21:34.793554] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-29T17:21:35.034799] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T17:21:35.593554] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-29T17:21:35.855739] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T17:21:36.179704] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-29T17:21:36.393562] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-29T17:21:37.193621] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-29T17:21:37.698630] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T17:21:37.993605] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-29T17:21:38.793615] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-29T17:21:39.096957] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-29T17:21:39.108485] [INFO ] [REMOTE ] AU: Full fetch complete (76657 records). [2025-10-29T17:21:39.108668] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-29T17:21:39.542278] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-29T17:21:39.538602] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-29T17:21:39.542401] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-29T17:21:39.543193] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-29T17:21:39.543280] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-29T17:21:39.553132] [DEBUG] [LOCAL ] AU: Trimmed 76657 records to 53072 (keeping 200 days of data) [2025-10-29T17:21:39.604750] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-29T17:21:39.900866] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T17:21:39.923398] [DEBUG] [LOCAL ] AU: Primary data saved (53072 records). [2025-10-29T17:21:39.923838] [INFO ] [MAIN ] AU: Full history saved. [2025-10-29T17:21:39.923946] [INFO ] [MAIN ] Update Progress: 178/2367 symbols completed. AU took 41.3s. Estimated remaining: 4h 25m 56s. Rate: 8.2 symbols/min [2025-10-29T17:21:40.092384] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:21:40.132980] [DEBUG] [LOCAL ] AVB: Loaded 41829 existing records from primary storage. [2025-10-29T17:21:40.133335] [INFO ] [MAIN ] AVB: Loaded 41829 existing records. [2025-10-29T17:21:40.351946] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:21:40.352172] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-29T17:21:40.352219] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-29T17:21:40.352791] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-29T17:21:40.352848] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-29T17:21:40.398746] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-29T17:21:40.704431] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:21:40.838455] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T17:21:41.193613] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-29T17:21:41.901955] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T17:21:41.911610] [INFO ] [REMOTE ] AUB: Full fetch complete (66520 records). [2025-10-29T17:21:41.911788] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-29T17:21:42.002398] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-29T17:21:42.321796] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-29T17:21:42.322039] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-29T17:21:42.322888] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-29T17:21:42.323000] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-29T17:21:42.324831] [DEBUG] [LOCAL ] AUB: Trimmed 66520 records to 45587 (keeping 200 days of data) [2025-10-29T17:21:42.445987] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T17:21:42.623361] [DEBUG] [LOCAL ] AUB: Primary data saved (45587 records). [2025-10-29T17:21:42.623488] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-29T17:21:42.623567] [INFO ] [MAIN ] Update Progress: 179/2367 symbols completed. AUB took 41.1s. Estimated remaining: 4h 24m 53s. Rate: 8.3 symbols/min [2025-10-29T17:21:42.737410] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T17:21:42.806015] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-29T17:21:42.809431] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:21:42.810446] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-29T17:21:42.810496] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-29T17:21:42.810620] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-29T17:21:42.810692] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-29T17:21:42.810748] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-29T17:21:42.810781] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-29T17:21:43.166896] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:21:43.593604] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-29T17:21:43.745473] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:21:43.745840] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-29T17:21:43.745963] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:21:43.746046] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-29T17:21:43.746122] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:21:43.746206] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-29T17:21:43.746281] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-29T17:21:43.746326] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-29T17:21:43.746382] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-29T17:21:43.746461] [INFO ] [MAIN ] Update Progress: 180/2367 symbols completed. AVBC took 1.1s. Estimated remaining: 4h 23m 31s. Rate: 8.3 symbols/min [2025-10-29T17:21:43.935617] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:21:43.958245] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T17:21:43.979922] [DEBUG] [LOCAL ] AVD: Loaded 20832 existing records from primary storage. [2025-10-29T17:21:43.980190] [INFO ] [MAIN ] AVD: Loaded 20832 existing records. [2025-10-29T17:21:44.162814] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:21:44.163041] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-29T17:21:44.163089] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-29T17:21:44.163289] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-29T17:21:44.163332] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-29T17:21:44.400816] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-29T17:21:44.552630] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:21:45.193584] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-29T17:21:45.234012] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T17:21:45.993528] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-29T17:21:46.198204] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-29T17:21:46.793562] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-29T17:21:47.089168] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T17:21:47.593583] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-29T17:21:47.853338] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T17:21:47.861215] [INFO ] [REMOTE ] AVA: Full fetch complete (55478 records). [2025-10-29T17:21:47.861347] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-29T17:21:48.241993] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-29T17:21:48.242095] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-29T17:21:48.242712] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-29T17:21:48.242775] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-29T17:21:48.244121] [DEBUG] [LOCAL ] AVA: Trimmed 55478 records to 37936 (keeping 200 days of data) [2025-10-29T17:21:48.415195] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-29T17:21:48.460719] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T17:21:48.495708] [DEBUG] [LOCAL ] AVA: Primary data saved (37936 records). [2025-10-29T17:21:48.495831] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-29T17:21:48.496393] [INFO ] [MAIN ] Update Progress: 181/2367 symbols completed. AVA took 23.1s. Estimated remaining: 4h 22m 54s. Rate: 8.3 symbols/min [2025-10-29T17:21:48.664324] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:21:48.685074] [DEBUG] [LOCAL ] AVK: Loaded 18344 existing records from primary storage. [2025-10-29T17:21:48.685312] [INFO ] [MAIN ] AVK: Loaded 18344 existing records. [2025-10-29T17:21:48.859214] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:21:48.859464] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-29T17:21:48.859546] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-29T17:21:48.859784] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-29T17:21:48.859849] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-29T17:21:48.998946] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-29T17:21:49.198697] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-29T17:21:49.264718] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:21:49.797465] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-29T17:21:49.993536] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-29T17:21:50.793532] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-29T17:21:50.824146] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-29T17:21:51.593540] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-29T17:21:51.635594] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-29T17:21:52.212153] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T17:21:52.393621] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-29T17:21:53.155986] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-29T17:21:53.193566] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-29T17:21:53.854192] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-29T17:21:53.993536] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-29T17:21:54.709586] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T17:21:54.793573] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-29T17:21:55.593709] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-29T17:21:56.159232] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T17:21:56.348129] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T17:21:56.393542] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-29T17:21:57.193552] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-29T17:21:57.220855] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T17:21:57.798922] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-29T17:21:57.993552] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-29T17:21:58.578286] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-29T17:21:58.793566] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-29T17:21:59.593606] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-29T17:21:59.885615] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T17:22:00.393537] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-29T17:22:00.419855] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T17:22:01.193584] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-29T17:22:01.529226] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T17:22:01.709408] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T17:22:01.993614] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-29T17:22:02.793520] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-29T17:22:02.851489] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-29T17:22:02.855219] [INFO ] [REMOTE ] AVD: Full fetch complete (32122 records). [2025-10-29T17:22:02.855293] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-29T17:22:02.855761] [FATAL] [VALIDATOR ] AVD: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:22:02.855840] [FATAL] [MAIN ] AVD: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:22:02.855882] [WARN ] [MAIN ] AVD: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:22:02.855953] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-29T17:22:02.856199] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-29T17:22:02.856243] [INFO ] [LOCAL ] AVD: Starting deletion of derivative data. [2025-10-29T17:22:02.856404] [DEBUG] [LOCAL ] AVD: Deleted derivative data file. [2025-10-29T17:22:02.856489] [INFO ] [MAIN ] Update Progress: 182/2367 symbols completed. AVD took 19.1s. Estimated remaining: 4h 24m 12s. Rate: 8.3 symbols/min [2025-10-29T17:22:03.025839] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:22:03.057675] [DEBUG] [LOCAL ] AVNS: Loaded 33233 existing records from primary storage. [2025-10-29T17:22:03.057935] [INFO ] [MAIN ] AVNS: Loaded 33233 existing records. [2025-10-29T17:22:03.233132] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:22:03.233355] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-29T17:22:03.233400] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-29T17:22:03.233826] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-29T17:22:03.233895] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-29T17:22:03.580810] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:22:03.593518] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-29T17:22:03.844496] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T17:22:04.393587] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-29T17:22:04.535723] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T17:22:05.193612] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-29T17:22:05.571773] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T17:22:05.979490] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T17:22:05.993513] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-29T17:22:06.793605] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-29T17:22:06.793513] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T17:22:07.282180] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-29T17:22:07.593580] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-29T17:22:08.393581] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-29T17:22:08.834334] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T17:22:08.955591] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-29T17:22:09.193545] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-29T17:22:09.993576] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-29T17:22:10.090032] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T17:22:10.092777] [INFO ] [REMOTE ] AVAL: Full fetch complete (15152 records). [2025-10-29T17:22:10.092851] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-29T17:22:10.511706] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-29T17:22:10.511798] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-29T17:22:10.512108] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-29T17:22:10.512150] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-29T17:22:10.512713] [DEBUG] [LOCAL ] AVAL: Trimmed 15152 records to 8228 (keeping 200 days of data) [2025-10-29T17:22:10.562287] [DEBUG] [LOCAL ] AVAL: Primary data saved (8228 records). [2025-10-29T17:22:10.562426] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-29T17:22:10.562505] [INFO ] [MAIN ] Update Progress: 183/2367 symbols completed. AVAL took 39.4s. Estimated remaining: 4h 24m 10s. Rate: 8.3 symbols/min [2025-10-29T17:22:10.742671] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:22:10.783611] [DEBUG] [LOCAL ] AVNT: Loaded 38109 existing records from primary storage. [2025-10-29T17:22:10.783960] [INFO ] [MAIN ] AVNT: Loaded 38109 existing records. [2025-10-29T17:22:10.798715] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-29T17:22:10.976907] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:22:10.977144] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-29T17:22:10.977193] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-29T17:22:10.977704] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-29T17:22:10.977764] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-29T17:22:11.338612] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:22:11.480868] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T17:22:11.493768] [INFO ] [REMOTE ] AVB: Full fetch complete (59645 records). [2025-10-29T17:22:11.493964] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-29T17:22:11.601063] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-29T17:22:11.934520] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-29T17:22:11.942264] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-29T17:22:11.955347] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-29T17:22:11.955524] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-29T17:22:11.957504] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T17:22:11.967104] [DEBUG] [LOCAL ] AVB: Trimmed 59645 records to 41864 (keeping 200 days of data) [2025-10-29T17:22:12.224920] [DEBUG] [LOCAL ] AVB: Primary data saved (41864 records). [2025-10-29T17:22:12.225036] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-29T17:22:12.225106] [INFO ] [MAIN ] Update Progress: 184/2367 symbols completed. AVB took 32.3s. Estimated remaining: 4h 22m 57s. Rate: 8.3 symbols/min [2025-10-29T17:22:12.402759] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-29T17:22:12.402669] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:22:12.418020] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-10-29T17:22:12.418300] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-10-29T17:22:12.418750] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-29T17:22:12.420736] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T17:22:12.419347] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-29T17:22:12.428801] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-29T17:22:12.429266] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-29T17:22:12.814345] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:22:13.193576] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-29T17:22:13.378821] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T17:22:13.993562] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-29T17:22:14.537122] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T17:22:14.793582] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-29T17:22:15.123709] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T17:22:15.593977] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T17:22:15.594195] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-29T17:22:16.086328] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-29T17:22:16.393574] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-29T17:22:17.193545] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-29T17:22:17.221561] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T17:22:17.993722] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-29T17:22:18.418609] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T17:22:18.793553] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-29T17:22:18.834690] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T17:22:19.593567] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-29T17:22:20.037105] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T17:22:20.316606] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T17:22:20.393562] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-29T17:22:21.193564] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-29T17:22:21.665910] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T17:22:21.993568] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-29T17:22:22.179001] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T17:22:22.793566] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-29T17:22:23.139858] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:22:23.593571] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-29T17:22:23.836774] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T17:22:24.381514] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-29T17:22:24.393525] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-29T17:22:25.193552] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-29T17:22:25.689773] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T17:22:25.993595] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-29T17:22:26.685129] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-29T17:22:26.793564] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-29T17:22:27.409241] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-29T17:22:27.416335] [INFO ] [REMOTE ] AVNS: Full fetch complete (48085 records). [2025-10-29T17:22:27.416462] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-29T17:22:27.594511] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-29T17:22:27.825168] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-29T17:22:27.825347] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-29T17:22:27.825953] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-29T17:22:27.826037] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-29T17:22:27.834434] [DEBUG] [LOCAL ] AVNS: Trimmed 48085 records to 33218 (keeping 200 days of data) [2025-10-29T17:22:27.849784] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T17:22:28.056021] [DEBUG] [LOCAL ] AVNS: Primary data saved (33218 records). [2025-10-29T17:22:28.056190] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-29T17:22:28.056295] [INFO ] [MAIN ] Update Progress: 185/2367 symbols completed. AVNS took 25.2s. Estimated remaining: 4h 24m 31s. Rate: 8.2 symbols/min [2025-10-29T17:22:28.239137] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:22:28.239301] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-29T17:22:28.239338] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-29T17:22:28.239458] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-29T17:22:28.239525] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-29T17:22:28.239592] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-29T17:22:28.239639] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-29T17:22:28.396413] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-29T17:22:28.629543] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:22:28.631790] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-29T17:22:29.193549] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-29T17:22:29.751760] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T17:22:29.839337] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T17:22:29.993551] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-29T17:22:30.793557] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-29T17:22:30.873600] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T17:22:31.308138] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-29T17:22:31.593560] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-29T17:22:32.393562] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-29T17:22:32.689235] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-29T17:22:33.193548] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-29T17:22:33.603558] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T17:22:33.993553] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-29T17:22:34.160118] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T17:22:34.793570] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-29T17:22:34.975782] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T17:22:34.981499] [INFO ] [REMOTE ] AVK: Full fetch complete (26812 records). [2025-10-29T17:22:34.981684] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-29T17:22:35.381884] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-29T17:22:35.381962] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-29T17:22:35.382334] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-29T17:22:35.382395] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-29T17:22:35.383134] [DEBUG] [LOCAL ] AVK: Trimmed 26812 records to 18394 (keeping 200 days of data) [2025-10-29T17:22:35.499091] [DEBUG] [LOCAL ] AVK: Primary data saved (18394 records). [2025-10-29T17:22:35.499224] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-29T17:22:35.499318] [INFO ] [MAIN ] Update Progress: 186/2367 symbols completed. AVK took 47.0s. Estimated remaining: 4h 24m 26s. Rate: 8.2 symbols/min [2025-10-29T17:22:35.600454] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-29T17:22:35.676712] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:22:35.702453] [DEBUG] [LOCAL ] AWF: Loaded 23902 existing records from primary storage. [2025-10-29T17:22:35.702724] [INFO ] [MAIN ] AWF: Loaded 23902 existing records. [2025-10-29T17:22:35.891073] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:22:35.891298] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-29T17:22:35.891347] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-29T17:22:35.891776] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-29T17:22:35.891835] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-29T17:22:36.306875] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:22:36.332496] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-29T17:22:36.393558] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-29T17:22:36.874598] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T17:22:37.193584] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-29T17:22:37.454232] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T17:22:37.993570] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-29T17:22:38.311882] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T17:22:38.321022] [INFO ] [REMOTE ] AVNT: Full fetch complete (55843 records). [2025-10-29T17:22:38.321198] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-29T17:22:38.708948] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-29T17:22:38.709036] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-29T17:22:38.709693] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-29T17:22:38.709754] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-29T17:22:38.710847] [DEBUG] [LOCAL ] AVNT: Trimmed 55843 records to 38002 (keeping 200 days of data) [2025-10-29T17:22:38.799190] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-29T17:22:38.946754] [DEBUG] [LOCAL ] AVNT: Primary data saved (38002 records). [2025-10-29T17:22:38.947378] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-29T17:22:38.948113] [INFO ] [MAIN ] Update Progress: 187/2367 symbols completed. AVNT took 28.4s. Estimated remaining: 4h 23m 34s. Rate: 8.3 symbols/min [2025-10-29T17:22:39.122980] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:22:39.149590] [DEBUG] [LOCAL ] AWI: Loaded 24954 existing records from primary storage. [2025-10-29T17:22:39.150012] [INFO ] [MAIN ] AWI: Loaded 24954 existing records. [2025-10-29T17:22:39.373192] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:22:39.377215] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T17:22:39.386381] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-29T17:22:39.386482] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-29T17:22:39.387004] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-29T17:22:39.387393] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-29T17:22:39.598737] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-29T17:22:39.745417] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:22:39.766440] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T17:22:40.393582] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-29T17:22:41.103045] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-29T17:22:41.193613] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-29T17:22:41.618994] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:22:41.993564] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-29T17:22:42.118269] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-29T17:22:42.793698] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-29T17:22:42.835403] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T17:22:43.593561] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-29T17:22:43.632331] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T17:22:44.380192] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-29T17:22:44.393522] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-29T17:22:45.192289] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T17:22:45.198670] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-29T17:22:45.993568] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-29T17:22:46.358273] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T17:22:46.755442] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T17:22:46.793552] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-29T17:22:47.593538] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-29T17:22:47.648802] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T17:22:48.400257] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-29T17:22:48.402423] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T17:22:49.193612] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-29T17:22:49.832622] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-29T17:22:49.843935] [INFO ] [REMOTE ] AVTR: Full fetch complete (77676 records). [2025-10-29T17:22:49.844064] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-29T17:22:50.002787] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-29T17:22:50.177242] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T17:22:50.287062] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-29T17:22:50.287176] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-29T17:22:50.288019] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-29T17:22:50.288082] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-29T17:22:50.289477] [DEBUG] [LOCAL ] AVTR: Trimmed 77676 records to 53570 (keeping 200 days of data) [2025-10-29T17:22:50.627801] [DEBUG] [LOCAL ] AVTR: Primary data saved (53570 records). [2025-10-29T17:22:50.628011] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-29T17:22:50.628136] [INFO ] [MAIN ] Update Progress: 188/2367 symbols completed. AVTR took 38.4s. Estimated remaining: 4h 24m 18s. Rate: 8.2 symbols/min [2025-10-29T17:22:50.796905] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-29T17:22:50.831491] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:22:50.875674] [DEBUG] [LOCAL ] AWK: Loaded 48235 existing records from primary storage. [2025-10-29T17:22:50.876006] [INFO ] [MAIN ] AWK: Loaded 48235 existing records. [2025-10-29T17:22:51.073037] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:22:51.073330] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-29T17:22:51.073408] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-29T17:22:51.082270] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-29T17:22:51.096611] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-29T17:22:51.168562] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T17:22:51.501287] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:22:51.593568] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-29T17:22:51.882311] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T17:22:52.393548] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-29T17:22:52.427923] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-29T17:22:53.193581] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-29T17:22:53.458565] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T17:22:53.898086] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T17:22:53.993602] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-29T17:22:54.793538] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-29T17:22:55.014137] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-29T17:22:55.593549] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-29T17:22:55.699892] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-29T17:22:56.393549] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-29T17:22:56.466847] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T17:22:57.193615] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-29T17:22:57.675997] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T17:22:57.689925] [INFO ] [REMOTE ] AVY: Full fetch complete (56680 records). [2025-10-29T17:22:57.690099] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-29T17:22:58.004400] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-29T17:22:58.124274] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-29T17:22:58.124382] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-29T17:22:58.125123] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-29T17:22:58.125205] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-29T17:22:58.142710] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T17:22:58.148034] [DEBUG] [LOCAL ] AVY: Trimmed 56680 records to 37767 (keeping 200 days of data) [2025-10-29T17:22:58.389913] [DEBUG] [LOCAL ] AVY: Primary data saved (37767 records). [2025-10-29T17:22:58.390048] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-29T17:22:58.390117] [INFO ] [MAIN ] Update Progress: 189/2367 symbols completed. AVY took 30.3s. Estimated remaining: 4h 24m 16s. Rate: 8.2 symbols/min [2025-10-29T17:22:58.568431] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:22:58.590970] [DEBUG] [LOCAL ] AWP: Loaded 21301 existing records from primary storage. [2025-10-29T17:22:58.591238] [INFO ] [MAIN ] AWP: Loaded 21301 existing records. [2025-10-29T17:22:58.787804] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:22:58.788051] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-29T17:22:58.788099] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-29T17:22:58.788349] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-29T17:22:58.788601] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-29T17:22:58.800895] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-29T17:22:59.156161] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:22:59.593579] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-29T17:23:00.393628] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-29T17:23:04.476628] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (6.47 seconds). [2025-10-29T17:23:04.484465] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-29T17:23:04.683772] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (5.09 seconds). [2025-10-29T17:23:04.690278] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-29T17:23:04.864636] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (4.47 seconds). [2025-10-29T17:23:04.871638] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-29T17:23:05.280289] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (6.48 seconds). [2025-10-29T17:23:05.292683] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-29T17:23:05.306981] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T17:23:05.311515] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-29T17:23:06.174232] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-29T17:23:06.179980] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-29T17:23:06.578946] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T17:23:06.586684] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-29T17:23:06.847389] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-29T17:23:06.853923] [INFO ] [REMOTE ] AWF: Full fetch complete (35819 records). [2025-10-29T17:23:06.854014] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-29T17:23:07.262483] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-29T17:23:07.262992] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-29T17:23:07.264350] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-29T17:23:07.323957] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-29T17:23:07.330111] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-29T17:23:07.332882] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T17:23:07.346386] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-29T17:23:07.352493] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-29T17:23:07.362382] [DEBUG] [LOCAL ] AWF: Trimmed 35819 records to 23833 (keeping 200 days of data) [2025-10-29T17:23:07.365096] [INFO ] [REMOTE ] AWI: Full fetch complete (36412 records). [2025-10-29T17:23:07.365318] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-29T17:23:07.597710] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-29T17:23:07.678344] [DEBUG] [LOCAL ] AWF: Primary data saved (23833 records). [2025-10-29T17:23:07.684328] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-29T17:23:07.700173] [INFO ] [MAIN ] Update Progress: 190/2367 symbols completed. AWF took 32.2s. Estimated remaining: 4h 24m 32s. Rate: 8.2 symbols/min [2025-10-29T17:23:08.117194] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:23:08.198376] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-29T17:23:08.198468] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-29T17:23:08.198974] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-29T17:23:08.199040] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-29T17:23:08.200277] [DEBUG] [LOCAL ] AWI: Trimmed 36412 records to 24986 (keeping 200 days of data) [2025-10-29T17:23:08.309999] [DEBUG] [LOCAL ] AWR: Loaded 22474 existing records from primary storage. [2025-10-29T17:23:08.311738] [INFO ] [MAIN ] AWR: Loaded 22474 existing records. [2025-10-29T17:23:08.525103] [DEBUG] [LOCAL ] AWI: Primary data saved (24986 records). [2025-10-29T17:23:08.546972] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-29T17:23:08.589226] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-29T17:23:08.577798] [INFO ] [MAIN ] Update Progress: 191/2367 symbols completed. AWI took 29.6s. Estimated remaining: 4h 23m 12s. Rate: 8.3 symbols/min [2025-10-29T17:23:08.641084] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-29T17:23:08.625779] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:23:08.664226] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-29T17:23:08.722783] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-29T17:23:08.736052] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-29T17:23:08.757282] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-29T17:23:08.868527] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:23:09.175790] [DEBUG] [LOCAL ] AX: Loaded 27197 existing records from primary storage. [2025-10-29T17:23:09.229399] [INFO ] [MAIN ] AX: Loaded 27197 existing records. [2025-10-29T17:23:09.362636] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:23:09.368883] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-29T17:23:09.378603] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-29T17:23:09.577536] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-29T17:23:09.586955] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:23:09.595094] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-29T17:23:09.595173] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-29T17:23:09.595613] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-29T17:23:09.595912] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-29T17:23:09.995612] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:23:09.995743] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-29T17:23:10.323412] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T17:23:10.793919] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-29T17:23:11.207535] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T17:23:11.513701] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T17:23:11.593568] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-29T17:23:12.393526] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-29T17:23:12.622960] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T17:23:13.193557] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-29T17:23:13.691367] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:23:13.993588] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-29T17:23:14.279625] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T17:23:14.730933] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T17:23:14.793571] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-29T17:23:15.593579] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-29T17:23:15.662416] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-29T17:23:16.393542] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-29T17:23:16.494551] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-29T17:23:17.193569] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-29T17:23:17.830492] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-29T17:23:17.934958] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-29T17:23:17.993521] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-29T17:23:18.793590] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-29T17:23:18.843695] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T17:23:19.593535] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-29T17:23:19.616173] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T17:23:20.393559] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-29T17:23:20.864877] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T17:23:21.193563] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-29T17:23:21.212810] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T17:23:21.924361] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T17:23:21.993600] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-29T17:23:22.799355] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-29T17:23:22.804476] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-29T17:23:22.809221] [INFO ] [REMOTE ] AWP: Full fetch complete (31296 records). [2025-10-29T17:23:22.809303] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-29T17:23:23.180792] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-29T17:23:23.180872] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-29T17:23:23.181279] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-29T17:23:23.181318] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-29T17:23:23.182148] [DEBUG] [LOCAL ] AWP: Trimmed 31296 records to 21334 (keeping 200 days of data) [2025-10-29T17:23:23.302040] [DEBUG] [LOCAL ] AWP: Primary data saved (21334 records). [2025-10-29T17:23:23.302217] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-29T17:23:23.302299] [INFO ] [MAIN ] Update Progress: 192/2367 symbols completed. AWP took 24.9s. Estimated remaining: 4h 24m 29s. Rate: 8.2 symbols/min [2025-10-29T17:23:23.469601] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:23:23.517299] [DEBUG] [LOCAL ] AXL: Loaded 50491 existing records from primary storage. [2025-10-29T17:23:23.517604] [INFO ] [MAIN ] AXL: Loaded 50491 existing records. [2025-10-29T17:23:23.597069] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-29T17:23:23.710509] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:23:23.717585] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-29T17:23:23.728247] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-29T17:23:23.729472] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T17:23:23.729536] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-29T17:23:23.734807] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-29T17:23:24.123825] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:23:24.393577] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-29T17:23:24.859951] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:23:25.104157] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T17:23:25.193561] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-29T17:23:25.869925] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T17:23:25.993609] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-29T17:23:26.793618] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-29T17:23:27.111790] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T17:23:27.593559] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-29T17:23:28.308940] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-29T17:23:28.391392] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-29T17:23:28.397048] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-29T17:23:29.193579] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-29T17:23:29.762278] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T17:23:29.772399] [INFO ] [REMOTE ] AWK: Full fetch complete (70897 records). [2025-10-29T17:23:29.772556] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-29T17:23:30.000131] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-29T17:23:30.175337] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-29T17:23:30.175530] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-29T17:23:30.176542] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-29T17:23:30.176621] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-29T17:23:30.192279] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-29T17:23:30.197708] [DEBUG] [LOCAL ] AWK: Trimmed 70897 records to 48231 (keeping 200 days of data) [2025-10-29T17:23:30.198632] [INFO ] [REMOTE ] AWR: Full fetch complete (32579 records). [2025-10-29T17:23:30.198999] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-29T17:23:30.803058] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-29T17:23:30.849718] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-29T17:23:30.853159] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-29T17:23:30.853811] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-29T17:23:30.873805] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-29T17:23:30.897977] [DEBUG] [LOCAL ] AWR: Trimmed 32579 records to 22408 (keeping 200 days of data) [2025-10-29T17:23:30.908168] [DEBUG] [LOCAL ] AWK: Primary data saved (48231 records). [2025-10-29T17:23:30.908294] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-29T17:23:30.908376] [INFO ] [MAIN ] Update Progress: 193/2367 symbols completed. AWK took 40.3s. Estimated remaining: 4h 24m 25s. Rate: 8.2 symbols/min [2025-10-29T17:23:31.198322] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:23:31.218813] [DEBUG] [LOCAL ] AWR: Primary data saved (22408 records). [2025-10-29T17:23:31.218941] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-29T17:23:31.219026] [INFO ] [MAIN ] Update Progress: 194/2367 symbols completed. AWR took 23.5s. Estimated remaining: 4h 22m 60s. Rate: 8.3 symbols/min [2025-10-29T17:23:31.454162] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:23:31.456891] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-29T17:23:31.469853] [DEBUG] [LOCAL ] AXR: Loaded 2773 existing records from primary storage. [2025-10-29T17:23:31.470084] [INFO ] [MAIN ] AXR: Loaded 2773 existing records. [2025-10-29T17:23:31.598604] [DEBUG] [LOCAL ] AXP: Loaded 53107 existing records from primary storage. [2025-10-29T17:23:31.598687] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-29T17:23:31.600043] [INFO ] [MAIN ] AXP: Loaded 53107 existing records. [2025-10-29T17:23:31.785531] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:23:31.791733] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-29T17:23:31.812552] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-29T17:23:31.867763] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:23:31.868191] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-29T17:23:31.868281] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-29T17:23:31.868135] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-29T17:23:31.879425] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-29T17:23:31.899502] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-29T17:23:31.910005] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-29T17:23:32.009046] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T17:23:32.410087] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-29T17:23:32.607466] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:23:32.634758] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:23:32.954849] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T17:23:33.193604] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-29T17:23:33.483351] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T17:23:33.993537] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-29T17:23:34.760089] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-29T17:23:34.793518] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-29T17:23:35.277318] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T17:23:35.593576] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-29T17:23:36.271677] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-29T17:23:36.393567] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-29T17:23:37.014701] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T17:23:37.193632] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-29T17:23:37.993537] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-29T17:23:38.104296] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-29T17:23:38.175904] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T17:23:38.462148] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-29T17:23:38.793636] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-29T17:23:39.593616] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-29T17:23:39.940387] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:23:40.394269] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-29T17:23:40.398701] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-29T17:23:41.193567] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-29T17:23:41.543929] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-29T17:23:41.998800] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-29T17:23:42.019852] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-29T17:23:42.378784] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T17:23:42.793558] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-29T17:23:43.593587] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-29T17:23:43.926305] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-29T17:23:43.960993] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:23:44.393560] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-29T17:23:45.193533] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-29T17:23:45.246723] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-29T17:23:45.252731] [INFO ] [REMOTE ] AX: Full fetch complete (41710 records). [2025-10-29T17:23:45.252859] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-29T17:23:45.571356] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-29T17:23:45.660182] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-29T17:23:45.660276] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-29T17:23:45.660774] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-29T17:23:45.660834] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-29T17:23:45.661638] [DEBUG] [LOCAL ] AX: Trimmed 41710 records to 27152 (keeping 200 days of data) [2025-10-29T17:23:45.810993] [DEBUG] [LOCAL ] AX: Primary data saved (27152 records). [2025-10-29T17:23:45.811113] [INFO ] [MAIN ] AX: Full history saved. [2025-10-29T17:23:45.811188] [INFO ] [MAIN ] Update Progress: 195/2367 symbols completed. AX took 37.2s. Estimated remaining: 4h 24m 14s. Rate: 8.2 symbols/min [2025-10-29T17:23:45.984227] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:23:45.993559] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-29T17:23:46.022791] [DEBUG] [LOCAL ] AXS: Loaded 38711 existing records from primary storage. [2025-10-29T17:23:46.023061] [INFO ] [MAIN ] AXS: Loaded 38711 existing records. [2025-10-29T17:23:46.204934] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:23:46.205184] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-29T17:23:46.205240] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-29T17:23:46.205423] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-29T17:23:46.205462] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-29T17:23:46.563176] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:23:46.793549] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-29T17:23:47.120434] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-29T17:23:47.593518] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-29T17:23:47.659536] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-29T17:23:47.946448] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-29T17:23:48.393565] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-29T17:23:49.193559] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-29T17:23:49.864809] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-29T17:23:49.993544] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-29T17:23:50.100247] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-29T17:23:50.793588] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-29T17:23:51.296117] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T17:23:51.593580] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-29T17:23:51.811632] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-29T17:23:52.393613] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-29T17:23:52.729959] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-29T17:23:53.196583] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-29T17:23:53.218242] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-29T17:23:53.993569] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-29T17:23:54.366765] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-29T17:23:54.422223] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T17:23:54.793579] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-29T17:23:55.593559] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-29T17:23:56.275363] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-29T17:23:56.393597] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-29T17:23:56.771710] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T17:23:57.193573] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-29T17:23:57.967679] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-29T17:23:57.993538] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-29T17:23:58.273498] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-29T17:23:58.793630] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-29T17:23:59.178996] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-29T17:23:59.180205] [INFO ] [REMOTE ] AXR: Full fetch complete (4241 records). [2025-10-29T17:23:59.180279] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-29T17:23:59.549283] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-29T17:23:59.549364] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-29T17:23:59.549538] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-29T17:23:59.549577] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-29T17:23:59.549958] [DEBUG] [LOCAL ] AXR: Trimmed 4241 records to 2756 (keeping 200 days of data) [2025-10-29T17:23:59.566198] [DEBUG] [LOCAL ] AXR: Primary data saved (2756 records). [2025-10-29T17:23:59.566380] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-29T17:23:59.566492] [INFO ] [MAIN ] Update Progress: 196/2367 symbols completed. AXR took 28.3s. Estimated remaining: 4h 25m 18s. Rate: 8.2 symbols/min [2025-10-29T17:23:59.598331] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-29T17:23:59.746813] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:23:59.785198] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-29T17:23:59.803229] [INFO ] [REMOTE ] AXP: Full fetch complete (77060 records). [2025-10-29T17:23:59.803404] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-29T17:24:00.080815] [DEBUG] [LOCAL ] AXTA: Loaded 52296 existing records from primary storage. [2025-10-29T17:24:00.114395] [INFO ] [MAIN ] AXTA: Loaded 52296 existing records. [2025-10-29T17:24:00.396537] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-29T17:24:00.417662] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:24:00.418497] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-29T17:24:00.418576] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-29T17:24:00.419473] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-29T17:24:00.419683] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-29T17:24:00.419938] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-29T17:24:00.419994] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-29T17:24:00.420402] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-29T17:24:00.420457] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-29T17:24:00.491414] [DEBUG] [LOCAL ] AXP: Trimmed 77060 records to 53089 (keeping 200 days of data) [2025-10-29T17:24:00.895593] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:01.040389] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T17:24:01.162506] [DEBUG] [LOCAL ] AXP: Primary data saved (53089 records). [2025-10-29T17:24:01.162673] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-29T17:24:01.162780] [INFO ] [MAIN ] Update Progress: 197/2367 symbols completed. AXP took 30.3s. Estimated remaining: 4h 24m 8s. Rate: 8.2 symbols/min [2025-10-29T17:24:01.193583] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-29T17:24:01.522590] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T17:24:01.993594] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-29T17:24:02.586271] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-29T17:24:02.598664] [INFO ] [REMOTE ] AXL: Full fetch complete (73238 records). [2025-10-29T17:24:02.598957] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-29T17:24:02.798756] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-29T17:24:03.032053] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-29T17:24:03.032516] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-29T17:24:03.033425] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-29T17:24:03.033621] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-29T17:24:03.035414] [DEBUG] [LOCAL ] AXL: Trimmed 73238 records to 50522 (keeping 200 days of data) [2025-10-29T17:24:03.065032] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T17:24:03.391715] [DEBUG] [LOCAL ] AXL: Primary data saved (50522 records). [2025-10-29T17:24:03.391911] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-29T17:24:03.392012] [INFO ] [MAIN ] Update Progress: 198/2367 symbols completed. AXL took 40.1s. Estimated remaining: 4h 23m 5s. Rate: 8.2 symbols/min [2025-10-29T17:24:03.593622] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-29T17:24:04.348771] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T17:24:04.393540] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-29T17:24:04.744176] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T17:24:05.193613] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-29T17:24:05.516506] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T17:24:05.993706] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-29T17:24:06.256408] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-29T17:24:06.793678] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-29T17:24:07.175458] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T17:24:07.593702] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-29T17:24:07.905552] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T17:24:08.393578] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-29T17:24:08.835169] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T17:24:09.193618] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-29T17:24:09.588552] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T17:24:09.597833] [INFO ] [REMOTE ] AXS: Full fetch complete (56387 records). [2025-10-29T17:24:09.597972] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-29T17:24:09.974589] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-29T17:24:09.974698] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-29T17:24:09.975326] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-29T17:24:09.975369] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-29T17:24:09.976864] [DEBUG] [LOCAL ] AXS: Trimmed 56387 records to 38765 (keeping 200 days of data) [2025-10-29T17:24:10.214228] [DEBUG] [LOCAL ] AXS: Primary data saved (38765 records). [2025-10-29T17:24:10.214358] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-29T17:24:10.215226] [INFO ] [MAIN ] Update Progress: 199/2367 symbols completed. AXS took 24.4s. Estimated remaining: 4h 22m 53s. Rate: 8.2 symbols/min [2025-10-29T17:24:10.491112] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:24:10.502002] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-29T17:24:11.691031] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T17:24:11.701557] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-29T17:24:13.008215] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T17:24:13.019435] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-29T17:24:14.228244] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T17:24:14.239415] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-29T17:24:15.493518] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T17:24:15.504550] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-29T17:24:17.077300] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-29T17:24:17.088798] [INFO ] [REMOTE ] AXTA: Full fetch complete (75546 records). [2025-10-29T17:24:17.088963] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-29T17:24:17.482371] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-29T17:24:17.482447] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-29T17:24:17.483251] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-29T17:24:17.483312] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-29T17:24:17.484711] [DEBUG] [LOCAL ] AXTA: Trimmed 75546 records to 52301 (keeping 200 days of data) [2025-10-29T17:24:17.782291] [DEBUG] [LOCAL ] AXTA: Primary data saved (52301 records). [2025-10-29T17:24:17.782432] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-29T17:24:17.783204] [INFO ] [MAIN ] Update Progress: 200/2367 symbols completed. AXTA took 18.2s. Estimated remaining: 4h 22m 49s. Rate: 8.2 symbols/min [2025-10-29T17:24:18.426738] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:24:18.466814] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:24:18.468750] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-29T17:24:18.527524] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-29T17:24:18.525160] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:24:18.550170] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:24:18.545636] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-29T17:24:18.550791] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-29T17:24:18.550885] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-29T17:24:18.553837] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-29T17:24:18.651393] [DEBUG] [LOCAL ] AZO: Loaded 10576 existing records from primary storage. [2025-10-29T17:24:18.663221] [INFO ] [MAIN ] AZO: Loaded 10576 existing records. [2025-10-29T17:24:18.752142] [DEBUG] [LOCAL ] AYI: Loaded 23511 existing records from primary storage. [2025-10-29T17:24:18.808400] [INFO ] [MAIN ] AYI: Loaded 23511 existing records. [2025-10-29T17:24:18.882698] [DEBUG] [LOCAL ] AZZ: Loaded 22835 existing records from primary storage. [2025-10-29T17:24:18.938160] [INFO ] [MAIN ] AZZ: Loaded 22835 existing records. [2025-10-29T17:24:19.193289] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:24:19.264415] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-29T17:24:19.278427] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-29T17:24:19.395087] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-29T17:24:19.411968] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-29T17:24:19.415248] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:24:19.476338] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-29T17:24:19.502397] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-29T17:24:19.576616] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:24:19.598365] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-29T17:24:19.612976] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-29T17:24:19.631547] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:19.613091] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-29T17:24:19.641891] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-29T17:24:19.631700] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-29T17:24:19.641805] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-29T17:24:19.652902] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-29T17:24:20.498850] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:20.528164] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-29T17:24:20.569969] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:20.586435] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-29T17:24:20.644606] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:20.645121] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-29T17:24:20.687586] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T17:24:20.693367] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-29T17:24:20.879596] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:24:20.879859] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-29T17:24:20.879945] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:24:20.880017] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-29T17:24:20.880055] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:24:20.880094] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-29T17:24:20.880153] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-29T17:24:20.880188] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-29T17:24:20.880228] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-29T17:24:20.880275] [INFO ] [MAIN ] Update Progress: 201/2367 symbols completed. B took 3.1s. Estimated remaining: 4h 21m 56s. Rate: 8.3 symbols/min [2025-10-29T17:24:21.063324] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:24:21.127315] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-29T17:24:21.127692] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-29T17:24:21.314973] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:24:21.315872] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-29T17:24:21.318333] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-29T17:24:21.318900] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-29T17:24:21.319753] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-29T17:24:21.320204] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-29T17:24:21.320262] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-29T17:24:21.614335] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T17:24:21.622761] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-29T17:24:21.704320] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:21.704836] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-29T17:24:21.742085] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T17:24:21.748286] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-29T17:24:21.774373] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-29T17:24:21.776540] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-29T17:24:22.368905] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T17:24:22.373431] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-29T17:24:22.491947] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T17:24:22.507421] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-29T17:24:22.793552] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-29T17:24:23.042716] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T17:24:23.418361] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-29T17:24:23.593627] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-29T17:24:23.714373] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T17:24:24.348725] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-29T17:24:24.393581] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-29T17:24:25.136679] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-29T17:24:25.193552] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-29T17:24:25.993558] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-29T17:24:26.600626] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T17:24:26.793522] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-29T17:24:26.902706] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-29T17:24:27.593526] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-29T17:24:27.670627] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T17:24:28.278844] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-29T17:24:28.393539] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-29T17:24:29.193607] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-29T17:24:29.916959] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T17:24:29.999441] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-29T17:24:30.020231] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-29T17:24:30.794669] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-29T17:24:30.799130] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-29T17:24:31.508851] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-29T17:24:31.593540] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-29T17:24:32.238273] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-29T17:24:32.393560] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-29T17:24:33.193541] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-29T17:24:33.339885] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-29T17:24:33.769202] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-29T17:24:33.993551] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-29T17:24:34.580421] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T17:24:34.793568] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-29T17:24:35.593565] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-29T17:24:35.674757] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T17:24:36.393582] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-29T17:24:37.033688] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-29T17:24:37.193618] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-29T17:24:37.513818] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-29T17:24:37.947873] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-29T17:24:37.950715] [INFO ] [REMOTE ] AZO: Full fetch complete (16048 records). [2025-10-29T17:24:37.950819] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-29T17:24:37.998796] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-29T17:24:38.328913] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-29T17:24:38.329007] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-29T17:24:38.329321] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-29T17:24:38.329380] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-29T17:24:38.329944] [DEBUG] [LOCAL ] AZO: Trimmed 16048 records to 10599 (keeping 200 days of data) [2025-10-29T17:24:38.394261] [DEBUG] [LOCAL ] AZO: Primary data saved (10599 records). [2025-10-29T17:24:38.394395] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-29T17:24:38.394472] [INFO ] [MAIN ] Update Progress: 202/2367 symbols completed. AZO took 20.6s. Estimated remaining: 4h 23m 39s. Rate: 8.2 symbols/min [2025-10-29T17:24:38.559565] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:24:38.611425] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-29T17:24:38.611766] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-29T17:24:38.801697] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-29T17:24:38.806339] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:24:38.806521] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-29T17:24:38.807287] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-29T17:24:38.807490] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-29T17:24:38.807531] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-29T17:24:39.160411] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:39.593701] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-29T17:24:39.916542] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T17:24:40.200170] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-29T17:24:40.393685] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-29T17:24:41.193600] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-29T17:24:41.218211] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T17:24:41.509220] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-29T17:24:41.993563] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-29T17:24:42.018298] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T17:24:42.793635] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-29T17:24:43.454683] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T17:24:43.593566] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-29T17:24:44.038909] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-29T17:24:44.393576] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-29T17:24:44.574637] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T17:24:44.580892] [INFO ] [REMOTE ] AZZ: Full fetch complete (32143 records). [2025-10-29T17:24:44.581023] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-29T17:24:44.992178] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-29T17:24:44.992270] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-29T17:24:44.992931] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-29T17:24:44.992997] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-29T17:24:44.994141] [DEBUG] [LOCAL ] AZZ: Trimmed 32143 records to 22966 (keeping 200 days of data) [2025-10-29T17:24:45.147950] [DEBUG] [LOCAL ] AZZ: Primary data saved (22966 records). [2025-10-29T17:24:45.148084] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-29T17:24:45.148188] [INFO ] [MAIN ] Update Progress: 203/2367 symbols completed. AZZ took 27.4s. Estimated remaining: 4h 23m 26s. Rate: 8.2 symbols/min [2025-10-29T17:24:45.198720] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-29T17:24:45.331938] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:24:45.390168] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-29T17:24:45.390588] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-29T17:24:45.580088] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:24:45.580365] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-29T17:24:45.580436] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-29T17:24:45.587418] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-29T17:24:45.599484] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-29T17:24:45.634984] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T17:24:45.717914] [INFO ] [REMOTE ] AYI: Full fetch complete (36161 records). [2025-10-29T17:24:45.733817] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-29T17:24:45.994716] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-29T17:24:46.307792] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:46.404080] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-29T17:24:46.404155] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-29T17:24:46.404578] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-29T17:24:46.404617] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-29T17:24:46.405447] [DEBUG] [LOCAL ] AYI: Trimmed 36161 records to 23371 (keeping 200 days of data) [2025-10-29T17:24:46.548957] [DEBUG] [LOCAL ] AYI: Primary data saved (23371 records). [2025-10-29T17:24:46.549081] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-29T17:24:46.549156] [INFO ] [MAIN ] Update Progress: 204/2367 symbols completed. AYI took 28.8s. Estimated remaining: 4h 22m 16s. Rate: 8.2 symbols/min [2025-10-29T17:24:46.719771] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:24:46.769088] [DEBUG] [LOCAL ] BAH: Loaded 51644 existing records from primary storage. [2025-10-29T17:24:46.769398] [INFO ] [MAIN ] BAH: Loaded 51644 existing records. [2025-10-29T17:24:46.801252] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-29T17:24:46.959851] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:24:46.960142] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-29T17:24:46.960250] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-29T17:24:46.960903] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-29T17:24:46.960985] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-29T17:24:47.365177] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-29T17:24:47.380165] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:24:47.593563] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-29T17:24:48.109960] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-29T17:24:48.393595] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-29T17:24:48.672560] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-29T17:24:49.193605] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-29T17:24:49.522414] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-29T17:24:49.993621] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-29T17:24:50.352406] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-29T17:24:50.793583] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-29T17:24:50.882722] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-29T17:24:51.194879] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T17:24:51.593573] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-29T17:24:52.393609] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-29T17:24:52.819757] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-29T17:24:53.193583] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-29T17:24:53.323852] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-29T17:24:53.993609] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-29T17:24:54.236079] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-29T17:24:54.793687] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-29T17:24:55.041762] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-29T17:24:55.316887] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-29T17:24:55.593552] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-29T17:24:56.393630] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-29T17:24:56.744453] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-29T17:24:56.793314] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T17:24:57.193591] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-29T17:24:57.993701] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-29T17:24:58.204771] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-29T17:24:58.793743] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-29T17:24:59.290997] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T17:24:59.442369] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-29T17:24:59.485610] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-29T17:24:59.497219] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-29T17:24:59.497389] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-29T17:24:59.598691] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-29T17:24:59.896111] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-29T17:24:59.896202] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-29T17:24:59.897083] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-29T17:24:59.897176] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-29T17:24:59.898776] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-29T17:25:00.228377] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-29T17:25:00.228513] [INFO ] [MAIN ] BA: Full history saved. [2025-10-29T17:25:00.228592] [INFO ] [MAIN ] Update Progress: 205/2367 symbols completed. BA took 39.3s. Estimated remaining: 4h 23m 16s. Rate: 8.2 symbols/min [2025-10-29T17:25:00.398217] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-29T17:25:00.399745] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:25:00.437442] [DEBUG] [LOCAL ] BAK: Loaded 39107 existing records from primary storage. [2025-10-29T17:25:00.437766] [INFO ] [MAIN ] BAK: Loaded 39107 existing records. [2025-10-29T17:25:00.650664] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:25:00.650907] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-29T17:25:00.650956] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-29T17:25:00.651234] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-29T17:25:00.651294] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-29T17:25:01.017148] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:25:01.193622] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-29T17:25:01.801857] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T17:25:01.881983] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-29T17:25:01.993698] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-29T17:25:02.793697] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-29T17:25:03.166637] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T17:25:03.302854] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-29T17:25:03.593612] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-29T17:25:04.110049] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T17:25:04.393550] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-29T17:25:04.605819] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T17:25:05.193608] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-29T17:25:05.850991] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T17:25:05.993563] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-29T17:25:06.793596] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-29T17:25:07.284100] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-29T17:25:07.327489] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T17:25:07.593591] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-29T17:25:08.393575] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-29T17:25:08.649434] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-29T17:25:08.974009] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:25:09.193638] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-29T17:25:09.993581] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-29T17:25:10.785180] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T17:25:10.795691] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-29T17:25:10.797698] [INFO ] [REMOTE ] BAH: Full fetch complete (75303 records). [2025-10-29T17:25:10.797868] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-29T17:25:11.241060] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.85 seconds). [2025-10-29T17:25:11.239561] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-29T17:25:11.241250] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-29T17:25:11.252730] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-29T17:25:11.252997] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-29T17:25:11.272111] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-29T17:25:11.274757] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-29T17:25:11.275967] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T17:25:11.284128] [DEBUG] [LOCAL ] BAH: Trimmed 75303 records to 51647 (keeping 200 days of data) [2025-10-29T17:25:11.594474] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-29T17:25:11.978361] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-29T17:25:11.978515] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-29T17:25:11.979447] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-29T17:25:12.009097] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-29T17:25:12.044279] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-29T17:25:12.054778] [DEBUG] [LOCAL ] BAH: Primary data saved (51647 records). [2025-10-29T17:25:12.054917] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-29T17:25:12.055021] [INFO ] [MAIN ] Update Progress: 206/2367 symbols completed. BAH took 25.5s. Estimated remaining: 4h 23m 56s. Rate: 8.2 symbols/min [2025-10-29T17:25:12.367159] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:25:12.544285] [DEBUG] [LOCAL ] BALL: Loaded 51894 existing records from primary storage. [2025-10-29T17:25:12.631127] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-29T17:25:12.629785] [INFO ] [MAIN ] BALL: Loaded 51894 existing records. [2025-10-29T17:25:12.631383] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-29T17:25:12.636761] [INFO ] [MAIN ] Update Progress: 207/2367 symbols completed. BABA took 34.2s. Estimated remaining: 4h 22m 39s. Rate: 8.2 symbols/min [2025-10-29T17:25:12.992151] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:25:12.997085] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-29T17:25:13.019280] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:25:12.997659] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-29T17:25:13.019740] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-29T17:25:13.020169] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-29T17:25:13.020553] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-29T17:25:13.020376] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-29T17:25:13.030161] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-29T17:25:13.042857] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-29T17:25:13.046052] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-29T17:25:13.045935] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-29T17:25:13.114926] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-29T17:25:13.211764] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-29T17:25:13.499918] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-29T17:25:13.654922] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-29T17:25:13.840577] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:25:13.897804] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:25:13.993575] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-29T17:25:14.376836] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T17:25:14.793569] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-29T17:25:15.143040] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T17:25:15.593623] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-29T17:25:15.693536] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-29T17:25:15.790526] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T17:25:16.393565] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-29T17:25:17.037957] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T17:25:17.193602] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-29T17:25:17.382300] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T17:25:17.993560] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-29T17:25:18.446149] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T17:25:18.793566] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-29T17:25:19.125377] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T17:25:19.593577] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-29T17:25:20.016445] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T17:25:20.393613] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-29T17:25:20.675429] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T17:25:21.193593] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-29T17:25:21.634792] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:25:21.650355] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-29T17:25:21.993570] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-29T17:25:22.460851] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-29T17:25:22.793531] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-29T17:25:23.290902] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-29T17:25:23.593589] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-29T17:25:24.393570] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-29T17:25:24.725183] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T17:25:25.193529] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-29T17:25:25.993557] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-29T17:25:26.212634] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-29T17:25:26.596833] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T17:25:26.604993] [INFO ] [REMOTE ] BAK: Full fetch complete (56771 records). [2025-10-29T17:25:26.605097] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-29T17:25:26.798679] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-29T17:25:26.991020] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-29T17:25:26.991099] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-29T17:25:26.991720] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-29T17:25:26.991782] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-29T17:25:26.992941] [DEBUG] [LOCAL ] BAK: Trimmed 56771 records to 39060 (keeping 200 days of data) [2025-10-29T17:25:27.202118] [DEBUG] [LOCAL ] BAK: Primary data saved (39060 records). [2025-10-29T17:25:27.202293] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-29T17:25:27.203016] [INFO ] [MAIN ] Update Progress: 208/2367 symbols completed. BAK took 27.0s. Estimated remaining: 4h 23m 47s. Rate: 8.2 symbols/min [2025-10-29T17:25:27.374038] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:25:27.374225] [DEBUG] [LOCAL ] BAM: No existing data file found in primary storage. [2025-10-29T17:25:27.374336] [WARN ] [MAIN ] BAM: No existing data found, performing full refresh instead. [2025-10-29T17:25:27.374509] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-29T17:25:27.374615] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-29T17:25:27.374717] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-10-29T17:25:27.374816] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-29T17:25:27.587411] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-29T17:25:27.603537] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-29T17:25:27.773246] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:25:28.324275] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T17:25:28.393567] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-29T17:25:29.008238] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-29T17:25:29.019602] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-29T17:25:29.019835] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-29T17:25:29.194425] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-29T17:25:29.420285] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-29T17:25:29.420360] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-29T17:25:29.421145] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-29T17:25:29.421207] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-29T17:25:29.422574] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-29T17:25:29.749861] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-29T17:25:29.750098] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-29T17:25:29.750997] [INFO ] [MAIN ] Update Progress: 209/2367 symbols completed. BAC took 44.6s. Estimated remaining: 4h 22m 50s. Rate: 8.2 symbols/min [2025-10-29T17:25:29.884809] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T17:25:29.971872] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:25:30.001635] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-29T17:25:30.031389] [DEBUG] [LOCAL ] BANC: Loaded 51376 existing records from primary storage. [2025-10-29T17:25:30.031763] [INFO ] [MAIN ] BANC: Loaded 51376 existing records. [2025-10-29T17:25:30.238691] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:25:30.238891] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-29T17:25:30.238939] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-29T17:25:30.239350] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-29T17:25:30.239390] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-29T17:25:30.618800] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:25:30.650201] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-29T17:25:30.793574] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-29T17:25:31.281242] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T17:25:31.593587] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-29T17:25:32.018926] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T17:25:32.393708] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-29T17:25:32.835063] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T17:25:33.193679] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-29T17:25:33.501574] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:25:33.993575] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-29T17:25:34.346316] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T17:25:34.484758] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-29T17:25:34.793604] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-29T17:25:35.291045] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-29T17:25:35.593613] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-29T17:25:35.958897] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-29T17:25:36.393588] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-29T17:25:37.193564] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-29T17:25:37.692610] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T17:25:37.738891] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T17:25:37.993600] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-29T17:25:38.793566] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-29T17:25:39.289934] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T17:25:39.593540] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-29T17:25:40.042754] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-29T17:25:40.393584] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-29T17:25:40.919478] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T17:25:41.193582] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-29T17:25:41.299959] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T17:25:41.304345] [INFO ] [REMOTE ] BALY: Full fetch complete (15971 records). [2025-10-29T17:25:41.304433] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-29T17:25:41.495048] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-29T17:25:41.495336] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:25:41.495411] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:25:41.495460] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-29T17:25:41.495516] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-29T17:25:41.495551] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-29T17:25:41.495590] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-29T17:25:41.495668] [INFO ] [MAIN ] Update Progress: 210/2367 symbols completed. BALY took 28.9s. Estimated remaining: 4h 23m 28s. Rate: 8.2 symbols/min [2025-10-29T17:25:41.663808] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:25:41.687365] [DEBUG] [LOCAL ] BAP: Loaded 24953 existing records from primary storage. [2025-10-29T17:25:41.687606] [INFO ] [MAIN ] BAP: Loaded 24953 existing records. [2025-10-29T17:25:41.878968] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:25:41.879163] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-29T17:25:41.879229] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-29T17:25:41.879504] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-29T17:25:41.879567] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-29T17:25:41.998725] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-29T17:25:42.257386] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:25:42.415430] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T17:25:42.793586] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-29T17:25:43.326677] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:25:43.593563] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-29T17:25:44.022164] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T17:25:44.393613] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-29T17:25:45.058747] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-29T17:25:45.070404] [INFO ] [REMOTE ] BALL: Full fetch complete (75613 records). [2025-10-29T17:25:45.070565] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-29T17:25:45.198771] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-29T17:25:45.477795] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-29T17:25:45.477880] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-29T17:25:45.478714] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-29T17:25:45.478778] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-29T17:25:45.480254] [DEBUG] [LOCAL ] BALL: Trimmed 75613 records to 51890 (keeping 200 days of data) [2025-10-29T17:25:45.795199] [DEBUG] [LOCAL ] BALL: Primary data saved (51890 records). [2025-10-29T17:25:45.795512] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-29T17:25:45.795604] [INFO ] [MAIN ] Update Progress: 211/2367 symbols completed. BALL took 33.7s. Estimated remaining: 4h 22m 50s. Rate: 8.2 symbols/min [2025-10-29T17:25:45.942684] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T17:25:45.996326] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-29T17:25:46.030159] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:25:46.065242] [DEBUG] [LOCAL ] BARK: Loaded 38013 existing records from primary storage. [2025-10-29T17:25:46.065523] [INFO ] [MAIN ] BARK: Loaded 38013 existing records. [2025-10-29T17:25:46.259024] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:25:46.259326] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-29T17:25:46.259402] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-29T17:25:46.259708] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-29T17:25:46.259779] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-29T17:25:46.361073] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T17:25:46.637402] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:25:46.793586] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-29T17:25:47.215693] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T17:25:47.593707] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-29T17:25:47.847835] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T17:25:48.393548] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-29T17:25:48.477989] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T17:25:49.193548] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-29T17:25:49.604745] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T17:25:49.993534] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-29T17:25:50.082407] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T17:25:50.793548] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-29T17:25:51.090920] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T17:25:51.593527] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-29T17:25:51.688041] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T17:25:52.393535] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-29T17:25:52.803257] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T17:25:53.193537] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-29T17:25:53.894534] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T17:25:53.906034] [INFO ] [REMOTE ] BANC: Full fetch complete (74674 records). [2025-10-29T17:25:53.906160] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-29T17:25:53.998824] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-29T17:25:54.303411] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-29T17:25:54.303485] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-29T17:25:54.304243] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-29T17:25:54.304305] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-29T17:25:54.305673] [DEBUG] [LOCAL ] BANC: Trimmed 74674 records to 51377 (keeping 200 days of data) [2025-10-29T17:25:54.587226] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T17:25:54.663835] [DEBUG] [LOCAL ] BANC: Primary data saved (51377 records). [2025-10-29T17:25:54.663924] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-29T17:25:54.663994] [INFO ] [MAIN ] Update Progress: 212/2367 symbols completed. BANC took 24.9s. Estimated remaining: 4h 22m 58s. Rate: 8.2 symbols/min [2025-10-29T17:25:54.804783] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-29T17:25:54.836123] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:25:54.886985] [DEBUG] [LOCAL ] BAX: Loaded 53536 existing records from primary storage. [2025-10-29T17:25:54.887297] [INFO ] [MAIN ] BAX: Loaded 53536 existing records. [2025-10-29T17:25:55.008059] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T17:25:55.096063] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:25:55.096310] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-29T17:25:55.096357] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-29T17:25:55.096551] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-29T17:25:55.096605] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-29T17:25:55.483210] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:25:55.593556] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-29T17:25:55.965337] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T17:25:56.393563] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-29T17:25:56.884519] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T17:25:57.193537] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-29T17:25:57.210922] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T17:25:57.993587] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-29T17:25:58.538356] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T17:25:58.793520] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-29T17:25:58.894121] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T17:25:59.599126] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-29T17:25:59.607544] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T17:26:00.393540] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-29T17:26:00.612296] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T17:26:01.193526] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-29T17:26:01.285610] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T17:26:01.993587] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-29T17:26:02.685298] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-29T17:26:02.793572] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-29T17:26:03.077171] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-29T17:26:03.593556] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-29T17:26:04.081448] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T17:26:04.393616] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-29T17:26:04.780813] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T17:26:05.193560] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-29T17:26:05.806853] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T17:26:05.993567] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-29T17:26:06.011237] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T17:26:06.793576] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-29T17:26:07.099176] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T17:26:07.593577] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-29T17:26:08.294999] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T17:26:08.306227] [INFO ] [REMOTE ] BAM: Full fetch complete (75328 records). [2025-10-29T17:26:08.306375] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-29T17:26:08.402359] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-29T17:26:08.708085] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-29T17:26:08.708162] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-29T17:26:08.708983] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-29T17:26:08.709046] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-29T17:26:08.710473] [DEBUG] [LOCAL ] BAM: Trimmed 75328 records to 52064 (keeping 200 days of data) [2025-10-29T17:26:09.049091] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T17:26:09.073253] [DEBUG] [LOCAL ] BAM: Primary data saved (52064 records). [2025-10-29T17:26:09.073613] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-29T17:26:09.073745] [INFO ] [MAIN ] Update Progress: 213/2367 symbols completed. BAM took 41.9s. Estimated remaining: 4h 24m 3s. Rate: 8.2 symbols/min [2025-10-29T17:26:09.195867] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-29T17:26:09.246925] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:09.299115] [DEBUG] [LOCAL ] BB: Loaded 52857 existing records from primary storage. [2025-10-29T17:26:09.299439] [INFO ] [MAIN ] BB: Loaded 52857 existing records. [2025-10-29T17:26:09.482600] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:09.482888] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-29T17:26:09.483018] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-29T17:26:09.490150] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-29T17:26:09.501353] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-29T17:26:09.507760] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T17:26:09.885327] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:09.993557] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-29T17:26:10.409117] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T17:26:10.414171] [INFO ] [REMOTE ] BAP: Full fetch complete (37106 records). [2025-10-29T17:26:10.414255] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-29T17:26:10.782820] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-29T17:26:10.782905] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-29T17:26:10.783409] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-29T17:26:10.783451] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-29T17:26:10.784353] [DEBUG] [LOCAL ] BAP: Trimmed 37106 records to 24995 (keeping 200 days of data) [2025-10-29T17:26:10.834324] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-29T17:26:10.937774] [DEBUG] [LOCAL ] BAP: Primary data saved (24995 records). [2025-10-29T17:26:10.937955] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-29T17:26:10.938068] [INFO ] [MAIN ] Update Progress: 214/2367 symbols completed. BAP took 29.4s. Estimated remaining: 4h 23m 0s. Rate: 8.2 symbols/min [2025-10-29T17:26:11.131747] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:11.135898] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T17:26:11.188464] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-29T17:26:11.188789] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-29T17:26:11.362626] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:11.362831] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-29T17:26:11.362877] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-29T17:26:11.363053] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-29T17:26:11.363089] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-29T17:26:11.598745] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-29T17:26:11.749809] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:12.321907] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-29T17:26:12.393567] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-29T17:26:12.751804] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T17:26:12.759964] [INFO ] [REMOTE ] BARK: Full fetch complete (55846 records). [2025-10-29T17:26:12.760096] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-29T17:26:13.145318] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-29T17:26:13.145403] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-29T17:26:13.146100] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-29T17:26:13.146168] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-29T17:26:13.147378] [DEBUG] [LOCAL ] BARK: Trimmed 55846 records to 38119 (keeping 200 days of data) [2025-10-29T17:26:13.199626] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-29T17:26:13.365389] [DEBUG] [LOCAL ] BARK: Primary data saved (38119 records). [2025-10-29T17:26:13.365587] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-29T17:26:13.365736] [INFO ] [MAIN ] Update Progress: 215/2367 symbols completed. BARK took 27.6s. Estimated remaining: 4h 22m 4s. Rate: 8.2 symbols/min [2025-10-29T17:26:13.543359] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:13.582606] [DEBUG] [LOCAL ] BBAR: Loaded 42680 existing records from primary storage. [2025-10-29T17:26:13.582905] [INFO ] [MAIN ] BBAR: Loaded 42680 existing records. [2025-10-29T17:26:13.768567] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:13.768868] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-29T17:26:13.768937] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-29T17:26:13.769121] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-29T17:26:13.769176] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-29T17:26:14.000200] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-29T17:26:14.159394] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:14.198542] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-29T17:26:14.793604] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-29T17:26:15.281098] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-29T17:26:15.513089] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-29T17:26:15.593523] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-29T17:26:16.117903] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T17:26:16.393564] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-29T17:26:16.885477] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T17:26:17.193591] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-29T17:26:17.964962] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-29T17:26:17.993526] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-29T17:26:18.463412] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T17:26:18.793534] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-29T17:26:19.373012] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T17:26:19.593626] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-29T17:26:20.040414] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:26:20.393563] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-29T17:26:20.452136] [DEBUG] [REMOTE ] BBAI: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-29T17:26:20.452627] [WARN ] [REMOTE ] BBAI: No data returned for month 2025-02 [2025-10-29T17:26:20.452806] [FATAL] [REMOTE ] BBAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:26:20.452984] [FATAL] [MAIN ] BBAI: Failed to fetch primary data. [2025-10-29T17:26:20.453060] [WARN ] [MAIN ] BBAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:26:20.453134] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-29T17:26:20.453200] [DEBUG] [LOCAL ] BBAI: No primary data file found to delete. [2025-10-29T17:26:20.453237] [INFO ] [LOCAL ] BBAI: Starting deletion of derivative data. [2025-10-29T17:26:20.453394] [DEBUG] [LOCAL ] BBAI: Deleted derivative data file. [2025-10-29T17:26:20.453460] [INFO ] [MAIN ] Update Progress: 216/2367 symbols completed. BBAI took 9.5s. Estimated remaining: 4h 21m 54s. Rate: 8.2 symbols/min [2025-10-29T17:26:20.636319] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:20.662728] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T17:26:20.714030] [DEBUG] [LOCAL ] BBD: Loaded 53278 existing records from primary storage. [2025-10-29T17:26:20.714380] [INFO ] [MAIN ] BBD: Loaded 53278 existing records. [2025-10-29T17:26:20.895369] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:20.895616] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-29T17:26:20.895701] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-29T17:26:20.895990] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-29T17:26:20.896047] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-29T17:26:21.206993] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-29T17:26:21.247262] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:21.993555] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-29T17:26:22.645487] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-29T17:26:22.793551] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-29T17:26:23.351626] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T17:26:23.593568] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-29T17:26:23.835887] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T17:26:24.393566] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-29T17:26:24.932390] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-29T17:26:25.193558] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-29T17:26:25.992931] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-29T17:26:25.997116] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-29T17:26:26.433924] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:26:26.793553] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-29T17:26:27.067200] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T17:26:27.593580] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-29T17:26:27.858963] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-29T17:26:28.393615] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-29T17:26:28.765541] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T17:26:29.193585] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-29T17:26:30.000773] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-29T17:26:30.006960] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-29T17:26:30.019153] [INFO ] [REMOTE ] BAX: Full fetch complete (77622 records). [2025-10-29T17:26:30.019274] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-29T17:26:30.418745] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-29T17:26:30.418850] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-29T17:26:30.419683] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-29T17:26:30.419749] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-29T17:26:30.421267] [DEBUG] [LOCAL ] BAX: Trimmed 77622 records to 53536 (keeping 200 days of data) [2025-10-29T17:26:30.694877] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-29T17:26:30.784271] [DEBUG] [LOCAL ] BAX: Primary data saved (53536 records). [2025-10-29T17:26:30.784404] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-29T17:26:30.785376] [INFO ] [MAIN ] Update Progress: 217/2367 symbols completed. BAX took 36.1s. Estimated remaining: 4h 22m 17s. Rate: 8.2 symbols/min [2025-10-29T17:26:30.798616] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-29T17:26:30.958926] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:30.990500] [DEBUG] [LOCAL ] BBDC: Loaded 32318 existing records from primary storage. [2025-10-29T17:26:30.990796] [INFO ] [MAIN ] BBDC: Loaded 32318 existing records. [2025-10-29T17:26:31.167563] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:31.167802] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-29T17:26:31.167879] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-29T17:26:31.168179] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-29T17:26:31.168223] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-29T17:26:31.516246] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:31.593529] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-29T17:26:31.737305] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T17:26:32.014731] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T17:26:32.393553] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-29T17:26:32.469261] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T17:26:33.193565] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-29T17:26:33.683258] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T17:26:33.993595] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-29T17:26:34.227224] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T17:26:34.793605] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-29T17:26:35.600778] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-29T17:26:35.606412] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-29T17:26:35.632815] [INFO ] [REMOTE ] BB: Full fetch complete (76566 records). [2025-10-29T17:26:35.635503] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-29T17:26:35.636145] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T17:26:35.643932] [FATAL] [VALIDATOR ] BB: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:26:35.644055] [FATAL] [MAIN ] BB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:26:35.644116] [WARN ] [MAIN ] BB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:26:35.644183] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-29T17:26:35.644245] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-10-29T17:26:35.644280] [INFO ] [LOCAL ] BB: Starting deletion of derivative data. [2025-10-29T17:26:35.644453] [DEBUG] [LOCAL ] BB: Deleted derivative data file. [2025-10-29T17:26:35.645248] [INFO ] [MAIN ] Update Progress: 218/2367 symbols completed. BB took 26.6s. Estimated remaining: 4h 21m 45s. Rate: 8.2 symbols/min [2025-10-29T17:26:35.831469] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:35.838809] [DEBUG] [LOCAL ] BBDO: Loaded 4822 existing records from primary storage. [2025-10-29T17:26:35.839016] [INFO ] [MAIN ] BBDO: Loaded 4822 existing records. [2025-10-29T17:26:36.032483] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:36.032723] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-29T17:26:36.032781] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-29T17:26:36.032916] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-29T17:26:36.032953] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-29T17:26:36.398776] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-29T17:26:36.402977] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:36.894675] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T17:26:37.193547] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-29T17:26:37.450306] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T17:26:37.993696] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-29T17:26:38.292729] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T17:26:38.793571] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-29T17:26:39.225540] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T17:26:39.593564] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-29T17:26:39.828358] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T17:26:40.099564] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-29T17:26:40.393633] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-29T17:26:41.193553] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-29T17:26:41.550865] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T17:26:41.993587] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-29T17:26:42.396368] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-29T17:26:42.516273] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T17:26:42.793544] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-29T17:26:43.243765] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T17:26:43.593557] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-29T17:26:44.107703] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T17:26:44.393611] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-29T17:26:45.193592] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-29T17:26:45.423497] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T17:26:45.993569] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-29T17:26:46.771804] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-29T17:26:46.793521] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-29T17:26:47.366299] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T17:26:47.375977] [INFO ] [REMOTE ] BBAR: Full fetch complete (61309 records). [2025-10-29T17:26:47.376081] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-29T17:26:47.599585] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-29T17:26:47.772274] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-29T17:26:47.772362] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-29T17:26:47.773059] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-29T17:26:47.773125] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-29T17:26:47.774403] [DEBUG] [LOCAL ] BBAR: Trimmed 61309 records to 42713 (keeping 200 days of data) [2025-10-29T17:26:48.030242] [DEBUG] [LOCAL ] BBAR: Primary data saved (42713 records). [2025-10-29T17:26:48.030400] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-29T17:26:48.030484] [INFO ] [MAIN ] Update Progress: 219/2367 symbols completed. BBAR took 34.7s. Estimated remaining: 4h 22m 28s. Rate: 8.2 symbols/min [2025-10-29T17:26:48.215103] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:48.232315] [DEBUG] [LOCAL ] BBN: Loaded 17318 existing records from primary storage. [2025-10-29T17:26:48.232573] [INFO ] [MAIN ] BBN: Loaded 17318 existing records. [2025-10-29T17:26:48.407685] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-29T17:26:48.421773] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:48.422562] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-29T17:26:48.423938] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-29T17:26:48.424265] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-29T17:26:48.424419] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-29T17:26:48.617247] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-29T17:26:48.701739] [INFO ] [REMOTE ] BBD: Full fetch complete (77272 records). [2025-10-29T17:26:48.785065] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-29T17:26:48.829835] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T17:26:48.935727] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:48.907318] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T17:26:49.202549] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-29T17:26:49.316952] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-29T17:26:49.317056] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-29T17:26:49.318018] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-29T17:26:49.318085] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-29T17:26:49.319566] [DEBUG] [LOCAL ] BBD: Trimmed 77272 records to 53282 (keeping 200 days of data) [2025-10-29T17:26:49.645049] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-29T17:26:49.665721] [DEBUG] [LOCAL ] BBD: Primary data saved (53282 records). [2025-10-29T17:26:49.665858] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-29T17:26:49.665963] [INFO ] [MAIN ] Update Progress: 220/2367 symbols completed. BBD took 29.2s. Estimated remaining: 4h 21m 25s. Rate: 8.2 symbols/min [2025-10-29T17:26:49.861678] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:49.861867] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-29T17:26:49.861905] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-29T17:26:49.862012] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-29T17:26:49.862052] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-29T17:26:49.862093] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-29T17:26:49.862125] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-29T17:26:49.998818] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-29T17:26:50.237038] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:50.793614] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-29T17:26:50.923996] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-29T17:26:51.217767] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-29T17:26:51.593572] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-29T17:26:51.926737] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-29T17:26:52.393592] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-29T17:26:53.194671] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-29T17:26:53.200282] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T17:26:53.926757] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-29T17:26:53.993574] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-29T17:26:54.793615] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-29T17:26:54.877037] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-29T17:26:55.156108] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-29T17:26:55.593612] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-29T17:26:55.735112] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:26:55.735364] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-29T17:26:55.735454] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:26:55.735524] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-29T17:26:55.735590] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:26:55.735693] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-29T17:26:55.735768] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-29T17:26:55.735808] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-29T17:26:55.735854] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-29T17:26:55.735903] [INFO ] [MAIN ] Update Progress: 221/2367 symbols completed. BBT took 6.1s. Estimated remaining: 4h 21m 6s. Rate: 8.2 symbols/min [2025-10-29T17:26:55.904170] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:55.912281] [DEBUG] [LOCAL ] BBU: Loaded 5867 existing records from primary storage. [2025-10-29T17:26:55.912488] [INFO ] [MAIN ] BBU: Loaded 5867 existing records. [2025-10-29T17:26:56.090272] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:56.090667] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-29T17:26:56.090729] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-29T17:26:56.090978] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-29T17:26:56.091036] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-29T17:26:56.403764] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-29T17:26:56.444481] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:56.974485] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-29T17:26:56.977619] [INFO ] [REMOTE ] BBDO: Full fetch complete (7436 records). [2025-10-29T17:26:56.977799] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-29T17:26:57.200522] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-29T17:26:57.359565] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-29T17:26:57.359669] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-29T17:26:57.359897] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-29T17:26:57.359939] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-29T17:26:57.360337] [DEBUG] [LOCAL ] BBDO: Trimmed 7436 records to 4860 (keeping 200 days of data) [2025-10-29T17:26:57.388123] [DEBUG] [LOCAL ] BBDO: Primary data saved (4860 records). [2025-10-29T17:26:57.388292] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-29T17:26:57.388377] [INFO ] [MAIN ] Update Progress: 222/2367 symbols completed. BBDO took 21.7s. Estimated remaining: 4h 20m 4s. Rate: 8.2 symbols/min [2025-10-29T17:26:57.559458] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:26:57.573995] [DEBUG] [LOCAL ] BBUC: Loaded 13766 existing records from primary storage. [2025-10-29T17:26:57.574190] [INFO ] [MAIN ] BBUC: Loaded 13766 existing records. [2025-10-29T17:26:57.759978] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:26:57.760236] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-29T17:26:57.760284] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-29T17:26:57.760440] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-29T17:26:57.760480] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-29T17:26:58.000837] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-29T17:26:58.132943] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:26:58.143450] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T17:26:58.793594] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-29T17:26:59.199096] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T17:26:59.240100] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T17:26:59.593577] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-29T17:27:00.393615] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-29T17:27:00.695951] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-29T17:27:00.703339] [INFO ] [REMOTE ] BBDC: Full fetch complete (48865 records). [2025-10-29T17:27:00.703446] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-29T17:27:01.089073] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-29T17:27:01.089347] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-29T17:27:01.089537] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-29T17:27:01.093031] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-29T17:27:01.093098] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-29T17:27:01.094244] [DEBUG] [LOCAL ] BBDC: Trimmed 48865 records to 32235 (keeping 200 days of data) [2025-10-29T17:27:01.197793] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-29T17:27:01.283279] [DEBUG] [LOCAL ] BBDC: Primary data saved (32235 records). [2025-10-29T17:27:01.283410] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-29T17:27:01.283488] [INFO ] [MAIN ] Update Progress: 223/2367 symbols completed. BBDC took 30.5s. Estimated remaining: 4h 19m 24s. Rate: 8.3 symbols/min [2025-10-29T17:27:01.447301] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:27:01.447519] [DEBUG] [LOCAL ] BBVA: No existing data file found in primary storage. [2025-10-29T17:27:01.447563] [WARN ] [MAIN ] BBVA: No existing data found, performing full refresh instead. [2025-10-29T17:27:01.447705] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-29T17:27:01.447755] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-29T17:27:01.447795] [DEBUG] [LOCAL ] BBVA: No primary data file found to delete. [2025-10-29T17:27:01.447826] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-29T17:27:01.624988] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-29T17:27:01.832069] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:27:01.993576] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-29T17:27:02.342412] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-29T17:27:02.793563] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-29T17:27:03.425690] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-29T17:27:03.593619] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-29T17:27:04.393523] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-29T17:27:04.540163] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T17:27:05.193609] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-29T17:27:05.720704] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T17:27:05.749738] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T17:27:05.993577] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-29T17:27:06.354743] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-29T17:27:06.793610] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-29T17:27:07.593614] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-29T17:27:08.000466] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T17:27:08.274282] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-29T17:27:08.393561] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-29T17:27:09.193629] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-29T17:27:09.741972] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T17:27:09.845765] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-29T17:27:09.993641] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-29T17:27:10.422940] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-29T17:27:10.793608] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-29T17:27:11.367433] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-29T17:27:11.593566] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-29T17:27:12.393569] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-29T17:27:12.425195] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T17:27:13.193615] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-29T17:27:13.766832] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T17:27:13.879173] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-29T17:27:13.993580] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-29T17:27:14.296918] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-29T17:27:14.793561] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-29T17:27:15.593537] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-29T17:27:15.654082] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-29T17:27:16.393542] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-29T17:27:16.937480] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-29T17:27:16.986327] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T17:27:17.193575] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-29T17:27:17.660366] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T17:27:17.993590] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-29T17:27:18.682248] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-29T17:27:18.793575] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-29T17:27:19.593555] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-29T17:27:19.955074] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-29T17:27:19.983582] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T17:27:20.393569] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-29T17:27:20.951295] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-29T17:27:21.193570] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-29T17:27:21.851132] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T17:27:21.993568] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-29T17:27:22.725809] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-29T17:27:22.731955] [INFO ] [REMOTE ] BBN: Full fetch complete (24916 records). [2025-10-29T17:27:22.732034] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-29T17:27:22.798774] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-29T17:27:23.104272] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-29T17:27:23.104344] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-29T17:27:23.104752] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-29T17:27:23.104826] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-29T17:27:23.105422] [DEBUG] [LOCAL ] BBN: Trimmed 24916 records to 17274 (keeping 200 days of data) [2025-10-29T17:27:23.212212] [DEBUG] [LOCAL ] BBN: Primary data saved (17274 records). [2025-10-29T17:27:23.212344] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-29T17:27:23.212419] [INFO ] [MAIN ] Update Progress: 224/2367 symbols completed. BBN took 35.2s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min [2025-10-29T17:27:23.386208] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:27:23.399195] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T17:27:23.421413] [DEBUG] [LOCAL ] BBW: Loaded 26874 existing records from primary storage. [2025-10-29T17:27:23.421690] [INFO ] [MAIN ] BBW: Loaded 26874 existing records. [2025-10-29T17:27:23.599375] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-29T17:27:23.605889] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:27:23.607058] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-29T17:27:23.607108] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-29T17:27:23.607532] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-29T17:27:23.607593] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-29T17:27:24.029248] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:27:24.303543] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T17:27:24.393543] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-29T17:27:25.031943] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T17:27:25.034953] [INFO ] [REMOTE ] BBU: Full fetch complete (7629 records). [2025-10-29T17:27:25.035058] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-29T17:27:25.195229] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-29T17:27:25.395585] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-29T17:27:25.395704] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-29T17:27:25.395937] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-29T17:27:25.395996] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-29T17:27:25.396400] [DEBUG] [LOCAL ] BBU: Trimmed 7629 records to 5905 (keeping 200 days of data) [2025-10-29T17:27:25.430871] [DEBUG] [LOCAL ] BBU: Primary data saved (5905 records). [2025-10-29T17:27:25.430995] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-29T17:27:25.431070] [INFO ] [MAIN ] Update Progress: 225/2367 symbols completed. BBU took 29.7s. Estimated remaining: 4h 20m 41s. Rate: 8.2 symbols/min [2025-10-29T17:27:25.596972] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:27:25.645018] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-29T17:27:25.645331] [INFO ] [MAIN ] BBWI: Loaded 53591 existing records. [2025-10-29T17:27:25.820058] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:27:25.820284] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-29T17:27:25.820331] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-29T17:27:25.820510] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-29T17:27:25.820548] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-29T17:27:26.002675] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-29T17:27:26.166526] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:27:26.592028] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-29T17:27:26.613317] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-29T17:27:26.793678] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-29T17:27:27.593578] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-29T17:27:28.235533] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T17:27:28.394047] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-29T17:27:28.761557] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T17:27:29.193710] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-29T17:27:29.628524] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T17:27:29.933252] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-29T17:27:29.993571] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-29T17:27:30.793574] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-29T17:27:31.452410] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T17:27:31.462967] [INFO ] [REMOTE ] BBVA: Full fetch complete (71924 records). [2025-10-29T17:27:31.463092] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-29T17:27:31.601636] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-29T17:27:31.893872] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-29T17:27:31.893950] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-29T17:27:31.894701] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-29T17:27:31.894763] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-29T17:27:31.896115] [DEBUG] [LOCAL ] BBVA: Trimmed 71924 records to 48973 (keeping 200 days of data) [2025-10-29T17:27:32.188407] [DEBUG] [LOCAL ] BBVA: Primary data saved (48973 records). [2025-10-29T17:27:32.188591] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-29T17:27:32.188692] [INFO ] [MAIN ] Update Progress: 226/2367 symbols completed. BBVA took 30.9s. Estimated remaining: 4h 20m 29s. Rate: 8.2 symbols/min [2025-10-29T17:27:32.395359] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-29T17:27:32.395190] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:27:32.403114] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-29T17:27:32.431435] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T17:27:32.436404] [INFO ] [REMOTE ] BBUC: Full fetch complete (19390 records). [2025-10-29T17:27:32.436524] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-29T17:27:32.779455] [DEBUG] [LOCAL ] BBY: Loaded 53427 existing records from primary storage. [2025-10-29T17:27:32.791630] [INFO ] [MAIN ] BBY: Loaded 53427 existing records. [2025-10-29T17:27:33.055993] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-29T17:27:33.056568] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-29T17:27:33.057417] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-29T17:27:33.057977] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-29T17:27:33.083246] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:27:33.083820] [DEBUG] [LOCAL ] BBUC: Trimmed 19390 records to 13767 (keeping 200 days of data) [2025-10-29T17:27:33.084460] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-29T17:27:33.085062] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-29T17:27:33.085604] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-29T17:27:33.085731] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-29T17:27:33.206921] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-29T17:27:33.436388] [DEBUG] [LOCAL ] BBUC: Primary data saved (13767 records). [2025-10-29T17:27:33.448774] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-29T17:27:33.472928] [INFO ] [MAIN ] Update Progress: 227/2367 symbols completed. BBUC took 36.1s. Estimated remaining: 4h 19m 25s. Rate: 8.2 symbols/min [2025-10-29T17:27:33.605701] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T17:27:33.699694] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:27:33.792030] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:27:33.838039] [DEBUG] [LOCAL ] BC: Loaded 43774 existing records from primary storage. [2025-10-29T17:27:33.838495] [INFO ] [MAIN ] BC: Loaded 43774 existing records. [2025-10-29T17:27:34.002125] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-29T17:27:34.027232] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:27:34.027600] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-29T17:27:34.027689] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-29T17:27:34.028259] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-29T17:27:34.028316] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-29T17:27:34.419204] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:27:34.492454] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T17:27:34.793709] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-29T17:27:35.577522] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-29T17:27:35.593502] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-29T17:27:35.664763] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-29T17:27:36.393601] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-29T17:27:36.844991] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T17:27:37.198704] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-29T17:27:37.206472] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-29T17:27:37.993532] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-29T17:27:38.624827] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T17:27:38.793572] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-29T17:27:39.359164] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T17:27:39.593740] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-29T17:27:40.168674] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T17:27:40.393634] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-29T17:27:40.503423] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-29T17:27:41.193573] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-29T17:27:41.624421] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:27:41.993599] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-29T17:27:42.204265] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T17:27:42.793562] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-29T17:27:43.435743] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-29T17:27:43.593561] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-29T17:27:44.221524] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T17:27:44.393567] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-29T17:27:44.596065] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:27:45.083080] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T17:27:45.193553] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-29T17:27:45.988193] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-29T17:27:45.993622] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-29T17:27:46.793619] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-29T17:27:47.290170] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T17:27:47.593572] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-29T17:27:48.122424] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T17:27:48.393568] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-29T17:27:48.876844] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-29T17:27:49.193633] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-29T17:27:49.710758] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T17:27:49.993635] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-29T17:27:50.171567] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-29T17:27:50.793530] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-29T17:27:51.158166] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T17:27:51.593573] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-29T17:27:52.149477] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T17:27:52.393605] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-29T17:27:52.896871] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T17:27:53.193615] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-29T17:27:53.753139] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T17:27:53.993573] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-29T17:27:54.395159] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T17:27:54.793621] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-29T17:27:55.082594] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-29T17:27:55.090495] [INFO ] [REMOTE ] BBW: Full fetch complete (39192 records). [2025-10-29T17:27:55.090699] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-29T17:27:55.482545] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-29T17:27:55.482636] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-29T17:27:55.483240] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-29T17:27:55.483287] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-29T17:27:55.484292] [DEBUG] [LOCAL ] BBW: Trimmed 39192 records to 26817 (keeping 200 days of data) [2025-10-29T17:27:55.593549] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-29T17:27:55.648771] [DEBUG] [LOCAL ] BBW: Primary data saved (26817 records). [2025-10-29T17:27:55.648927] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-29T17:27:55.649027] [INFO ] [MAIN ] Update Progress: 228/2367 symbols completed. BBW took 32.4s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min [2025-10-29T17:27:55.823785] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:27:55.858816] [DEBUG] [LOCAL ] BCAT: Loaded 33937 existing records from primary storage. [2025-10-29T17:27:55.859129] [INFO ] [MAIN ] BCAT: Loaded 33937 existing records. [2025-10-29T17:27:56.044705] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:27:56.045071] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-29T17:27:56.045198] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-29T17:27:56.045829] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-29T17:27:56.045897] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-29T17:27:56.393774] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-29T17:27:56.413799] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:27:56.446952] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-29T17:27:57.157943] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T17:27:57.169277] [INFO ] [REMOTE ] BBY: Full fetch complete (77417 records). [2025-10-29T17:27:57.169437] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-29T17:27:57.201866] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-29T17:27:57.577832] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-29T17:27:57.577941] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-29T17:27:57.578849] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-29T17:27:57.578933] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-29T17:27:57.580695] [DEBUG] [LOCAL ] BBY: Trimmed 77417 records to 53423 (keeping 200 days of data) [2025-10-29T17:27:57.604814] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T17:27:57.930145] [DEBUG] [LOCAL ] BBY: Primary data saved (53423 records). [2025-10-29T17:27:57.930278] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-29T17:27:57.931111] [INFO ] [MAIN ] Update Progress: 229/2367 symbols completed. BBY took 25.7s. Estimated remaining: 4h 20m 43s. Rate: 8.2 symbols/min [2025-10-29T17:27:57.998712] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-29T17:27:58.109117] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:27:58.137845] [DEBUG] [LOCAL ] BCC: Loaded 28455 existing records from primary storage. [2025-10-29T17:27:58.138114] [INFO ] [MAIN ] BCC: Loaded 28455 existing records. [2025-10-29T17:27:58.320225] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:27:58.320615] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-29T17:27:58.320974] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-29T17:27:58.321180] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-29T17:27:58.321227] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-29T17:27:58.503295] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T17:27:58.709031] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:27:58.793536] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-29T17:27:59.290994] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T17:27:59.593614] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-29T17:27:59.977059] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T17:28:00.393621] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-29T17:28:01.198679] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-29T17:28:01.220134] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-29T17:28:01.232535] [INFO ] [REMOTE ] BBWI: Full fetch complete (77636 records). [2025-10-29T17:28:01.232718] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-29T17:28:01.680402] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T17:28:01.679201] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-29T17:28:01.680550] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-29T17:28:01.688679] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-29T17:28:01.689095] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-29T17:28:01.690547] [DEBUG] [LOCAL ] BBWI: Trimmed 77636 records to 53591 (keeping 200 days of data) [2025-10-29T17:28:01.994913] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-29T17:28:02.039684] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-29T17:28:02.039938] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-29T17:28:02.040035] [INFO ] [MAIN ] Update Progress: 230/2367 symbols completed. BBWI took 36.6s. Estimated remaining: 4h 20m 6s. Rate: 8.2 symbols/min [2025-10-29T17:28:02.236398] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:28:02.236764] [DEBUG] [LOCAL ] BCE: No existing data file found in primary storage. [2025-10-29T17:28:02.236823] [WARN ] [MAIN ] BCE: No existing data found, performing full refresh instead. [2025-10-29T17:28:02.237057] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-29T17:28:02.237130] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-29T17:28:02.237186] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-10-29T17:28:02.237329] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-29T17:28:02.337335] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T17:28:02.644187] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:28:02.793549] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-29T17:28:03.057185] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T17:28:03.593611] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-29T17:28:04.171601] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T17:28:04.394443] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-29T17:28:04.408694] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T17:28:05.193594] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-29T17:28:05.633973] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T17:28:05.993578] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-29T17:28:06.059692] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-29T17:28:06.793595] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-29T17:28:06.948516] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T17:28:07.593585] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-29T17:28:07.746667] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-29T17:28:08.393605] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-29T17:28:08.807793] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T17:28:09.199454] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-29T17:28:09.216550] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T17:28:09.993564] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-29T17:28:10.199065] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-29T17:28:10.793540] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-29T17:28:11.284771] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T17:28:11.593561] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-29T17:28:11.877507] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T17:28:12.393597] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-29T17:28:12.893949] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T17:28:13.193603] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-29T17:28:13.791323] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T17:28:13.801240] [INFO ] [REMOTE ] BC: Full fetch complete (63949 records). [2025-10-29T17:28:13.801398] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-29T17:28:14.004266] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-29T17:28:14.198088] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-29T17:28:14.198156] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-29T17:28:14.198887] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-29T17:28:14.198950] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-29T17:28:14.200211] [DEBUG] [LOCAL ] BC: Trimmed 63949 records to 43736 (keeping 200 days of data) [2025-10-29T17:28:14.482551] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T17:28:14.493453] [DEBUG] [LOCAL ] BC: Primary data saved (43736 records). [2025-10-29T17:28:14.493949] [INFO ] [MAIN ] BC: Full history saved. [2025-10-29T17:28:14.494224] [INFO ] [MAIN ] Update Progress: 231/2367 symbols completed. BC took 41.0s. Estimated remaining: 4h 20m 46s. Rate: 8.2 symbols/min [2025-10-29T17:28:14.676306] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:28:14.703516] [DEBUG] [LOCAL ] BCH: Loaded 29555 existing records from primary storage. [2025-10-29T17:28:14.703824] [INFO ] [MAIN ] BCH: Loaded 29555 existing records. [2025-10-29T17:28:14.799878] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-29T17:28:14.880395] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:28:14.880752] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-29T17:28:14.880807] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-29T17:28:14.881216] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-29T17:28:14.881271] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-29T17:28:15.248507] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:28:15.368668] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-29T17:28:15.593631] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-29T17:28:15.875413] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T17:28:16.393567] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-29T17:28:16.432340] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T17:28:17.193525] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-29T17:28:17.618166] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T17:28:17.993525] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-29T17:28:18.148374] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T17:28:18.793542] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-29T17:28:18.901060] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-29T17:28:19.593559] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-29T17:28:20.051705] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T17:28:20.292402] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-29T17:28:20.393589] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-29T17:28:21.193555] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-29T17:28:21.399573] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T17:28:21.993559] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-29T17:28:22.067755] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T17:28:22.793523] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-29T17:28:22.875406] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T17:28:23.502574] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T17:28:23.593597] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-29T17:28:24.393587] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-29T17:28:24.808670] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T17:28:25.193561] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-29T17:28:25.321872] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T17:28:25.993561] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-29T17:28:26.321589] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-29T17:28:26.330220] [INFO ] [REMOTE ] BCAT: Full fetch complete (49984 records). [2025-10-29T17:28:26.330407] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-29T17:28:26.739373] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-29T17:28:26.739488] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-29T17:28:26.740236] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-29T17:28:26.740303] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-29T17:28:26.741828] [DEBUG] [LOCAL ] BCAT: Trimmed 49984 records to 33920 (keeping 200 days of data) [2025-10-29T17:28:26.794809] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-29T17:28:26.961891] [DEBUG] [LOCAL ] BCAT: Primary data saved (33920 records). [2025-10-29T17:28:26.962089] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-29T17:28:26.962190] [INFO ] [MAIN ] Update Progress: 232/2367 symbols completed. BCAT took 31.3s. Estimated remaining: 4h 21m 26s. Rate: 8.2 symbols/min [2025-10-29T17:28:27.144168] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:28:27.173965] [DEBUG] [LOCAL ] BCO: Loaded 24272 existing records from primary storage. [2025-10-29T17:28:27.174697] [INFO ] [MAIN ] BCO: Loaded 24272 existing records. [2025-10-29T17:28:27.368186] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:28:27.368731] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-29T17:28:27.368798] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-29T17:28:27.399202] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-29T17:28:27.399911] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-29T17:28:27.407752] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T17:28:27.603307] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-29T17:28:27.851843] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:28:27.898969] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-29T17:28:27.908034] [INFO ] [REMOTE ] BCC: Full fetch complete (41742 records). [2025-10-29T17:28:27.908298] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-29T17:28:28.315876] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-29T17:28:28.316000] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-29T17:28:28.316715] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-29T17:28:28.316791] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-29T17:28:28.317731] [DEBUG] [LOCAL ] BCC: Trimmed 41742 records to 28458 (keeping 200 days of data) [2025-10-29T17:28:28.404415] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-29T17:28:28.488051] [DEBUG] [LOCAL ] BCC: Primary data saved (28458 records). [2025-10-29T17:28:28.488185] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-29T17:28:28.488263] [INFO ] [MAIN ] Update Progress: 233/2367 symbols completed. BCC took 30.6s. Estimated remaining: 4h 20m 25s. Rate: 8.2 symbols/min [2025-10-29T17:28:28.663887] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:28:28.728134] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T17:28:28.736811] [DEBUG] [LOCAL ] BCS: Loaded 53436 existing records from primary storage. [2025-10-29T17:28:28.737174] [INFO ] [MAIN ] BCS: Loaded 53436 existing records. [2025-10-29T17:28:28.912678] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:28:28.912909] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-29T17:28:28.912961] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-29T17:28:28.913561] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-29T17:28:28.913620] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-29T17:28:29.199123] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-29T17:28:29.287813] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:28:29.823608] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-29T17:28:29.834709] [INFO ] [REMOTE ] BCE: Full fetch complete (76090 records). [2025-10-29T17:28:29.834861] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-29T17:28:29.993949] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-29T17:28:30.255583] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T17:28:30.273780] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-29T17:28:30.273856] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-29T17:28:30.280709] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-29T17:28:30.280792] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-29T17:28:30.282404] [DEBUG] [LOCAL ] BCE: Trimmed 76090 records to 52224 (keeping 200 days of data) [2025-10-29T17:28:30.585165] [DEBUG] [LOCAL ] BCE: Primary data saved (52224 records). [2025-10-29T17:28:30.585287] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-29T17:28:30.585354] [INFO ] [MAIN ] Update Progress: 234/2367 symbols completed. BCE took 28.5s. Estimated remaining: 4h 19m 30s. Rate: 8.2 symbols/min [2025-10-29T17:28:30.749662] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:28:30.776292] [DEBUG] [LOCAL ] BCSF: Loaded 27752 existing records from primary storage. [2025-10-29T17:28:30.776574] [INFO ] [MAIN ] BCSF: Loaded 27752 existing records. [2025-10-29T17:28:30.798737] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-29T17:28:30.956529] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:28:30.956761] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-29T17:28:30.956811] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-29T17:28:30.957227] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-29T17:28:30.957283] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-29T17:28:31.346534] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:28:31.593579] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-29T17:28:31.661888] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-29T17:28:31.688709] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-29T17:28:32.395747] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-29T17:28:32.398480] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T17:28:33.199621] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-29T17:28:33.210506] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T17:28:33.993560] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-29T17:28:34.141025] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T17:28:34.793530] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-29T17:28:34.909362] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T17:28:35.593709] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-29T17:28:36.029841] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T17:28:36.350460] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T17:28:36.393536] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-29T17:28:37.193568] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-29T17:28:37.797412] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T17:28:37.993559] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-29T17:28:38.139756] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-29T17:28:38.793594] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-29T17:28:39.422547] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T17:28:39.593530] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-29T17:28:39.765727] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-29T17:28:40.382165] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-29T17:28:40.393544] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-29T17:28:41.123933] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-29T17:28:41.193571] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-29T17:28:41.993527] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-29T17:28:42.084719] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T17:28:42.793570] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-29T17:28:43.566003] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-29T17:28:43.594002] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-29T17:28:43.597739] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T17:28:44.393546] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-29T17:28:44.448481] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-29T17:28:45.193533] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-29T17:28:45.455118] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T17:28:45.462107] [INFO ] [REMOTE ] BCH: Full fetch complete (41683 records). [2025-10-29T17:28:45.462214] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-29T17:28:45.843025] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-29T17:28:45.843111] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-29T17:28:45.843622] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-29T17:28:45.843696] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-29T17:28:45.844749] [DEBUG] [LOCAL ] BCH: Trimmed 41683 records to 29451 (keeping 200 days of data) [2025-10-29T17:28:45.998786] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-29T17:28:46.018088] [DEBUG] [LOCAL ] BCH: Primary data saved (29451 records). [2025-10-29T17:28:46.018229] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-29T17:28:46.018323] [INFO ] [MAIN ] Update Progress: 235/2367 symbols completed. BCH took 31.5s. Estimated remaining: 4h 20m 37s. Rate: 8.2 symbols/min [2025-10-29T17:28:46.192710] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:28:46.213078] [DEBUG] [LOCAL ] BCX: Loaded 21667 existing records from primary storage. [2025-10-29T17:28:46.213382] [INFO ] [MAIN ] BCX: Loaded 21667 existing records. [2025-10-29T17:28:46.403309] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:28:46.403867] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-29T17:28:46.404114] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-29T17:28:46.404721] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-29T17:28:46.404911] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-29T17:28:46.705164] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-29T17:28:46.796704] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-29T17:28:46.815582] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:28:46.852215] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T17:28:47.593526] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-29T17:28:47.613762] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T17:28:48.393597] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-29T17:28:48.998535] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T17:28:49.193555] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-29T17:28:49.504260] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T17:28:49.993541] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-29T17:28:50.705793] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-29T17:28:50.767167] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T17:28:50.793518] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-29T17:28:51.598059] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-29T17:28:51.600148] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T17:28:52.342523] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-29T17:28:52.393573] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-29T17:28:53.192984] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T17:28:53.199139] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-29T17:28:53.993556] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-29T17:28:54.587105] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T17:28:54.798869] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-29T17:28:54.802967] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T17:28:55.593588] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-29T17:28:56.412538] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-29T17:28:56.411317] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-29T17:28:56.422145] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-29T17:28:56.434075] [INFO ] [REMOTE ] BCS: Full fetch complete (77526 records). [2025-10-29T17:28:56.434186] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-29T17:28:56.815885] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-29T17:28:56.815992] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-29T17:28:56.816794] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-29T17:28:56.816857] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-29T17:28:56.818238] [DEBUG] [LOCAL ] BCS: Trimmed 77526 records to 53435 (keeping 200 days of data) [2025-10-29T17:28:57.131546] [DEBUG] [LOCAL ] BCS: Primary data saved (53435 records). [2025-10-29T17:28:57.131712] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-29T17:28:57.132430] [INFO ] [MAIN ] Update Progress: 236/2367 symbols completed. BCS took 28.6s. Estimated remaining: 4h 21m 4s. Rate: 8.2 symbols/min [2025-10-29T17:28:57.198878] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-29T17:28:57.318332] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:28:57.334607] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T17:28:57.360395] [DEBUG] [LOCAL ] BDC: Loaded 23420 existing records from primary storage. [2025-10-29T17:28:57.360628] [INFO ] [MAIN ] BDC: Loaded 23420 existing records. [2025-10-29T17:28:57.548395] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:28:57.548637] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-29T17:28:57.548720] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-29T17:28:57.549017] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-29T17:28:57.549058] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-29T17:28:57.921937] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:28:57.932242] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-29T17:28:57.993512] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-29T17:28:58.667330] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T17:28:58.793583] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-29T17:28:59.476399] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T17:28:59.593544] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-29T17:29:00.393554] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-29T17:29:00.550077] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T17:29:01.193552] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-29T17:29:01.278932] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-29T17:29:01.993537] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-29T17:29:02.075512] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-29T17:29:02.079722] [INFO ] [REMOTE ] BCO: Full fetch complete (35857 records). [2025-10-29T17:29:02.079868] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-29T17:29:02.462336] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-29T17:29:02.462407] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-29T17:29:02.462901] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-29T17:29:02.462964] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-29T17:29:02.463914] [DEBUG] [LOCAL ] BCO: Trimmed 35857 records to 24124 (keeping 200 days of data) [2025-10-29T17:29:02.608476] [DEBUG] [LOCAL ] BCO: Primary data saved (24124 records). [2025-10-29T17:29:02.608594] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-29T17:29:02.608688] [INFO ] [MAIN ] Update Progress: 237/2367 symbols completed. BCO took 35.6s. Estimated remaining: 4h 20m 39s. Rate: 8.2 symbols/min [2025-10-29T17:29:02.720940] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-29T17:29:02.793544] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-29T17:29:03.471170] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T17:29:03.593533] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-29T17:29:04.394803] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-29T17:29:04.398361] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-29T17:29:05.193596] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-29T17:29:05.255320] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T17:29:05.993616] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-29T17:29:06.402979] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T17:29:06.793551] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-29T17:29:06.919121] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-29T17:29:07.593599] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-29T17:29:07.821213] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-29T17:29:07.830977] [INFO ] [REMOTE ] BCSF: Full fetch complete (40115 records). [2025-10-29T17:29:07.831165] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-29T17:29:08.381144] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-29T17:29:08.381295] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-29T17:29:08.382174] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-29T17:29:08.382297] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-29T17:29:08.383707] [DEBUG] [LOCAL ] BCSF: Trimmed 40115 records to 27662 (keeping 200 days of data) [2025-10-29T17:29:08.448203] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-29T17:29:08.584469] [DEBUG] [LOCAL ] BCSF: Primary data saved (27662 records). [2025-10-29T17:29:08.584778] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-29T17:29:08.584937] [INFO ] [MAIN ] Update Progress: 238/2367 symbols completed. BCSF took 38.0s. Estimated remaining: 4h 20m 20s. Rate: 8.2 symbols/min [2025-10-29T17:29:08.606342] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T17:29:09.193634] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-29T17:29:09.379927] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T17:29:09.385434] [INFO ] [REMOTE ] BCX: Full fetch complete (33419 records). [2025-10-29T17:29:09.385522] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-29T17:29:09.749243] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-29T17:29:09.749317] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-29T17:29:09.749770] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-29T17:29:09.749828] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-29T17:29:09.750494] [DEBUG] [LOCAL ] BCX: Trimmed 33419 records to 21477 (keeping 200 days of data) [2025-10-29T17:29:09.876247] [DEBUG] [LOCAL ] BCX: Primary data saved (21477 records). [2025-10-29T17:29:09.876380] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-29T17:29:09.876462] [INFO ] [MAIN ] Update Progress: 239/2367 symbols completed. BCX took 23.9s. Estimated remaining: 4h 19m 19s. Rate: 8.2 symbols/min [2025-10-29T17:29:09.890085] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-29T17:29:09.993558] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-29T17:29:10.850053] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T17:29:10.859310] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-29T17:29:11.835952] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T17:29:11.843190] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-29T17:29:12.620940] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T17:29:12.627228] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-29T17:29:13.380346] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T17:29:13.385568] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-29T17:29:14.225751] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-29T17:29:14.230908] [INFO ] [REMOTE ] BDC: Full fetch complete (35670 records). [2025-10-29T17:29:14.231014] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-29T17:29:14.621286] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-29T17:29:14.621394] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-29T17:29:14.622313] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-29T17:29:14.622381] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-29T17:29:14.623432] [DEBUG] [LOCAL ] BDC: Trimmed 35670 records to 23469 (keeping 200 days of data) [2025-10-29T17:29:14.774881] [DEBUG] [LOCAL ] BDC: Primary data saved (23469 records). [2025-10-29T17:29:14.775062] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-29T17:29:14.775160] [INFO ] [MAIN ] Update Progress: 240/2367 symbols completed. BDC took 17.6s. Estimated remaining: 4h 18m 50s. Rate: 8.2 symbols/min [2025-10-29T17:29:15.467917] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:29:15.497976] [DEBUG] [LOCAL ] BDN: No existing data file found in primary storage. [2025-10-29T17:29:15.502160] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:29:15.533694] [WARN ] [MAIN ] BDN: No existing data found, performing full refresh instead. [2025-10-29T17:29:15.552996] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-29T17:29:15.552329] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:29:15.553180] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-29T17:29:15.553890] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-29T17:29:15.553986] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-29T17:29:15.547425] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:29:15.843783] [DEBUG] [LOCAL ] BDJ: Loaded 28805 existing records from primary storage. [2025-10-29T17:29:15.875529] [INFO ] [MAIN ] BDJ: Loaded 28805 existing records. [2025-10-29T17:29:15.991736] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-29T17:29:16.062373] [DEBUG] [LOCAL ] BDX: Loaded 52015 existing records from primary storage. [2025-10-29T17:29:16.123996] [INFO ] [MAIN ] BE: Loaded 53661 existing records. [2025-10-29T17:29:16.187917] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:29:16.198941] [INFO ] [MAIN ] BDX: Loaded 52015 existing records. [2025-10-29T17:29:16.286578] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-29T17:29:16.394337] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:29:16.434832] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-29T17:29:16.441553] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-29T17:29:16.463907] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-29T17:29:16.494302] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-29T17:29:16.633140] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:29:16.665585] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-29T17:29:16.709101] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-29T17:29:16.797226] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:29:16.801490] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-29T17:29:16.801806] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-29T17:29:16.808056] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-29T17:29:16.807864] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-29T17:29:16.813534] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-29T17:29:16.829746] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-29T17:29:17.581634] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:29:17.642748] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-29T17:29:17.870964] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:29:17.895969] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-29T17:29:17.976768] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:29:17.977156] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-29T17:29:18.004290] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-29T17:29:18.014055] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-29T17:29:18.804747] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T17:29:18.811968] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-29T17:29:19.180371] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T17:29:19.192383] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-29T17:29:19.224107] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T17:29:19.548782] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-29T17:29:19.593533] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-29T17:29:20.395829] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-29T17:29:20.402355] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T17:29:21.193589] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-29T17:29:21.457372] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (3.56 seconds). [2025-10-29T17:29:21.560586] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T17:29:21.603965] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-29T17:29:21.993586] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-29T17:29:22.794127] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-29T17:29:22.799881] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-29T17:29:23.312084] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T17:29:23.593567] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-29T17:29:24.193392] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-29T17:29:24.393598] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-29T17:29:24.764071] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T17:29:25.193615] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-29T17:29:25.836567] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T17:29:25.993691] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-29T17:29:26.609930] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T17:29:26.793567] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-29T17:29:27.413065] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-29T17:29:27.593602] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-29T17:29:27.637227] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T17:29:28.393602] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-29T17:29:28.856748] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T17:29:29.193691] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-29T17:29:29.896542] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-29T17:29:29.993570] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-29T17:29:30.568185] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-29T17:29:30.793696] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-29T17:29:31.448193] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-29T17:29:31.593598] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-29T17:29:31.790850] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T17:29:32.393582] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-29T17:29:32.710780] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T17:29:33.193636] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-29T17:29:33.758802] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-29T17:29:33.993611] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-29T17:29:34.559126] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T17:29:34.793630] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-29T17:29:35.593535] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-29T17:29:35.739878] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-29T17:29:35.774892] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T17:29:36.393593] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-29T17:29:36.920918] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T17:29:37.193611] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-29T17:29:37.993594] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-29T17:29:38.091933] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-29T17:29:38.595805] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T17:29:38.753532] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T17:29:38.793517] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-29T17:29:39.579241] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-29T17:29:39.593531] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-29T17:29:40.149147] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-29T17:29:40.159629] [INFO ] [REMOTE ] BDX: Full fetch complete (75374 records). [2025-10-29T17:29:40.159805] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-29T17:29:40.398829] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-29T17:29:40.552437] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-29T17:29:40.552513] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-29T17:29:40.553304] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-29T17:29:40.553366] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-29T17:29:40.555057] [DEBUG] [LOCAL ] BDX: Trimmed 75374 records to 52016 (keeping 200 days of data) [2025-10-29T17:29:40.870599] [DEBUG] [LOCAL ] BDX: Primary data saved (52016 records). [2025-10-29T17:29:40.870778] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-29T17:29:40.871732] [INFO ] [MAIN ] Update Progress: 241/2367 symbols completed. BDX took 26.1s. Estimated remaining: 4h 21m 29s. Rate: 8.1 symbols/min [2025-10-29T17:29:41.035561] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:29:41.035754] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-29T17:29:41.035798] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-29T17:29:41.035902] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-29T17:29:41.035986] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-29T17:29:41.036037] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-29T17:29:41.036069] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-29T17:29:41.204463] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-29T17:29:41.388397] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:29:41.522874] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T17:29:41.529494] [INFO ] [REMOTE ] BDJ: Full fetch complete (42535 records). [2025-10-29T17:29:41.529673] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-29T17:29:41.941928] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-29T17:29:41.942002] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-29T17:29:41.942506] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-29T17:29:41.942543] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-29T17:29:41.943392] [DEBUG] [LOCAL ] BDJ: Trimmed 42535 records to 28733 (keeping 200 days of data) [2025-10-29T17:29:42.001370] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-29T17:29:42.117170] [DEBUG] [LOCAL ] BDJ: Primary data saved (28733 records). [2025-10-29T17:29:42.117294] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-29T17:29:42.117381] [INFO ] [MAIN ] Update Progress: 242/2367 symbols completed. BDJ took 27.3s. Estimated remaining: 4h 20m 27s. Rate: 8.2 symbols/min [2025-10-29T17:29:42.283570] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:29:42.335778] [DEBUG] [LOCAL ] BEKE: Loaded 53169 existing records from primary storage. [2025-10-29T17:29:42.336108] [INFO ] [MAIN ] BEKE: Loaded 53169 existing records. [2025-10-29T17:29:42.517524] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:29:42.518083] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-29T17:29:42.518158] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-29T17:29:42.518857] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-29T17:29:42.518924] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-29T17:29:42.677088] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T17:29:42.798736] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-29T17:29:42.956473] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:29:43.593568] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-29T17:29:43.912834] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-29T17:29:44.037054] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-29T17:29:44.218384] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-29T17:29:44.393557] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-29T17:29:45.193604] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-29T17:29:45.764114] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T17:29:45.993709] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-29T17:29:46.430790] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T17:29:46.793620] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-29T17:29:47.189549] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T17:29:47.593586] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-29T17:29:47.782534] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.19 seconds). [2025-10-29T17:29:48.393562] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-29T17:29:48.660886] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-29T17:29:48.960569] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-29T17:29:48.971980] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-29T17:29:48.972139] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-29T17:29:49.203438] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-29T17:29:49.374882] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-29T17:29:49.374972] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-29T17:29:49.375787] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-29T17:29:49.375856] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-29T17:29:49.377395] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 53661 (keeping 200 days of data) [2025-10-29T17:29:49.582359] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-29T17:29:49.690742] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-29T17:29:49.690890] [INFO ] [MAIN ] BE: Full history saved. [2025-10-29T17:29:49.690967] [INFO ] [MAIN ] Update Progress: 243/2367 symbols completed. BE took 34.9s. Estimated remaining: 4h 20m 22s. Rate: 8.2 symbols/min [2025-10-29T17:29:49.865495] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:29:49.915983] [DEBUG] [LOCAL ] BEN: Loaded 53093 existing records from primary storage. [2025-10-29T17:29:49.916319] [INFO ] [MAIN ] BEN: Loaded 53093 existing records. [2025-10-29T17:29:49.998815] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-29T17:29:50.098140] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:29:50.098355] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-29T17:29:50.098403] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-29T17:29:50.098981] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-29T17:29:50.099040] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-29T17:29:50.451175] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:29:50.793544] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-29T17:29:51.521594] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-29T17:29:51.593695] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-29T17:29:52.199879] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-29T17:29:52.210550] [INFO ] [REMOTE ] BDN: Full fetch complete (69405 records). [2025-10-29T17:29:52.210738] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-29T17:29:52.394475] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-29T17:29:52.609721] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-29T17:29:52.609801] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-29T17:29:52.610565] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-29T17:29:52.610613] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-29T17:29:52.611992] [DEBUG] [LOCAL ] BDN: Trimmed 69405 records to 47517 (keeping 200 days of data) [2025-10-29T17:29:52.724196] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T17:29:52.918317] [DEBUG] [LOCAL ] BDN: Primary data saved (47517 records). [2025-10-29T17:29:52.920415] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-29T17:29:52.920199] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T17:29:52.920585] [INFO ] [MAIN ] Update Progress: 244/2367 symbols completed. BDN took 38.1s. Estimated remaining: 4h 19m 39s. Rate: 8.2 symbols/min [2025-10-29T17:29:53.105117] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:29:53.141960] [DEBUG] [LOCAL ] BEP: Loaded 38735 existing records from primary storage. [2025-10-29T17:29:53.142257] [INFO ] [MAIN ] BEP: Loaded 38735 existing records. [2025-10-29T17:29:53.202584] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-29T17:29:53.320264] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:29:53.320485] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-29T17:29:53.320543] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-29T17:29:53.321062] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-29T17:29:53.321120] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-29T17:29:53.676767] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:29:53.993569] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-29T17:29:54.410421] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T17:29:54.793630] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-29T17:29:55.233907] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-29T17:29:55.284639] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T17:29:55.593693] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-29T17:29:56.393577] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-29T17:29:57.193606] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-29T17:29:57.464024] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-29T17:29:57.505838] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-29T17:29:57.806856] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-29T17:29:57.993701] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-29T17:29:58.793546] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-29T17:29:59.290958] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:29:59.593608] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-29T17:29:59.819413] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-29T17:30:00.171942] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T17:30:00.393570] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-29T17:30:00.641573] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-29T17:30:01.193591] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-29T17:30:01.993558] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-29T17:30:02.170881] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T17:30:02.171793] [INFO ] [REMOTE ] BEDU: Full fetch complete (1322 records). [2025-10-29T17:30:02.171861] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-29T17:30:02.172285] [FATAL] [VALIDATOR ] BEDU: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:30:02.172389] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:30:02.172432] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:30:02.172498] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-29T17:30:02.172560] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-29T17:30:02.172594] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-29T17:30:02.172632] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-29T17:30:02.172724] [INFO ] [MAIN ] Update Progress: 245/2367 symbols completed. BEDU took 21.3s. Estimated remaining: 4h 19m 48s. Rate: 8.2 symbols/min [2025-10-29T17:30:02.354352] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:30:02.354519] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-10-29T17:30:02.354557] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-10-29T17:30:02.354692] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-29T17:30:02.354746] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-29T17:30:02.354787] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-29T17:30:02.354818] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-29T17:30:02.731011] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:30:02.793547] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-29T17:30:03.221677] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T17:30:03.593557] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-29T17:30:04.393565] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-29T17:30:04.474309] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-29T17:30:05.193598] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-29T17:30:05.387084] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-29T17:30:05.993573] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-29T17:30:06.104773] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-29T17:30:06.793539] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-29T17:30:06.923044] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-29T17:30:07.212560] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T17:30:07.593581] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-29T17:30:07.791584] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:30:08.393576] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-29T17:30:08.857288] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T17:30:09.193578] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-29T17:30:09.773558] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T17:30:09.993575] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-29T17:30:10.377384] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T17:30:10.793555] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-29T17:30:11.184083] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T17:30:11.593546] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-29T17:30:12.165481] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T17:30:12.393563] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-29T17:30:13.067304] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T17:30:13.193558] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-29T17:30:13.623533] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T17:30:13.993592] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-29T17:30:14.793551] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-29T17:30:14.891099] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-29T17:30:14.934278] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-29T17:30:15.593552] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-29T17:30:16.167620] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T17:30:16.393577] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-29T17:30:16.762807] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:30:17.193583] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-29T17:30:17.685138] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T17:30:17.993564] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-29T17:30:18.350623] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-29T17:30:18.793546] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-29T17:30:19.463504] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-29T17:30:19.474788] [INFO ] [REMOTE ] BEN: Full fetch complete (77045 records). [2025-10-29T17:30:19.474926] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-29T17:30:19.595313] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-29T17:30:19.906258] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-29T17:30:19.906481] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-29T17:30:19.907299] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-29T17:30:19.907375] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-29T17:30:19.909166] [DEBUG] [LOCAL ] BEN: Trimmed 77045 records to 53088 (keeping 200 days of data) [2025-10-29T17:30:19.940836] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T17:30:20.266208] [DEBUG] [LOCAL ] BEN: Primary data saved (53088 records). [2025-10-29T17:30:20.266373] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-29T17:30:20.267172] [INFO ] [MAIN ] Update Progress: 246/2367 symbols completed. BEN took 30.6s. Estimated remaining: 4h 21m 13s. Rate: 8.1 symbols/min [2025-10-29T17:30:20.404769] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-29T17:30:20.435795] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:30:20.446098] [DEBUG] [LOCAL ] BEPH: Loaded 4778 existing records from primary storage. [2025-10-29T17:30:20.446425] [INFO ] [MAIN ] BEPH: Loaded 4778 existing records. [2025-10-29T17:30:20.620100] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:30:20.620248] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-29T17:30:20.620295] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-29T17:30:20.620497] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-29T17:30:20.620552] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-29T17:30:20.968798] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:30:21.193574] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-29T17:30:21.238319] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T17:30:21.249602] [INFO ] [REMOTE ] BEKE: Full fetch complete (77313 records). [2025-10-29T17:30:21.249795] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-29T17:30:21.642515] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-29T17:30:21.642747] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-29T17:30:21.643576] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-29T17:30:21.643787] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-29T17:30:21.669237] [DEBUG] [LOCAL ] BEKE: Trimmed 77313 records to 53161 (keeping 200 days of data) [2025-10-29T17:30:21.670836] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T17:30:21.790431] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T17:30:21.999886] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-29T17:30:22.004483] [DEBUG] [LOCAL ] BEKE: Primary data saved (53161 records). [2025-10-29T17:30:22.005930] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-29T17:30:22.006056] [INFO ] [MAIN ] Update Progress: 247/2367 symbols completed. BEKE took 39.9s. Estimated remaining: 4h 20m 17s. Rate: 8.1 symbols/min [2025-10-29T17:30:22.177438] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:30:22.182937] [DEBUG] [LOCAL ] BEPI: Loaded 3456 existing records from primary storage. [2025-10-29T17:30:22.183082] [INFO ] [MAIN ] BEPI: Loaded 3456 existing records. [2025-10-29T17:30:22.362944] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:30:22.363164] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-29T17:30:22.363215] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-29T17:30:22.363348] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-29T17:30:22.363398] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-29T17:30:22.728819] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:30:22.793572] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-29T17:30:23.111390] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T17:30:23.593592] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-29T17:30:23.775388] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T17:30:23.979937] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-29T17:30:24.393563] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-29T17:30:24.705859] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-29T17:30:25.193557] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-29T17:30:25.993565] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-29T17:30:26.268336] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-29T17:30:26.299594] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T17:30:26.793547] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-29T17:30:27.593578] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-29T17:30:27.762128] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T17:30:28.037072] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-29T17:30:28.393559] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-29T17:30:29.193554] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-29T17:30:29.619494] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-29T17:30:29.847369] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T17:30:29.857894] [INFO ] [REMOTE ] BEPC: Full fetch complete (68842 records). [2025-10-29T17:30:29.858031] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-29T17:30:30.003490] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-29T17:30:30.259879] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-29T17:30:30.259954] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-29T17:30:30.260673] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-29T17:30:30.260733] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-29T17:30:30.261930] [DEBUG] [LOCAL ] BEPC: Trimmed 68842 records to 46214 (keeping 200 days of data) [2025-10-29T17:30:30.474791] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-29T17:30:30.545615] [DEBUG] [LOCAL ] BEPC: Primary data saved (46214 records). [2025-10-29T17:30:30.545781] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-29T17:30:30.545884] [INFO ] [MAIN ] Update Progress: 248/2367 symbols completed. BEPC took 28.4s. Estimated remaining: 4h 20m 20s. Rate: 8.1 symbols/min [2025-10-29T17:30:30.713845] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:30:30.718863] [DEBUG] [LOCAL ] BEPJ: Loaded 3060 existing records from primary storage. [2025-10-29T17:30:30.719022] [INFO ] [MAIN ] BEPJ: Loaded 3060 existing records. [2025-10-29T17:30:30.798801] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-29T17:30:30.907270] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:30:30.907495] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-29T17:30:30.907544] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-29T17:30:30.907741] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-29T17:30:30.907799] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-29T17:30:31.297948] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:30:31.302244] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-29T17:30:31.593718] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-29T17:30:32.094343] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-29T17:30:32.393578] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-29T17:30:32.837498] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-29T17:30:33.193700] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-29T17:30:33.574356] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T17:30:33.993544] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-29T17:30:34.416898] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-29T17:30:34.793576] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-29T17:30:35.593589] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-29T17:30:35.897906] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T17:30:36.272231] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T17:30:36.283567] [INFO ] [REMOTE ] BEP: Full fetch complete (59242 records). [2025-10-29T17:30:36.283862] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-29T17:30:36.398712] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-29T17:30:36.671303] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-29T17:30:36.671398] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-29T17:30:36.672113] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-29T17:30:36.672185] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-29T17:30:36.673515] [DEBUG] [LOCAL ] BEP: Trimmed 59242 records to 38826 (keeping 200 days of data) [2025-10-29T17:30:36.783419] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T17:30:36.912952] [DEBUG] [LOCAL ] BEP: Primary data saved (38826 records). [2025-10-29T17:30:36.913090] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-29T17:30:36.913165] [INFO ] [MAIN ] Update Progress: 249/2367 symbols completed. BEP took 44.0s. Estimated remaining: 4h 20m 4s. Rate: 8.1 symbols/min [2025-10-29T17:30:37.101721] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:30:37.133200] [DEBUG] [LOCAL ] BFAM: Loaded 33747 existing records from primary storage. [2025-10-29T17:30:37.133465] [INFO ] [MAIN ] BFAM: Loaded 33747 existing records. [2025-10-29T17:30:37.198822] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-29T17:30:37.311389] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:30:37.311622] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-29T17:30:37.311703] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-29T17:30:37.312269] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-29T17:30:37.312327] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-29T17:30:37.607111] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T17:30:37.685816] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:30:37.993631] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-29T17:30:38.793565] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-29T17:30:38.937610] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T17:30:39.333883] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-29T17:30:39.593569] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-29T17:30:39.866127] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-29T17:30:40.393573] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-29T17:30:41.193599] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-29T17:30:41.283210] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T17:30:41.565111] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-29T17:30:41.993616] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-29T17:30:42.486806] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-29T17:30:42.793558] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-29T17:30:43.593520] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-29T17:30:43.773599] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T17:30:43.947581] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-29T17:30:44.393625] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-29T17:30:44.784911] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T17:30:45.193573] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-29T17:30:45.576599] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-29T17:30:45.993588] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-29T17:30:46.260775] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-29T17:30:46.793576] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-29T17:30:47.259577] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-29T17:30:47.261701] [INFO ] [REMOTE ] BEPH: Full fetch complete (7455 records). [2025-10-29T17:30:47.261794] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-29T17:30:47.600193] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-29T17:30:47.633344] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-29T17:30:47.633423] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-29T17:30:47.633618] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-29T17:30:47.633806] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-29T17:30:47.634293] [DEBUG] [LOCAL ] BEPH: Trimmed 7455 records to 4754 (keeping 200 days of data) [2025-10-29T17:30:47.667813] [DEBUG] [LOCAL ] BEPH: Primary data saved (4754 records). [2025-10-29T17:30:47.667998] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-29T17:30:47.668098] [INFO ] [MAIN ] Update Progress: 250/2367 symbols completed. BEPH took 27.4s. Estimated remaining: 4h 20m 25s. Rate: 8.1 symbols/min [2025-10-29T17:30:47.836801] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:30:47.875308] [DEBUG] [LOCAL ] BFH: Loaded 41132 existing records from primary storage. [2025-10-29T17:30:47.875582] [INFO ] [MAIN ] BFH: Loaded 41132 existing records. [2025-10-29T17:30:48.050781] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:30:48.050979] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-29T17:30:48.051025] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-29T17:30:48.051495] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-29T17:30:48.051553] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-29T17:30:48.399128] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:30:48.394676] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-29T17:30:48.667483] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-29T17:30:48.907860] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-29T17:30:48.909580] [INFO ] [REMOTE ] BEPI: Full fetch complete (4719 records). [2025-10-29T17:30:48.909711] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-29T17:30:49.198694] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-29T17:30:49.269073] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-29T17:30:49.269147] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-29T17:30:49.269304] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-29T17:30:49.269345] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-29T17:30:49.269732] [DEBUG] [LOCAL ] BEPI: Trimmed 4719 records to 3436 (keeping 200 days of data) [2025-10-29T17:30:49.291005] [DEBUG] [LOCAL ] BEPI: Primary data saved (3436 records). [2025-10-29T17:30:49.291112] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-29T17:30:49.291193] [INFO ] [MAIN ] Update Progress: 251/2367 symbols completed. BEPI took 27.3s. Estimated remaining: 4h 19m 29s. Rate: 8.2 symbols/min [2025-10-29T17:30:49.457129] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:30:49.471603] [DEBUG] [LOCAL ] BFK: Loaded 13780 existing records from primary storage. [2025-10-29T17:30:49.471829] [INFO ] [MAIN ] BFK: Loaded 13780 existing records. [2025-10-29T17:30:49.643631] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:30:49.643850] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-29T17:30:49.643896] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-29T17:30:49.644091] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-29T17:30:49.644148] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-29T17:30:49.993820] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:30:49.993886] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-29T17:30:50.358321] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T17:30:50.419844] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-29T17:30:50.793545] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-29T17:30:51.222458] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-29T17:30:51.593571] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-29T17:30:52.291109] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-29T17:30:52.393718] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-29T17:30:53.193531] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-29T17:30:53.278491] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T17:30:53.695348] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T17:30:53.993566] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-29T17:30:54.504768] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T17:30:54.793601] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-29T17:30:55.118876] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T17:30:55.593575] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-29T17:30:55.983582] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-29T17:30:55.984889] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4375 records). [2025-10-29T17:30:55.984981] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-29T17:30:56.359888] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-29T17:30:56.359977] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-29T17:30:56.360117] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-29T17:30:56.360191] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-29T17:30:56.360550] [DEBUG] [LOCAL ] BEPJ: Trimmed 4375 records to 3047 (keeping 200 days of data) [2025-10-29T17:30:56.378803] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3047 records). [2025-10-29T17:30:56.378867] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-29T17:30:56.378934] [INFO ] [MAIN ] Update Progress: 252/2367 symbols completed. BEPJ took 25.8s. Estimated remaining: 4h 19m 20s. Rate: 8.2 symbols/min [2025-10-29T17:30:56.399054] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-29T17:30:56.545336] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:30:56.592482] [DEBUG] [LOCAL ] BFLY: Loaded 51850 existing records from primary storage. [2025-10-29T17:30:56.592792] [INFO ] [MAIN ] BFLY: Loaded 51850 existing records. [2025-10-29T17:30:56.767023] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:30:56.767268] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-29T17:30:56.767315] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-29T17:30:56.767836] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-29T17:30:56.767892] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-29T17:30:57.114590] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:30:57.193536] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-29T17:30:57.567959] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T17:30:57.657035] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T17:30:57.993563] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-29T17:30:58.793630] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-29T17:30:58.998896] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T17:30:59.593618] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-29T17:30:59.978306] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T17:31:00.248497] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-29T17:31:00.393703] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-29T17:31:01.193554] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-29T17:31:01.768429] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T17:31:01.993548] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-29T17:31:02.080828] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-29T17:31:02.793597] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-29T17:31:03.451402] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T17:31:03.493677] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T17:31:03.593550] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-29T17:31:04.135714] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-29T17:31:04.393629] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-29T17:31:04.896508] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-29T17:31:05.193571] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-29T17:31:05.993602] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-29T17:31:06.487248] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T17:31:06.793544] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-29T17:31:07.099192] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T17:31:07.593560] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-29T17:31:08.011888] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T17:31:08.393584] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-29T17:31:08.857129] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T17:31:09.193553] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-29T17:31:09.358364] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-29T17:31:09.825794] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T17:31:09.993562] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-29T17:31:10.793565] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-29T17:31:10.986129] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-29T17:31:11.593564] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-29T17:31:12.076429] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:31:12.393566] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-29T17:31:12.815982] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T17:31:12.823860] [INFO ] [REMOTE ] BFAM: Full fetch complete (47720 records). [2025-10-29T17:31:12.823977] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-29T17:31:13.200016] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-29T17:31:13.200787] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-29T17:31:13.200864] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-29T17:31:13.202161] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-29T17:31:13.202223] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-29T17:31:13.203366] [DEBUG] [LOCAL ] BFAM: Trimmed 47720 records to 33826 (keeping 200 days of data) [2025-10-29T17:31:13.399780] [DEBUG] [LOCAL ] BFAM: Primary data saved (33826 records). [2025-10-29T17:31:13.399915] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-29T17:31:13.399992] [INFO ] [MAIN ] Update Progress: 253/2367 symbols completed. BFAM took 36.5s. Estimated remaining: 4h 20m 33s. Rate: 8.1 symbols/min [2025-10-29T17:31:13.570188] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:31:13.581493] [DEBUG] [LOCAL ] BFS: Loaded 9454 existing records from primary storage. [2025-10-29T17:31:13.581739] [INFO ] [MAIN ] BFS: Loaded 9454 existing records. [2025-10-29T17:31:13.766105] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:31:13.766606] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-29T17:31:13.766738] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-29T17:31:13.767064] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-29T17:31:13.767150] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-29T17:31:13.978809] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-29T17:31:14.001822] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-29T17:31:14.195424] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-29T17:31:14.199232] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:31:14.203745] [INFO ] [REMOTE ] BFK: Full fetch complete (19569 records). [2025-10-29T17:31:14.203901] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-29T17:31:14.578224] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-29T17:31:14.578301] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-29T17:31:14.578635] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-29T17:31:14.578714] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-29T17:31:14.579246] [DEBUG] [LOCAL ] BFK: Trimmed 19569 records to 13795 (keeping 200 days of data) [2025-10-29T17:31:14.657453] [DEBUG] [LOCAL ] BFK: Primary data saved (13795 records). [2025-10-29T17:31:14.657583] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-29T17:31:14.657681] [INFO ] [MAIN ] Update Progress: 254/2367 symbols completed. BFK took 25.4s. Estimated remaining: 4h 19m 35s. Rate: 8.1 symbols/min [2025-10-29T17:31:14.802335] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-29T17:31:14.833566] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:31:14.833742] [DEBUG] [LOCAL ] BFZ: No existing data file found in primary storage. [2025-10-29T17:31:14.833787] [WARN ] [MAIN ] BFZ: No existing data found, performing full refresh instead. [2025-10-29T17:31:14.833916] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-29T17:31:14.833957] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-29T17:31:14.833997] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-29T17:31:14.834205] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-29T17:31:15.210408] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:31:15.235274] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T17:31:15.404433] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T17:31:15.593631] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-29T17:31:16.379011] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-29T17:31:16.393553] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-29T17:31:17.007051] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T17:31:17.193583] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-29T17:31:17.774282] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T17:31:17.993562] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-29T17:31:18.793589] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-29T17:31:19.289326] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T17:31:19.289673] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T17:31:19.593620] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-29T17:31:20.393607] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-29T17:31:21.112346] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-29T17:31:21.193549] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-29T17:31:21.643210] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T17:31:21.993557] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-29T17:31:22.588228] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T17:31:22.738373] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-29T17:31:22.793531] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-29T17:31:23.328797] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T17:31:23.593563] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-29T17:31:24.194089] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-29T17:31:24.393557] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-29T17:31:24.909999] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-29T17:31:25.193598] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-29T17:31:25.993638] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-29T17:31:26.602845] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-29T17:31:26.602627] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T17:31:26.793552] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-29T17:31:27.222458] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-29T17:31:27.593578] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-29T17:31:28.393521] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-29T17:31:28.668732] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T17:31:28.957465] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-29T17:31:29.193628] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-29T17:31:29.993700] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-29T17:31:30.679545] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T17:31:30.793539] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-29T17:31:30.909405] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-29T17:31:30.920912] [INFO ] [REMOTE ] BFLY: Full fetch complete (75477 records). [2025-10-29T17:31:30.921082] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-29T17:31:31.312214] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-29T17:31:31.312305] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-29T17:31:31.313249] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-29T17:31:31.313320] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-29T17:31:31.314838] [DEBUG] [LOCAL ] BFLY: Trimmed 75477 records to 51840 (keeping 200 days of data) [2025-10-29T17:31:31.596077] [DEBUG] [LOCAL ] BFLY: Primary data saved (51840 records). [2025-10-29T17:31:31.596425] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-29T17:31:31.597374] [INFO ] [MAIN ] Update Progress: 255/2367 symbols completed. BFLY took 35.2s. Estimated remaining: 4h 20m 47s. Rate: 8.1 symbols/min [2025-10-29T17:31:31.596272] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-29T17:31:31.768209] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:31:31.814538] [DEBUG] [LOCAL ] BG: Loaded 50357 existing records from primary storage. [2025-10-29T17:31:31.814868] [INFO ] [MAIN ] BG: Loaded 50357 existing records. [2025-10-29T17:31:31.993723] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:31:31.994002] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-29T17:31:31.994072] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-29T17:31:31.994553] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-29T17:31:31.994608] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-29T17:31:32.293218] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-29T17:31:32.350888] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-29T17:31:32.394034] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-29T17:31:32.418710] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:31:32.895350] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-29T17:31:33.193545] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-29T17:31:33.745399] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-29T17:31:33.993604] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-29T17:31:34.793548] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-29T17:31:35.314329] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T17:31:35.385267] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-29T17:31:35.593628] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-29T17:31:36.393560] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-29T17:31:36.856371] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-29T17:31:36.866208] [INFO ] [REMOTE ] BFH: Full fetch complete (60267 records). [2025-10-29T17:31:36.866396] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-29T17:31:37.195245] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-29T17:31:37.220772] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T17:31:37.250596] [INFO ] [REMOTE ] BFS: Full fetch complete (13037 records). [2025-10-29T17:31:37.285838] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-29T17:31:37.320025] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:31:37.323431] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-29T17:31:37.323291] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:31:37.323587] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-29T17:31:37.323631] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:31:37.323846] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-29T17:31:37.324572] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-29T17:31:37.324796] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-29T17:31:37.324726] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-29T17:31:37.325086] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-29T17:31:37.325518] [DEBUG] [LOCAL ] BFS: Deleted derivative data file. [2025-10-29T17:31:37.325733] [INFO ] [MAIN ] Update Progress: 256/2367 symbols completed. BFS took 23.9s. Estimated remaining: 4h 20m 25s. Rate: 8.1 symbols/min [2025-10-29T17:31:37.418576] [DEBUG] [LOCAL ] BFH: Trimmed 60267 records to 41042 (keeping 200 days of data) [2025-10-29T17:31:37.595936] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:31:37.603137] [DEBUG] [LOCAL ] BGB: No existing data file found in primary storage. [2025-10-29T17:31:37.603491] [WARN ] [MAIN ] BGB: No existing data found, performing full refresh instead. [2025-10-29T17:31:37.604942] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-29T17:31:37.605060] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-29T17:31:37.605741] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-29T17:31:37.606408] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-29T17:31:38.008758] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-29T17:31:38.015010] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:31:38.142927] [DEBUG] [LOCAL ] BFH: Primary data saved (41042 records). [2025-10-29T17:31:38.143066] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-29T17:31:38.143863] [INFO ] [MAIN ] Update Progress: 257/2367 symbols completed. BFH took 50.5s. Estimated remaining: 4h 19m 24s. Rate: 8.1 symbols/min [2025-10-29T17:31:38.321725] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:31:38.341127] [DEBUG] [LOCAL ] BGH: Loaded 16819 existing records from primary storage. [2025-10-29T17:31:38.341365] [INFO ] [MAIN ] BGH: Loaded 16819 existing records. [2025-10-29T17:31:38.524345] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:31:38.524615] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-29T17:31:38.524695] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-29T17:31:38.525004] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-29T17:31:38.525063] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-29T17:31:38.799928] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-29T17:31:38.899815] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T17:31:38.976701] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:31:39.003774] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-29T17:31:39.593521] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-29T17:31:39.736771] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T17:31:40.393609] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-29T17:31:40.930975] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T17:31:41.153824] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T17:31:41.158424] [INFO ] [REMOTE ] BFZ: Full fetch complete (17613 records). [2025-10-29T17:31:41.158591] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-29T17:31:41.198823] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-29T17:31:41.557663] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-29T17:31:41.557961] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-29T17:31:41.558320] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-29T17:31:41.558364] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-29T17:31:41.558907] [DEBUG] [LOCAL ] BFZ: Trimmed 17613 records to 11890 (keeping 200 days of data) [2025-10-29T17:31:41.629276] [DEBUG] [LOCAL ] BFZ: Primary data saved (11890 records). [2025-10-29T17:31:41.629398] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-29T17:31:41.629463] [INFO ] [MAIN ] Update Progress: 258/2367 symbols completed. BFZ took 27.0s. Estimated remaining: 4h 18m 45s. Rate: 8.2 symbols/min [2025-10-29T17:31:41.804320] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:31:41.819783] [DEBUG] [LOCAL ] BGR: Loaded 13033 existing records from primary storage. [2025-10-29T17:31:41.820006] [INFO ] [MAIN ] BGR: Loaded 13033 existing records. [2025-10-29T17:31:42.000066] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-29T17:31:42.023270] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:31:42.036168] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-29T17:31:42.036278] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-29T17:31:42.038241] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-29T17:31:42.038154] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T17:31:42.038490] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-29T17:31:42.407309] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:31:42.793566] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-29T17:31:43.282540] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:31:43.466772] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T17:31:43.593610] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-29T17:31:44.393554] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-29T17:31:44.465953] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-29T17:31:45.193607] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-29T17:31:45.721668] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:31:45.795274] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T17:31:45.993589] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-29T17:31:46.793554] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-29T17:31:47.281748] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T17:31:47.300958] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T17:31:47.593574] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-29T17:31:48.191584] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-29T17:31:48.393589] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-29T17:31:49.069115] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-29T17:31:49.193556] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-29T17:31:49.999376] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-29T17:31:50.004592] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T17:31:50.683798] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-29T17:31:50.793622] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-29T17:31:51.548998] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T17:31:51.593722] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-29T17:31:52.148311] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-29T17:31:52.393682] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-29T17:31:53.010635] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T17:31:53.193558] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-29T17:31:53.679902] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-29T17:31:53.993571] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-29T17:31:54.793566] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-29T17:31:55.246791] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T17:31:55.416139] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-29T17:31:55.593527] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-29T17:31:56.187163] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T17:31:56.393620] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-29T17:31:56.969000] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-29T17:31:57.193593] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-29T17:31:57.970266] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T17:31:57.993585] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-29T17:31:58.682005] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T17:31:58.793564] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-29T17:31:59.593630] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-29T17:32:00.091335] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T17:32:00.114830] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-29T17:32:00.393564] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-29T17:32:01.091611] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T17:32:01.193555] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-29T17:32:01.993615] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-29T17:32:02.237086] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T17:32:02.241593] [INFO ] [REMOTE ] BGB: Full fetch complete (26225 records). [2025-10-29T17:32:02.241785] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-29T17:32:02.242430] [FATAL] [VALIDATOR ] BGB: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:32:02.242526] [FATAL] [MAIN ] BGB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:32:02.242573] [WARN ] [MAIN ] BGB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:32:02.242618] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-29T17:32:02.242720] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-29T17:32:02.242771] [INFO ] [LOCAL ] BGB: Starting deletion of derivative data. [2025-10-29T17:32:02.242815] [DEBUG] [LOCAL ] BGB: No derivative data file found to delete. [2025-10-29T17:32:02.242878] [INFO ] [MAIN ] Update Progress: 259/2367 symbols completed. BGB took 24.9s. Estimated remaining: 4h 20m 25s. Rate: 8.1 symbols/min [2025-10-29T17:32:02.429321] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:02.429557] [DEBUG] [LOCAL ] BGS: No existing data file found in primary storage. [2025-10-29T17:32:02.429597] [WARN ] [MAIN ] BGS: No existing data found, performing full refresh instead. [2025-10-29T17:32:02.429750] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-29T17:32:02.429794] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-29T17:32:02.429837] [DEBUG] [LOCAL ] BGS: No primary data file found to delete. [2025-10-29T17:32:02.429870] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-29T17:32:02.795040] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-29T17:32:02.827416] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:02.838732] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T17:32:03.593553] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-29T17:32:04.077974] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T17:32:04.393611] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-29T17:32:04.838506] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T17:32:05.193601] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-29T17:32:05.824851] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-29T17:32:05.841466] [INFO ] [REMOTE ] BG: Full fetch complete (73008 records). [2025-10-29T17:32:05.845587] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-29T17:32:05.846468] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T17:32:05.999974] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-29T17:32:06.269703] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-29T17:32:06.269814] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-29T17:32:06.270775] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-29T17:32:06.270858] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-29T17:32:06.272433] [DEBUG] [LOCAL ] BG: Trimmed 73008 records to 50335 (keeping 200 days of data) [2025-10-29T17:32:06.575224] [DEBUG] [LOCAL ] BG: Primary data saved (50335 records). [2025-10-29T17:32:06.575351] [INFO ] [MAIN ] BG: Full history saved. [2025-10-29T17:32:06.576126] [INFO ] [MAIN ] Update Progress: 260/2367 symbols completed. BG took 35.0s. Estimated remaining: 4h 19m 53s. Rate: 8.1 symbols/min [2025-10-29T17:32:06.754804] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:06.754994] [DEBUG] [LOCAL ] BGSF: No existing data file found in primary storage. [2025-10-29T17:32:06.755032] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-10-29T17:32:06.755141] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-29T17:32:06.755183] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-29T17:32:06.755225] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-10-29T17:32:06.755258] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-29T17:32:06.798710] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-29T17:32:07.151055] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:07.225360] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T17:32:07.344324] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-29T17:32:07.593555] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-29T17:32:08.043685] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T17:32:08.393569] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-29T17:32:08.670705] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-29T17:32:09.193553] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-29T17:32:09.584367] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-29T17:32:09.993562] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-29T17:32:10.351713] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-29T17:32:10.793546] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-29T17:32:11.593601] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-29T17:32:12.030594] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-29T17:32:12.174733] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T17:32:12.393596] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-29T17:32:13.193564] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-29T17:32:13.638038] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T17:32:13.885207] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T17:32:13.993571] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-29T17:32:14.711496] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-29T17:32:14.793541] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-29T17:32:15.393721] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T17:32:15.593601] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-29T17:32:16.259564] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-29T17:32:16.262754] [INFO ] [REMOTE ] BGR: Full fetch complete (19896 records). [2025-10-29T17:32:16.263019] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-29T17:32:16.406925] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-29T17:32:16.643708] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-29T17:32:16.643791] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-29T17:32:16.644164] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-29T17:32:16.644205] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-29T17:32:16.644824] [DEBUG] [LOCAL ] BGR: Trimmed 19896 records to 12968 (keeping 200 days of data) [2025-10-29T17:32:16.727117] [DEBUG] [LOCAL ] BGR: Primary data saved (12968 records). [2025-10-29T17:32:16.727300] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-29T17:32:16.727409] [INFO ] [MAIN ] Update Progress: 261/2367 symbols completed. BGR took 35.1s. Estimated remaining: 4h 20m 8s. Rate: 8.1 symbols/min [2025-10-29T17:32:16.912511] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:16.929040] [DEBUG] [LOCAL ] BGT: Loaded 15761 existing records from primary storage. [2025-10-29T17:32:16.929273] [INFO ] [MAIN ] BGT: Loaded 15761 existing records. [2025-10-29T17:32:17.111124] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:32:17.111320] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-29T17:32:17.111368] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-29T17:32:17.111521] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-29T17:32:17.111562] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-29T17:32:17.198737] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-29T17:32:17.482721] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:17.838916] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T17:32:17.993560] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-29T17:32:18.030317] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T17:32:18.034445] [INFO ] [REMOTE ] BGH: Full fetch complete (23032 records). [2025-10-29T17:32:18.034573] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-29T17:32:18.035132] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:32:18.035223] [FATAL] [MAIN ] BGH: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:32:18.035268] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:32:18.035336] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-29T17:32:18.035400] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-29T17:32:18.035436] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-10-29T17:32:18.035612] [DEBUG] [LOCAL ] BGH: Deleted derivative data file. [2025-10-29T17:32:18.035726] [INFO ] [MAIN ] Update Progress: 262/2367 symbols completed. BGH took 39.9s. Estimated remaining: 4h 19m 11s. Rate: 8.1 symbols/min [2025-10-29T17:32:18.220615] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:18.234385] [DEBUG] [LOCAL ] BGX: Loaded 10865 existing records from primary storage. [2025-10-29T17:32:18.234673] [INFO ] [MAIN ] BGX: Loaded 10865 existing records. [2025-10-29T17:32:18.437841] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:32:18.438056] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-29T17:32:18.438105] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-29T17:32:18.438251] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-29T17:32:18.438291] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-29T17:32:18.764422] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-29T17:32:18.805426] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-29T17:32:18.845710] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:19.287271] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T17:32:19.593553] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-29T17:32:20.393584] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-29T17:32:20.442639] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-29T17:32:20.721136] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-29T17:32:21.193590] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-29T17:32:21.993584] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-29T17:32:22.241229] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T17:32:22.793570] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-29T17:32:22.818486] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T17:32:23.593805] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-29T17:32:24.152062] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T17:32:24.178219] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-29T17:32:24.393583] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-29T17:32:25.193561] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-29T17:32:25.465213] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T17:32:25.993550] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-29T17:32:26.073108] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-29T17:32:26.076265] [INFO ] [REMOTE ] BGSF: Full fetch complete (9823 records). [2025-10-29T17:32:26.076334] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-29T17:32:26.436663] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-29T17:32:26.436748] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-29T17:32:26.436977] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-29T17:32:26.437014] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-29T17:32:26.437428] [DEBUG] [LOCAL ] BGSF: Trimmed 9823 records to 8354 (keeping 200 days of data) [2025-10-29T17:32:26.484486] [DEBUG] [LOCAL ] BGSF: Primary data saved (8354 records). [2025-10-29T17:32:26.484603] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-29T17:32:26.484702] [INFO ] [MAIN ] Update Progress: 263/2367 symbols completed. BGSF took 19.9s. Estimated remaining: 4h 19m 12s. Rate: 8.1 symbols/min [2025-10-29T17:32:26.653503] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:26.673881] [DEBUG] [LOCAL ] BGY: Loaded 21157 existing records from primary storage. [2025-10-29T17:32:26.674134] [INFO ] [MAIN ] BGY: Loaded 21157 existing records. [2025-10-29T17:32:26.798706] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-29T17:32:26.858370] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:32:26.858541] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-29T17:32:26.858589] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-29T17:32:26.858828] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-29T17:32:26.858886] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-29T17:32:27.227832] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:27.257234] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T17:32:27.455828] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-29T17:32:27.593576] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-29T17:32:28.393598] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-29T17:32:28.486953] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-29T17:32:28.875625] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-29T17:32:29.193681] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-29T17:32:29.713060] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-29T17:32:29.993608] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-29T17:32:30.793535] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-29T17:32:31.438444] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-29T17:32:31.522240] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T17:32:31.533249] [INFO ] [REMOTE ] BGS: Full fetch complete (72666 records). [2025-10-29T17:32:31.533412] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-29T17:32:31.598769] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-29T17:32:31.942448] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-29T17:32:31.942539] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-29T17:32:31.943355] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-29T17:32:31.943427] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-29T17:32:31.944885] [DEBUG] [LOCAL ] BGS: Trimmed 72666 records to 50465 (keeping 200 days of data) [2025-10-29T17:32:32.187801] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-29T17:32:32.275148] [DEBUG] [LOCAL ] BGS: Primary data saved (50465 records). [2025-10-29T17:32:32.275291] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-29T17:32:32.275363] [INFO ] [MAIN ] Update Progress: 264/2367 symbols completed. BGS took 30.0s. Estimated remaining: 4h 18m 52s. Rate: 8.1 symbols/min [2025-10-29T17:32:32.398695] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-29T17:32:32.443684] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:32.461066] [DEBUG] [LOCAL ] BH: Loaded 16681 existing records from primary storage. [2025-10-29T17:32:32.461301] [INFO ] [MAIN ] BH: Loaded 16681 existing records. [2025-10-29T17:32:32.636700] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:32:32.636939] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-29T17:32:32.637027] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-29T17:32:32.637274] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-29T17:32:32.637315] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-29T17:32:33.021011] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T17:32:33.066269] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:33.193581] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-29T17:32:33.799722] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-29T17:32:33.993596] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-29T17:32:34.498039] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-29T17:32:34.793547] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-29T17:32:35.498330] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-29T17:32:35.593581] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-29T17:32:36.112629] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T17:32:36.393571] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-29T17:32:36.887468] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-29T17:32:37.193559] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-29T17:32:37.883087] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T17:32:37.993615] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-29T17:32:38.793543] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-29T17:32:39.003354] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T17:32:39.439731] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-29T17:32:39.443368] [INFO ] [REMOTE ] BGX: Full fetch complete (16470 records). [2025-10-29T17:32:39.443445] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-29T17:32:39.598889] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-29T17:32:39.834769] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-29T17:32:39.834869] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-29T17:32:39.835245] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-29T17:32:39.835287] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-29T17:32:39.835883] [DEBUG] [LOCAL ] BGX: Trimmed 16470 records to 10899 (keeping 200 days of data) [2025-10-29T17:32:39.912609] [DEBUG] [LOCAL ] BGX: Primary data saved (10899 records). [2025-10-29T17:32:39.912786] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-29T17:32:39.912874] [INFO ] [MAIN ] Update Progress: 265/2367 symbols completed. BGX took 21.9s. Estimated remaining: 4h 18m 47s. Rate: 8.1 symbols/min [2025-10-29T17:32:40.099993] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:40.100164] [DEBUG] [LOCAL ] BHC: No existing data file found in primary storage. [2025-10-29T17:32:40.100201] [WARN ] [MAIN ] BHC: No existing data found, performing full refresh instead. [2025-10-29T17:32:40.100315] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-29T17:32:40.100357] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-29T17:32:40.100399] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-10-29T17:32:40.100433] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-29T17:32:40.394979] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-29T17:32:40.469684] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:40.486411] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T17:32:41.040026] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-29T17:32:41.193603] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-29T17:32:41.993596] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-29T17:32:42.388096] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T17:32:42.400688] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T17:32:42.793558] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-29T17:32:43.448917] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-29T17:32:43.593573] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-29T17:32:44.265281] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T17:32:44.393698] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-29T17:32:45.193581] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-29T17:32:45.463456] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T17:32:45.888563] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-29T17:32:45.993581] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-29T17:32:46.645492] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T17:32:46.793591] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-29T17:32:47.470379] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T17:32:47.593556] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-29T17:32:48.393603] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-29T17:32:48.729507] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T17:32:49.193599] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-29T17:32:49.277124] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T17:32:49.993573] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-29T17:32:50.313812] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T17:32:50.671823] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T17:32:50.793597] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-29T17:32:51.392442] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T17:32:51.593627] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-29T17:32:52.301138] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T17:32:52.393515] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-29T17:32:53.035402] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T17:32:53.193573] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-29T17:32:53.975285] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-29T17:32:53.979854] [INFO ] [REMOTE ] BGY: Full fetch complete (32719 records). [2025-10-29T17:32:53.979963] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-29T17:32:53.980486] [FATAL] [VALIDATOR ] BGY: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:32:53.980563] [FATAL] [MAIN ] BGY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:32:53.980629] [WARN ] [MAIN ] BGY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:32:53.980721] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-29T17:32:53.980783] [DEBUG] [LOCAL ] BGY: No primary data file found to delete. [2025-10-29T17:32:53.980831] [INFO ] [LOCAL ] BGY: Starting deletion of derivative data. [2025-10-29T17:32:53.980975] [DEBUG] [LOCAL ] BGY: Deleted derivative data file. [2025-10-29T17:32:53.981042] [INFO ] [MAIN ] Update Progress: 266/2367 symbols completed. BGY took 27.5s. Estimated remaining: 4h 19m 32s. Rate: 8.1 symbols/min [2025-10-29T17:32:53.998700] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-29T17:32:54.152864] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:54.174839] [DEBUG] [LOCAL ] BHE: Loaded 23133 existing records from primary storage. [2025-10-29T17:32:54.175096] [INFO ] [MAIN ] BHE: Loaded 23133 existing records. [2025-10-29T17:32:54.353961] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:32:54.354196] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-29T17:32:54.354243] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-29T17:32:54.354737] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-29T17:32:54.354795] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-29T17:32:54.706294] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:54.793584] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-29T17:32:55.405010] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T17:32:55.593527] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-29T17:32:55.669100] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T17:32:56.394833] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-29T17:32:56.397780] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-29T17:32:56.957555] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-29T17:32:57.193566] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-29T17:32:57.993530] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-29T17:32:58.038744] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T17:32:58.650212] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T17:32:58.653524] [INFO ] [REMOTE ] BGT: Full fetch complete (23676 records). [2025-10-29T17:32:58.653604] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-29T17:32:58.654114] [FATAL] [VALIDATOR ] BGT: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:32:58.654201] [FATAL] [MAIN ] BGT: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:32:58.654245] [WARN ] [MAIN ] BGT: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:32:58.654290] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-29T17:32:58.654410] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-10-29T17:32:58.654473] [INFO ] [LOCAL ] BGT: Starting deletion of derivative data. [2025-10-29T17:32:58.654677] [DEBUG] [LOCAL ] BGT: Deleted derivative data file. [2025-10-29T17:32:58.654782] [INFO ] [MAIN ] Update Progress: 267/2367 symbols completed. BGT took 41.9s. Estimated remaining: 4h 19m 3s. Rate: 8.1 symbols/min [2025-10-29T17:32:58.800097] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-29T17:32:58.828028] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:32:58.851506] [DEBUG] [LOCAL ] BHK: Loaded 24002 existing records from primary storage. [2025-10-29T17:32:58.851807] [INFO ] [MAIN ] BHK: Loaded 24002 existing records. [2025-10-29T17:32:59.056388] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:32:59.056621] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-29T17:32:59.056701] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-29T17:32:59.057165] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-29T17:32:59.057222] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-29T17:32:59.409569] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:32:59.593520] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-29T17:32:59.777126] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T17:33:00.161313] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T17:33:00.393574] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-29T17:33:01.193557] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-29T17:33:01.238531] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-29T17:33:01.801074] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T17:33:01.993608] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-29T17:33:02.561977] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T17:33:02.793576] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-29T17:33:03.593571] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-29T17:33:03.867613] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T17:33:04.276857] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-29T17:33:04.393568] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-29T17:33:05.108578] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T17:33:05.193539] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-29T17:33:05.850423] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-29T17:33:05.993555] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-29T17:33:06.750604] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-29T17:33:06.793549] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-29T17:33:07.599855] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-29T17:33:07.616841] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T17:33:08.254320] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-29T17:33:08.393559] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-29T17:33:09.193562] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-29T17:33:09.221282] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-29T17:33:09.993609] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-29T17:33:10.462993] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T17:33:10.765609] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-29T17:33:10.793509] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-29T17:33:11.546470] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-29T17:33:11.593548] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-29T17:33:12.393608] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-29T17:33:12.433084] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-29T17:33:13.194072] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-29T17:33:13.197831] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-29T17:33:13.993573] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-29T17:33:14.520605] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T17:33:14.755124] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T17:33:14.793602] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-29T17:33:15.466278] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T17:33:15.593601] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-29T17:33:16.329479] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-29T17:33:16.393611] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-29T17:33:17.193576] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-29T17:33:17.543277] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T17:33:17.993605] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-29T17:33:18.567073] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T17:33:18.572685] [INFO ] [REMOTE ] BHE: Full fetch complete (36347 records). [2025-10-29T17:33:18.572885] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-29T17:33:18.802768] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-29T17:33:19.025214] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-29T17:33:19.025362] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-29T17:33:19.026163] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-29T17:33:19.026234] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-29T17:33:19.027563] [DEBUG] [LOCAL ] BHE: Trimmed 36347 records to 23159 (keeping 200 days of data) [2025-10-29T17:33:19.184056] [DEBUG] [LOCAL ] BHE: Primary data saved (23159 records). [2025-10-29T17:33:19.184238] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-29T17:33:19.184340] [INFO ] [MAIN ] Update Progress: 268/2367 symbols completed. BHE took 25.2s. Estimated remaining: 4h 20m 39s. Rate: 8.1 symbols/min [2025-10-29T17:33:19.386902] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:33:19.414636] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-29T17:33:19.424595] [INFO ] [REMOTE ] BHC: Full fetch complete (67309 records). [2025-10-29T17:33:19.424813] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-29T17:33:19.425837] [FATAL] [VALIDATOR ] BHC: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:33:19.425971] [FATAL] [MAIN ] BHC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:33:19.426023] [WARN ] [MAIN ] BHC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:33:19.426088] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-29T17:33:19.426157] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-10-29T17:33:19.426241] [INFO ] [LOCAL ] BHC: Starting deletion of derivative data. [2025-10-29T17:33:19.426405] [DEBUG] [LOCAL ] BHC: No derivative data file found to delete. [2025-10-29T17:33:19.426475] [INFO ] [MAIN ] Update Progress: 269/2367 symbols completed. BHC took 39.5s. Estimated remaining: 4h 19m 35s. Rate: 8.1 symbols/min [2025-10-29T17:33:19.597380] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-29T17:33:19.601036] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:33:19.618344] [DEBUG] [LOCAL ] BHR: No existing data file found in primary storage. [2025-10-29T17:33:19.618525] [WARN ] [MAIN ] BHR: No existing data found, performing full refresh instead. [2025-10-29T17:33:19.618690] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-29T17:33:19.618747] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-29T17:33:19.618791] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-29T17:33:19.618824] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-29T17:33:19.774963] [DEBUG] [LOCAL ] BHP: Loaded 53359 existing records from primary storage. [2025-10-29T17:33:19.834405] [INFO ] [MAIN ] BHP: Loaded 53359 existing records. [2025-10-29T17:33:20.091370] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T17:33:20.214614] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:33:20.307356] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:33:20.307694] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-29T17:33:20.307760] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-29T17:33:20.308626] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-29T17:33:20.308735] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-29T17:33:20.398725] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-29T17:33:20.584514] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T17:33:20.626053] [INFO ] [REMOTE ] BH: Full fetch complete (19629 records). [2025-10-29T17:33:20.634961] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-29T17:33:20.834044] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:33:21.118701] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-29T17:33:21.118816] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-29T17:33:21.119342] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-29T17:33:21.119386] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-29T17:33:21.120146] [DEBUG] [LOCAL ] BH: Trimmed 19629 records to 16708 (keeping 200 days of data) [2025-10-29T17:33:21.200303] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-29T17:33:21.239864] [DEBUG] [LOCAL ] BH: Primary data saved (16708 records). [2025-10-29T17:33:21.240194] [INFO ] [MAIN ] BH: Full history saved. [2025-10-29T17:33:21.240312] [INFO ] [MAIN ] Update Progress: 270/2367 symbols completed. BH took 49.0s. Estimated remaining: 4h 18m 44s. Rate: 8.1 symbols/min [2025-10-29T17:33:21.463137] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T17:33:21.486515] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:33:21.493120] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-29T17:33:21.493184] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-29T17:33:21.493350] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-29T17:33:21.493394] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-29T17:33:21.493438] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-29T17:33:21.493474] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-29T17:33:21.896078] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:33:21.993540] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-29T17:33:22.361352] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-29T17:33:22.793544] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-29T17:33:22.836285] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-29T17:33:23.070909] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-29T17:33:23.593631] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-29T17:33:24.393737] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-29T17:33:24.956198] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T17:33:24.992051] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-29T17:33:25.193584] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-29T17:33:25.461848] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-29T17:33:25.993586] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-29T17:33:26.257473] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-29T17:33:26.793587] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-29T17:33:27.038150] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-29T17:33:27.593602] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-29T17:33:28.335951] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T17:33:28.393569] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-29T17:33:29.193551] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-29T17:33:29.233899] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T17:33:29.981933] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-29T17:33:29.993514] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-29T17:33:30.790820] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-29T17:33:30.795683] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-29T17:33:31.593616] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-29T17:33:31.823431] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-29T17:33:31.829838] [INFO ] [REMOTE ] BHK: Full fetch complete (30678 records). [2025-10-29T17:33:31.830115] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-29T17:33:31.831101] [FATAL] [VALIDATOR ] BHK: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:33:31.831213] [FATAL] [MAIN ] BHK: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:33:31.831275] [WARN ] [MAIN ] BHK: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:33:31.831342] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-29T17:33:31.831437] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-29T17:33:31.831499] [INFO ] [LOCAL ] BHK: Starting deletion of derivative data. [2025-10-29T17:33:31.831891] [DEBUG] [LOCAL ] BHK: Deleted derivative data file. [2025-10-29T17:33:31.832023] [INFO ] [MAIN ] Update Progress: 271/2367 symbols completed. BHK took 33.2s. Estimated remaining: 4h 19m 1s. Rate: 8.1 symbols/min [2025-10-29T17:33:32.092128] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:33:32.162348] [DEBUG] [LOCAL ] BHVN: Loaded 50589 existing records from primary storage. [2025-10-29T17:33:32.162877] [INFO ] [MAIN ] BHVN: Loaded 50589 existing records. [2025-10-29T17:33:32.367733] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:33:32.380899] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-29T17:33:32.381067] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-29T17:33:32.382184] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T17:33:32.386901] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-29T17:33:32.387832] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-29T17:33:32.399477] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-29T17:33:32.762862] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:33:33.087103] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T17:33:33.193572] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-29T17:33:33.519786] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-29T17:33:33.993628] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-29T17:33:34.793552] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-29T17:33:35.086981] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-29T17:33:35.593542] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-29T17:33:35.811135] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-29T17:33:36.263694] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-29T17:33:36.393570] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-29T17:33:37.198778] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-29T17:33:37.215016] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T17:33:37.481038] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-29T17:33:37.993575] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-29T17:33:38.793584] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-29T17:33:39.084358] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-29T17:33:39.180383] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T17:33:39.593560] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-29T17:33:39.918610] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-29T17:33:39.919475] [INFO ] [REMOTE ] BHV: Full fetch complete (1421 records). [2025-10-29T17:33:39.919541] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-29T17:33:40.098395] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-29T17:33:40.098587] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:33:40.098633] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:33:40.098722] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-29T17:33:40.098785] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-29T17:33:40.098821] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-29T17:33:40.098860] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-29T17:33:40.098915] [INFO ] [MAIN ] Update Progress: 272/2367 symbols completed. BHV took 18.9s. Estimated remaining: 4h 19m 0s. Rate: 8.1 symbols/min [2025-10-29T17:33:40.271095] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:33:40.324386] [DEBUG] [LOCAL ] BILL: Loaded 52480 existing records from primary storage. [2025-10-29T17:33:40.324801] [INFO ] [MAIN ] BILL: Loaded 52480 existing records. [2025-10-29T17:33:40.398689] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-29T17:33:40.515965] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:33:40.516166] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-29T17:33:40.516238] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-29T17:33:40.516887] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-29T17:33:40.516943] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-29T17:33:40.884306] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:33:41.193593] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-29T17:33:41.434235] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T17:33:41.993614] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-29T17:33:42.593409] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T17:33:42.793563] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-29T17:33:43.044935] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-29T17:33:43.050235] [INFO ] [REMOTE ] BHR: Full fetch complete (30929 records). [2025-10-29T17:33:43.050311] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-29T17:33:43.050834] [FATAL] [VALIDATOR ] BHR: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:33:43.050914] [FATAL] [MAIN ] BHR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:33:43.050955] [WARN ] [MAIN ] BHR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:33:43.051020] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-29T17:33:43.051080] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-29T17:33:43.051114] [INFO ] [LOCAL ] BHR: Starting deletion of derivative data. [2025-10-29T17:33:43.051152] [DEBUG] [LOCAL ] BHR: No derivative data file found to delete. [2025-10-29T17:33:43.051202] [INFO ] [MAIN ] Update Progress: 273/2367 symbols completed. BHR took 23.6s. Estimated remaining: 4h 18m 19s. Rate: 8.1 symbols/min [2025-10-29T17:33:43.218325] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:33:43.218482] [DEBUG] [LOCAL ] BIO: No existing data file found in primary storage. [2025-10-29T17:33:43.218520] [WARN ] [MAIN ] BIO: No existing data found, performing full refresh instead. [2025-10-29T17:33:43.218630] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-29T17:33:43.218708] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-29T17:33:43.218761] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-29T17:33:43.218795] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-29T17:33:43.574700] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:33:43.593572] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-29T17:33:44.016099] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T17:33:44.393575] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-29T17:33:45.063267] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-29T17:33:45.193618] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-29T17:33:45.670412] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T17:33:45.993558] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-29T17:33:46.104544] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-29T17:33:46.793568] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-29T17:33:47.416728] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T17:33:47.593551] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-29T17:33:47.807109] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T17:33:48.393571] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-29T17:33:49.107950] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T17:33:49.193523] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-29T17:33:49.238926] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T17:33:49.993563] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-29T17:33:50.637959] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T17:33:50.793585] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-29T17:33:51.336914] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T17:33:51.593527] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-29T17:33:51.727964] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-29T17:33:52.393607] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-29T17:33:53.193542] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-29T17:33:53.245292] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-29T17:33:53.328233] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-29T17:33:53.993635] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-29T17:33:54.501717] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T17:33:54.736085] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-29T17:33:54.793572] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-29T17:33:55.593579] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-29T17:33:56.183806] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T17:33:56.393597] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-29T17:33:56.595258] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T17:33:57.193575] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-29T17:33:57.397993] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T17:33:57.993570] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-29T17:33:58.793573] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-29T17:33:58.913798] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-29T17:33:58.929601] [INFO ] [REMOTE ] BHP: Full fetch complete (77052 records). [2025-10-29T17:33:58.929828] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-29T17:33:58.930785] [FATAL] [VALIDATOR ] BHP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:33:58.930870] [FATAL] [MAIN ] BHP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:33:58.930915] [WARN ] [MAIN ] BHP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:33:58.930969] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-29T17:33:58.931049] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-29T17:33:58.931087] [INFO ] [LOCAL ] BHP: Starting deletion of derivative data. [2025-10-29T17:33:58.931307] [DEBUG] [LOCAL ] BHP: Deleted derivative data file. [2025-10-29T17:33:58.931866] [INFO ] [MAIN ] Update Progress: 274/2367 symbols completed. BHP took 39.7s. Estimated remaining: 4h 19m 16s. Rate: 8.1 symbols/min [2025-10-29T17:33:59.113738] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:33:59.150497] [DEBUG] [LOCAL ] BIP: Loaded 38427 existing records from primary storage. [2025-10-29T17:33:59.150831] [INFO ] [MAIN ] BIP: Loaded 38427 existing records. [2025-10-29T17:33:59.330913] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:33:59.331264] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-29T17:33:59.331337] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-29T17:33:59.331938] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-29T17:33:59.331999] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-29T17:33:59.480227] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T17:33:59.598701] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-29T17:33:59.803596] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:33:59.820690] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T17:34:00.393559] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-29T17:34:01.060220] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-29T17:34:01.193574] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-29T17:34:01.291549] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-29T17:34:01.993577] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-29T17:34:02.740945] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T17:34:02.793538] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-29T17:34:03.393078] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T17:34:03.593552] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-29T17:34:04.116297] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T17:34:04.393559] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-29T17:34:04.934346] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T17:34:05.069818] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T17:34:05.193572] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-29T17:34:05.993596] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-29T17:34:06.681711] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T17:34:06.693208] [INFO ] [REMOTE ] BHVN: Full fetch complete (70884 records). [2025-10-29T17:34:06.693389] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-29T17:34:06.793673] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-29T17:34:07.077463] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-29T17:34:07.077542] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-29T17:34:07.078282] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-29T17:34:07.078345] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-29T17:34:07.079624] [DEBUG] [LOCAL ] BHVN: Trimmed 70884 records to 50607 (keeping 200 days of data) [2025-10-29T17:34:07.377631] [DEBUG] [LOCAL ] BHVN: Primary data saved (50607 records). [2025-10-29T17:34:07.377792] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-29T17:34:07.377880] [INFO ] [MAIN ] Update Progress: 275/2367 symbols completed. BHVN took 35.5s. Estimated remaining: 4h 19m 16s. Rate: 8.1 symbols/min [2025-10-29T17:34:07.550962] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:34:07.551200] [DEBUG] [LOCAL ] BIPC: No existing data file found in primary storage. [2025-10-29T17:34:07.551286] [WARN ] [MAIN ] BIPC: No existing data found, performing full refresh instead. [2025-10-29T17:34:07.551536] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-29T17:34:07.551608] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-29T17:34:07.551722] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-29T17:34:07.551882] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-29T17:34:07.607420] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-29T17:34:07.848419] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-29T17:34:07.973543] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:34:07.986467] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T17:34:07.991114] [INFO ] [REMOTE ] BIO: Full fetch complete (34878 records). [2025-10-29T17:34:07.991193] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-29T17:34:08.366227] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-29T17:34:08.366309] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-29T17:34:08.366797] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-29T17:34:08.366858] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-29T17:34:08.367719] [DEBUG] [LOCAL ] BIO: Trimmed 34878 records to 23392 (keeping 200 days of data) [2025-10-29T17:34:08.416680] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-29T17:34:08.503780] [DEBUG] [LOCAL ] BIO: Primary data saved (23392 records). [2025-10-29T17:34:08.503899] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-29T17:34:08.503966] [INFO ] [MAIN ] Update Progress: 276/2367 symbols completed. BIO took 25.5s. Estimated remaining: 4h 18m 21s. Rate: 8.1 symbols/min [2025-10-29T17:34:08.675447] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:34:08.680139] [DEBUG] [LOCAL ] BIPH: Loaded 2221 existing records from primary storage. [2025-10-29T17:34:08.680279] [INFO ] [MAIN ] BIPH: Loaded 2221 existing records. [2025-10-29T17:34:08.871254] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:34:08.871615] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-29T17:34:08.871765] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-29T17:34:08.872044] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-29T17:34:08.872178] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-29T17:34:08.987533] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T17:34:09.198911] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-29T17:34:09.296608] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:34:09.837085] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-29T17:34:09.993544] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-29T17:34:10.170078] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T17:34:10.793586] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-29T17:34:11.342030] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T17:34:11.593599] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-29T17:34:11.794757] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:34:12.393626] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-29T17:34:12.527025] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-29T17:34:13.193582] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-29T17:34:13.500901] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T17:34:13.633397] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T17:34:13.993590] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-29T17:34:14.793600] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-29T17:34:15.162404] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T17:34:15.593572] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-29T17:34:16.354735] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T17:34:16.365885] [INFO ] [REMOTE ] BILL: Full fetch complete (76126 records). [2025-10-29T17:34:16.366047] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-29T17:34:16.398758] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-29T17:34:16.771763] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-29T17:34:16.771899] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-29T17:34:16.772773] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-29T17:34:16.772996] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-29T17:34:16.774715] [DEBUG] [LOCAL ] BILL: Trimmed 76126 records to 52491 (keeping 200 days of data) [2025-10-29T17:34:16.923107] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T17:34:17.127325] [DEBUG] [LOCAL ] BILL: Primary data saved (52491 records). [2025-10-29T17:34:17.127469] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-29T17:34:17.127547] [INFO ] [MAIN ] Update Progress: 277/2367 symbols completed. BILL took 37.0s. Estimated remaining: 4h 18m 23s. Rate: 8.1 symbols/min [2025-10-29T17:34:17.193610] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-29T17:34:17.553707] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T17:34:17.993627] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-29T17:34:18.132461] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-29T17:34:18.793739] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-29T17:34:19.031008] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T17:34:19.593541] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-29T17:34:19.768060] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-29T17:34:20.393561] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-29T17:34:20.549624] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T17:34:21.193588] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-29T17:34:21.515260] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T17:34:21.566433] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T17:34:21.993679] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-29T17:34:22.793602] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-29T17:34:23.036069] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-29T17:34:23.593604] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-29T17:34:23.744512] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T17:34:23.991281] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T17:34:24.393683] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-29T17:34:24.742831] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-29T17:34:25.193671] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-29T17:34:25.523687] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T17:34:25.993618] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-29T17:34:26.255798] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-29T17:34:26.793582] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-29T17:34:27.593845] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-29T17:34:27.887547] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T17:34:28.393631] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-29T17:34:28.569731] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T17:34:28.679022] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-29T17:34:29.193601] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-29T17:34:29.993608] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-29T17:34:30.439128] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T17:34:30.448687] [INFO ] [REMOTE ] BIPC: Full fetch complete (60165 records). [2025-10-29T17:34:30.448879] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-29T17:34:30.794915] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-29T17:34:30.901599] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-29T17:34:30.901741] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-29T17:34:30.902812] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-29T17:34:30.902881] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-29T17:34:30.904673] [DEBUG] [LOCAL ] BIPC: Trimmed 60165 records to 40652 (keeping 200 days of data) [2025-10-29T17:34:31.145943] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-29T17:34:31.196146] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T17:34:31.222147] [DEBUG] [LOCAL ] BIPC: Primary data saved (40652 records). [2025-10-29T17:34:31.222330] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-29T17:34:31.222416] [INFO ] [MAIN ] Update Progress: 278/2367 symbols completed. BIPC took 23.8s. Estimated remaining: 4h 19m 6s. Rate: 8.1 symbols/min [2025-10-29T17:34:31.593583] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-29T17:34:32.393704] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-29T17:34:32.695350] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T17:34:32.812968] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T17:34:32.822432] [INFO ] [REMOTE ] BIP: Full fetch complete (57831 records). [2025-10-29T17:34:32.822609] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-29T17:34:33.198816] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-29T17:34:33.303182] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-29T17:34:33.303308] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-29T17:34:33.304290] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-29T17:34:33.304355] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-29T17:34:33.306288] [DEBUG] [LOCAL ] BIP: Trimmed 57831 records to 38444 (keeping 200 days of data) [2025-10-29T17:34:33.556920] [DEBUG] [LOCAL ] BIP: Primary data saved (38444 records). [2025-10-29T17:34:33.557120] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-29T17:34:33.557222] [INFO ] [MAIN ] Update Progress: 279/2367 symbols completed. BIP took 34.6s. Estimated remaining: 4h 18m 20s. Rate: 8.1 symbols/min [2025-10-29T17:34:33.656437] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-29T17:34:33.657663] [INFO ] [REMOTE ] BIPH: Full fetch complete (3573 records). [2025-10-29T17:34:33.657740] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-29T17:34:34.032305] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-29T17:34:34.032405] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-29T17:34:34.032633] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-29T17:34:34.032746] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-29T17:34:34.033136] [DEBUG] [LOCAL ] BIPH: Trimmed 3573 records to 2080 (keeping 200 days of data) [2025-10-29T17:34:34.046127] [DEBUG] [LOCAL ] BIPH: Primary data saved (2080 records). [2025-10-29T17:34:34.046189] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-29T17:34:34.046265] [INFO ] [MAIN ] Update Progress: 280/2367 symbols completed. BIPH took 25.5s. Estimated remaining: 4h 17m 21s. Rate: 8.1 symbols/min [2025-10-29T17:34:34.753681] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:34:34.805144] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:34:34.801681] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:34:34.859706] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:34:34.860274] [DEBUG] [LOCAL ] BIT: No existing data file found in primary storage. [2025-10-29T17:34:34.860336] [WARN ] [MAIN ] BIT: No existing data found, performing full refresh instead. [2025-10-29T17:34:34.860471] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-29T17:34:34.860553] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-29T17:34:34.861930] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-10-29T17:34:34.862305] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-29T17:34:34.915563] [DEBUG] [LOCAL ] BIPI: Loaded 2702 existing records from primary storage. [2025-10-29T17:34:34.947134] [INFO ] [MAIN ] BIPI: Loaded 2702 existing records. [2025-10-29T17:34:34.930686] [DEBUG] [LOCAL ] BIPJ: Loaded 3000 existing records from primary storage. [2025-10-29T17:34:34.952688] [INFO ] [MAIN ] BIPJ: Loaded 3000 existing records. [2025-10-29T17:34:35.498398] [DEBUG] [LOCAL ] BIRK: Loaded 51067 existing records from primary storage. [2025-10-29T17:34:35.619561] [INFO ] [MAIN ] BIRK: Loaded 51067 existing records. [2025-10-29T17:34:35.628870] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:34:35.717285] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-29T17:34:35.641287] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:34:35.727959] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-29T17:34:35.738360] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-29T17:34:35.823539] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-29T17:34:35.853139] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-29T17:34:35.853220] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-29T17:34:35.857021] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-29T17:34:35.856968] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:34:35.877828] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-29T17:34:35.878197] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-29T17:34:36.221197] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:34:36.243509] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-29T17:34:36.290602] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-29T17:34:36.416751] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-29T17:34:36.501812] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-29T17:34:36.882565] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:34:36.901331] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-29T17:34:36.936922] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:34:36.964070] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-29T17:34:37.008355] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T17:34:37.088225] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-29T17:34:37.250327] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:34:37.250793] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-29T17:34:37.427762] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-29T17:34:37.482821] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T17:34:37.854600] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T17:34:37.993609] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-29T17:34:38.261204] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T17:34:38.706681] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-29T17:34:38.793592] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-29T17:34:39.593759] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-29T17:34:39.903492] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:34:40.044505] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-29T17:34:40.393682] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-29T17:34:41.098273] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T17:34:41.193623] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-29T17:34:41.993610] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-29T17:34:42.285088] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-29T17:34:42.532005] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T17:34:42.793583] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-29T17:34:43.593589] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-29T17:34:43.919260] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-29T17:34:43.965805] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T17:34:44.393580] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-29T17:34:45.193580] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-29T17:34:45.649560] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T17:34:45.993603] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-29T17:34:46.042602] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-29T17:34:46.793599] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-29T17:34:47.101314] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T17:34:47.591127] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T17:34:47.595717] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-29T17:34:48.393626] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-29T17:34:48.743347] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-29T17:34:49.197384] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-29T17:34:49.207148] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-29T17:34:49.572369] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-29T17:34:49.993575] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-29T17:34:50.666501] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-29T17:34:50.793585] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-29T17:34:51.177227] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T17:34:51.593578] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-29T17:34:51.892460] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-29T17:34:52.393582] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-29T17:34:52.716329] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-29T17:34:53.193579] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-29T17:34:53.993598] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-29T17:34:54.068177] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-29T17:34:54.336507] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-29T17:34:54.793589] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-29T17:34:55.593579] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-29T17:34:55.965865] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-29T17:34:56.017297] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T17:34:56.393586] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-29T17:34:57.193538] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-29T17:34:57.246754] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-29T17:34:57.993584] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-29T17:34:58.348337] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T17:34:58.793576] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-29T17:34:58.967416] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-29T17:34:58.974449] [INFO ] [REMOTE ] BIT: Full fetch complete (32427 records). [2025-10-29T17:34:58.974699] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-29T17:34:59.412704] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-29T17:34:59.412832] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-29T17:34:59.413606] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-29T17:34:59.413712] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-29T17:34:59.415089] [DEBUG] [LOCAL ] BIT: Trimmed 32427 records to 23617 (keeping 200 days of data) [2025-10-29T17:34:59.569669] [DEBUG] [LOCAL ] BIT: Primary data saved (23617 records). [2025-10-29T17:34:59.569856] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-29T17:34:59.569942] [INFO ] [MAIN ] Update Progress: 281/2367 symbols completed. BIT took 25.5s. Estimated remaining: 4h 19m 28s. Rate: 8.0 symbols/min [2025-10-29T17:34:59.603326] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-29T17:34:59.769296] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:34:59.832701] [DEBUG] [LOCAL ] BJ: Loaded 51394 existing records from primary storage. [2025-10-29T17:34:59.833291] [INFO ] [MAIN ] BJ: Loaded 51394 existing records. [2025-10-29T17:35:00.026398] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:35:00.026744] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-29T17:35:00.026804] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-29T17:35:00.027806] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-29T17:35:00.027867] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-29T17:35:00.232710] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T17:35:00.398786] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-29T17:35:00.437474] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:35:00.480593] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-29T17:35:00.493155] [INFO ] [REMOTE ] BIRK: Full fetch complete (73472 records). [2025-10-29T17:35:00.493409] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-29T17:35:00.920363] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-29T17:35:00.920497] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-29T17:35:00.921670] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-29T17:35:00.921783] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-29T17:35:00.924539] [DEBUG] [LOCAL ] BIRK: Trimmed 73472 records to 51054 (keeping 200 days of data) [2025-10-29T17:35:01.031021] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T17:35:01.195711] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-29T17:35:01.274116] [DEBUG] [LOCAL ] BIRK: Primary data saved (51054 records). [2025-10-29T17:35:01.274331] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-29T17:35:01.274466] [INFO ] [MAIN ] Update Progress: 282/2367 symbols completed. BIRK took 27.2s. Estimated remaining: 4h 18m 38s. Rate: 8.1 symbols/min [2025-10-29T17:35:01.472637] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:35:01.529179] [DEBUG] [LOCAL ] BK: Loaded 53534 existing records from primary storage. [2025-10-29T17:35:01.529587] [INFO ] [MAIN ] BK: Loaded 53534 existing records. [2025-10-29T17:35:01.656427] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T17:35:01.750949] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:35:01.751442] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-29T17:35:01.751495] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-29T17:35:01.752812] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-29T17:35:01.752886] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-29T17:35:02.002430] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-29T17:35:02.198956] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:35:02.561050] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-29T17:35:02.562516] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4099 records). [2025-10-29T17:35:02.562615] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-29T17:35:02.798877] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-29T17:35:02.971753] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-29T17:35:02.971861] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-29T17:35:02.972103] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-29T17:35:02.972182] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-29T17:35:02.972606] [DEBUG] [LOCAL ] BIPJ: Trimmed 4099 records to 2933 (keeping 200 days of data) [2025-10-29T17:35:02.992546] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2933 records). [2025-10-29T17:35:02.992759] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-29T17:35:02.992871] [INFO ] [MAIN ] Update Progress: 283/2367 symbols completed. BIPJ took 28.9s. Estimated remaining: 4h 17m 48s. Rate: 8.1 symbols/min [2025-10-29T17:35:03.189625] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:35:03.240184] [DEBUG] [LOCAL ] BKD: Loaded 50272 existing records from primary storage. [2025-10-29T17:35:03.240631] [INFO ] [MAIN ] BKD: Loaded 50272 existing records. [2025-10-29T17:35:03.435888] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:35:03.436211] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-29T17:35:03.436265] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-29T17:35:03.436771] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-29T17:35:03.436834] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-29T17:35:03.598790] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-29T17:35:03.824288] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:35:04.001007] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-29T17:35:04.345236] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T17:35:04.393702] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-29T17:35:04.748892] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T17:35:05.193594] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-29T17:35:05.522970] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T17:35:05.993586] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-29T17:35:06.793588] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-29T17:35:07.235197] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-29T17:35:07.236705] [INFO ] [REMOTE ] BIPI: Full fetch complete (4480 records). [2025-10-29T17:35:07.236850] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-29T17:35:07.415712] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-29T17:35:07.598681] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-29T17:35:07.686517] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-29T17:35:07.686616] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-29T17:35:07.686932] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-29T17:35:07.687078] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-29T17:35:07.687576] [DEBUG] [LOCAL ] BIPI: Trimmed 4480 records to 2673 (keeping 200 days of data) [2025-10-29T17:35:07.705860] [DEBUG] [LOCAL ] BIPI: Primary data saved (2673 records). [2025-10-29T17:35:07.706084] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-29T17:35:07.706195] [INFO ] [MAIN ] Update Progress: 284/2367 symbols completed. BIPI took 33.7s. Estimated remaining: 4h 17m 21s. Rate: 8.1 symbols/min [2025-10-29T17:35:07.898324] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:35:07.935026] [DEBUG] [LOCAL ] BKE: Loaded 33084 existing records from primary storage. [2025-10-29T17:35:07.935412] [INFO ] [MAIN ] BKE: Loaded 33084 existing records. [2025-10-29T17:35:08.131828] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:35:08.132148] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-29T17:35:08.132208] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-29T17:35:08.132851] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-29T17:35:08.132912] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-29T17:35:08.404698] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-29T17:35:08.581262] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:35:08.820907] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T17:35:09.193575] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-29T17:35:09.716024] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T17:35:09.993592] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-29T17:35:10.575119] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T17:35:10.793585] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-29T17:35:11.133185] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T17:35:11.593692] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-29T17:35:11.765805] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T17:35:12.393628] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-29T17:35:12.754153] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T17:35:13.193676] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-29T17:35:13.735131] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T17:35:13.993610] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-29T17:35:14.449972] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T17:35:14.793686] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-29T17:35:15.428821] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T17:35:15.593600] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-29T17:35:16.047554] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T17:35:16.393619] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-29T17:35:16.759662] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T17:35:17.193614] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-29T17:35:17.849310] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-29T17:35:17.993615] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-29T17:35:18.399300] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T17:35:18.793593] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-29T17:35:19.003278] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T17:35:19.593596] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-29T17:35:20.089430] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:35:20.393580] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-29T17:35:20.892149] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:35:21.193559] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-29T17:35:21.323582] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T17:35:21.993632] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-29T17:35:22.431111] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T17:35:22.793695] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-29T17:35:23.128549] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T17:35:23.597791] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-29T17:35:23.604434] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T17:35:24.393634] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-29T17:35:24.891209] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T17:35:25.193629] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-29T17:35:25.434233] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T17:35:25.993612] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-29T17:35:26.139042] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T17:35:26.793637] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-29T17:35:27.432548] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T17:35:27.593631] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-29T17:35:28.387671] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-29T17:35:28.398779] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-29T17:35:29.103205] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-29T17:35:29.193573] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-29T17:35:29.392279] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T17:35:29.993637] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-29T17:35:30.597190] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T17:35:30.793601] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-29T17:35:31.075665] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T17:35:31.593626] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-29T17:35:32.044540] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T17:35:32.393578] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-29T17:35:32.774610] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T17:35:33.193629] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-29T17:35:33.834043] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-29T17:35:33.847058] [INFO ] [REMOTE ] BJ: Full fetch complete (74348 records). [2025-10-29T17:35:33.847302] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-29T17:35:34.005338] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-29T17:35:34.302681] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-29T17:35:34.302972] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-29T17:35:34.304157] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-29T17:35:34.304292] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-29T17:35:34.328701] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T17:35:34.328901] [DEBUG] [LOCAL ] BJ: Trimmed 74348 records to 51365 (keeping 200 days of data) [2025-10-29T17:35:34.667901] [DEBUG] [LOCAL ] BJ: Primary data saved (51365 records). [2025-10-29T17:35:34.668098] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-29T17:35:34.669401] [INFO ] [MAIN ] Update Progress: 285/2367 symbols completed. BJ took 35.1s. Estimated remaining: 4h 19m 36s. Rate: 8.0 symbols/min [2025-10-29T17:35:34.808426] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-29T17:35:34.839147] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:35:34.879801] [DEBUG] [LOCAL ] BKH: Loaded 37298 existing records from primary storage. [2025-10-29T17:35:34.880064] [INFO ] [MAIN ] BKH: Loaded 37298 existing records. [2025-10-29T17:35:35.054572] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:35:35.054855] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-29T17:35:35.054908] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-29T17:35:35.055433] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-29T17:35:35.055475] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-29T17:35:35.421189] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:35:35.491406] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T17:35:35.593559] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-29T17:35:35.923876] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T17:35:35.930626] [INFO ] [REMOTE ] BKE: Full fetch complete (49796 records). [2025-10-29T17:35:35.930775] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-29T17:35:36.301410] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-29T17:35:36.301486] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-29T17:35:36.302072] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-29T17:35:36.302133] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-29T17:35:36.303110] [DEBUG] [LOCAL ] BKE: Trimmed 49796 records to 32985 (keeping 200 days of data) [2025-10-29T17:35:36.397381] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-29T17:35:36.516991] [DEBUG] [LOCAL ] BKE: Primary data saved (32985 records). [2025-10-29T17:35:36.517187] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-29T17:35:36.517300] [INFO ] [MAIN ] Update Progress: 286/2367 symbols completed. BKE took 28.8s. Estimated remaining: 4h 18m 48s. Rate: 8.0 symbols/min [2025-10-29T17:35:36.701832] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:35:36.724831] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T17:35:36.767370] [DEBUG] [LOCAL ] BKKT: Loaded 37975 existing records from primary storage. [2025-10-29T17:35:36.767830] [INFO ] [MAIN ] BKKT: Loaded 37975 existing records. [2025-10-29T17:35:36.962430] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:35:36.962917] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-29T17:35:36.962974] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-29T17:35:36.963603] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-29T17:35:36.963720] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-29T17:35:37.202482] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-29T17:35:37.346914] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:35:37.574814] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T17:35:37.993575] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-29T17:35:38.223259] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-29T17:35:38.793579] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-29T17:35:39.249535] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T17:35:39.593562] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-29T17:35:39.741604] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-29T17:35:40.393564] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-29T17:35:41.193531] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-29T17:35:41.238560] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T17:35:41.249510] [INFO ] [REMOTE ] BKD: Full fetch complete (72130 records). [2025-10-29T17:35:41.249682] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-29T17:35:41.589540] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T17:35:41.697501] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-29T17:35:41.697597] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-29T17:35:41.698414] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-29T17:35:41.698481] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-29T17:35:41.699958] [DEBUG] [LOCAL ] BKD: Trimmed 72130 records to 50286 (keeping 200 days of data) [2025-10-29T17:35:41.985451] [DEBUG] [LOCAL ] BKD: Primary data saved (50286 records). [2025-10-29T17:35:41.985625] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-29T17:35:41.985754] [INFO ] [MAIN ] Update Progress: 287/2367 symbols completed. BKD took 39.0s. Estimated remaining: 4h 18m 26s. Rate: 8.0 symbols/min [2025-10-29T17:35:41.999323] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-29T17:35:42.170810] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:35:42.179972] [DEBUG] [LOCAL ] BKN: Loaded 7211 existing records from primary storage. [2025-10-29T17:35:42.180193] [INFO ] [MAIN ] BKN: Loaded 7211 existing records. [2025-10-29T17:35:42.393235] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:35:42.393470] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-29T17:35:42.393522] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-29T17:35:42.393823] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-29T17:35:42.393882] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-29T17:35:42.776120] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:35:42.805492] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-29T17:35:42.812036] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-29T17:35:42.824188] [INFO ] [REMOTE ] BK: Full fetch complete (77666 records). [2025-10-29T17:35:42.824352] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-29T17:35:43.239811] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-29T17:35:43.239975] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-29T17:35:43.240868] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-29T17:35:43.240994] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-29T17:35:43.261842] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T17:35:43.269038] [DEBUG] [LOCAL ] BK: Trimmed 77666 records to 53532 (keeping 200 days of data) [2025-10-29T17:35:43.604184] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-29T17:35:43.604105] [DEBUG] [LOCAL ] BK: Primary data saved (53532 records). [2025-10-29T17:35:43.605128] [INFO ] [MAIN ] BK: Full history saved. [2025-10-29T17:35:43.605778] [INFO ] [MAIN ] Update Progress: 288/2367 symbols completed. BK took 42.3s. Estimated remaining: 4h 17m 37s. Rate: 8.1 symbols/min [2025-10-29T17:35:43.784507] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:35:43.802704] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:35:43.849613] [DEBUG] [LOCAL ] BKSY: Loaded 48927 existing records from primary storage. [2025-10-29T17:35:43.849926] [INFO ] [MAIN ] BKSY: Loaded 48927 existing records. [2025-10-29T17:35:44.041400] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:35:44.041624] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-29T17:35:44.041832] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-29T17:35:44.042153] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-29T17:35:44.042195] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-29T17:35:44.163411] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-29T17:35:44.395683] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-29T17:35:44.418919] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:35:44.753180] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T17:35:45.193562] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-29T17:35:45.993573] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-29T17:35:46.306410] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T17:35:46.443514] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T17:35:46.793548] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-29T17:35:47.593581] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-29T17:35:48.115058] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-29T17:35:48.226351] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-29T17:35:48.393551] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-29T17:35:49.193563] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-29T17:35:49.699855] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-29T17:35:49.773634] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T17:35:49.993629] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-29T17:35:50.597944] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-29T17:35:50.793558] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-29T17:35:51.593567] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-29T17:35:51.971382] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T17:35:52.393559] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-29T17:35:52.651778] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T17:35:53.193546] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-29T17:35:53.638339] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-29T17:35:53.840042] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-29T17:35:53.993565] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-29T17:35:54.793599] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-29T17:35:55.200103] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T17:35:55.593582] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-29T17:35:55.847529] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T17:35:56.393579] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-29T17:35:56.977991] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T17:35:57.193558] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-29T17:35:57.420803] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T17:35:57.590464] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-29T17:35:57.993596] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-29T17:35:58.545543] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T17:35:58.793594] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-29T17:35:59.593627] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-29T17:36:00.395497] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-29T17:36:00.400891] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-29T17:36:00.559360] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-29T17:36:01.193608] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-29T17:36:01.297953] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T17:36:01.300295] [INFO ] [REMOTE ] BKN: Full fetch complete (11121 records). [2025-10-29T17:36:01.300382] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-29T17:36:01.733112] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-29T17:36:01.733219] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-29T17:36:01.733759] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-29T17:36:01.733823] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-29T17:36:01.734416] [DEBUG] [LOCAL ] BKN: Trimmed 11121 records to 7176 (keeping 200 days of data) [2025-10-29T17:36:01.782703] [DEBUG] [LOCAL ] BKN: Primary data saved (7176 records). [2025-10-29T17:36:01.782896] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-29T17:36:01.783001] [INFO ] [MAIN ] Update Progress: 289/2367 symbols completed. BKN took 19.8s. Estimated remaining: 4h 18m 46s. Rate: 8.0 symbols/min [2025-10-29T17:36:01.967255] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:36:01.985315] [DEBUG] [LOCAL ] BKT: Loaded 12704 existing records from primary storage. [2025-10-29T17:36:01.985690] [INFO ] [MAIN ] BKT: Loaded 12704 existing records. [2025-10-29T17:36:01.998865] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-29T17:36:02.221082] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:36:02.221760] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-29T17:36:02.221860] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-29T17:36:02.222233] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-29T17:36:02.222295] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-29T17:36:02.603454] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:36:02.740113] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T17:36:02.793558] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-29T17:36:03.216715] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T17:36:03.593543] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-29T17:36:04.393546] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-29T17:36:04.452945] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-29T17:36:04.483315] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T17:36:05.193615] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-29T17:36:05.627678] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-29T17:36:05.635888] [INFO ] [REMOTE ] BKH: Full fetch complete (53078 records). [2025-10-29T17:36:05.636039] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-29T17:36:05.636866] [FATAL] [VALIDATOR ] BKH: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:36:05.636985] [FATAL] [MAIN ] BKH: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:36:05.637058] [WARN ] [MAIN ] BKH: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:36:05.637140] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-29T17:36:05.637242] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-29T17:36:05.637310] [INFO ] [LOCAL ] BKH: Starting deletion of derivative data. [2025-10-29T17:36:05.637518] [DEBUG] [LOCAL ] BKH: Deleted derivative data file. [2025-10-29T17:36:05.637626] [INFO ] [MAIN ] Update Progress: 290/2367 symbols completed. BKH took 31.0s. Estimated remaining: 4h 18m 13s. Rate: 8.0 symbols/min [2025-10-29T17:36:05.819899] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:36:05.857953] [DEBUG] [LOCAL ] BKU: Loaded 42090 existing records from primary storage. [2025-10-29T17:36:05.858244] [INFO ] [MAIN ] BKU: Loaded 42090 existing records. [2025-10-29T17:36:06.008552] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-29T17:36:06.050407] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:36:06.050735] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-29T17:36:06.050807] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-29T17:36:06.051507] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-29T17:36:06.051564] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-29T17:36:06.425321] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:36:06.793542] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-29T17:36:06.951615] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-29T17:36:06.962415] [INFO ] [REMOTE ] BKSY: Full fetch complete (70893 records). [2025-10-29T17:36:06.962531] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-29T17:36:07.344805] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T17:36:07.390256] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-29T17:36:07.395595] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-29T17:36:07.397120] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-29T17:36:07.397500] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T17:36:07.397595] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-29T17:36:07.402009] [DEBUG] [LOCAL ] BKSY: Trimmed 70893 records to 49004 (keeping 200 days of data) [2025-10-29T17:36:07.598078] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-29T17:36:07.684272] [DEBUG] [LOCAL ] BKSY: Primary data saved (49004 records). [2025-10-29T17:36:07.684421] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-29T17:36:07.684998] [INFO ] [MAIN ] Update Progress: 291/2367 symbols completed. BKSY took 24.1s. Estimated remaining: 4h 17m 27s. Rate: 8.1 symbols/min [2025-10-29T17:36:07.854364] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:36:07.882752] [DEBUG] [LOCAL ] BKV: Loaded 28974 existing records from primary storage. [2025-10-29T17:36:07.883002] [INFO ] [MAIN ] BKV: Loaded 28974 existing records. [2025-10-29T17:36:08.067194] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-29T17:36:08.071892] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:36:08.075238] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-29T17:36:08.075305] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-29T17:36:08.075770] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-29T17:36:08.075831] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-29T17:36:08.398747] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-29T17:36:08.466478] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:36:09.193567] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-29T17:36:09.700944] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T17:36:09.805699] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T17:36:09.993569] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-29T17:36:10.793569] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-29T17:36:11.459543] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T17:36:11.593539] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-29T17:36:11.770448] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-29T17:36:12.181147] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-29T17:36:12.393579] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-29T17:36:13.193612] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-29T17:36:13.325847] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T17:36:13.993545] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-29T17:36:14.139990] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T17:36:14.378530] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-29T17:36:14.793619] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-29T17:36:15.593579] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-29T17:36:16.209329] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T17:36:16.393594] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-29T17:36:16.636323] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T17:36:17.193602] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-29T17:36:17.428913] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T17:36:17.897014] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T17:36:17.993565] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-29T17:36:18.793601] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-29T17:36:19.593704] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-29T17:36:19.867161] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T17:36:20.061424] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-29T17:36:20.074009] [INFO ] [REMOTE ] BKKT: Full fetch complete (52646 records). [2025-10-29T17:36:20.074209] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-29T17:36:20.403875] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-29T17:36:20.593054] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-29T17:36:20.593121] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-29T17:36:20.593788] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-29T17:36:20.593859] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-29T17:36:20.603871] [DEBUG] [LOCAL ] BKKT: Trimmed 52646 records to 38131 (keeping 200 days of data) [2025-10-29T17:36:20.618418] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-29T17:36:20.842466] [DEBUG] [LOCAL ] BKKT: Primary data saved (38131 records). [2025-10-29T17:36:20.842619] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-29T17:36:20.842732] [INFO ] [MAIN ] Update Progress: 292/2367 symbols completed. BKKT took 44.3s. Estimated remaining: 4h 18m 0s. Rate: 8.0 symbols/min [2025-10-29T17:36:21.030492] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:36:21.068134] [DEBUG] [LOCAL ] BLCO: Loaded 34377 existing records from primary storage. [2025-10-29T17:36:21.068402] [INFO ] [MAIN ] BLCO: Loaded 34377 existing records. [2025-10-29T17:36:21.205737] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-29T17:36:21.247691] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:36:21.248049] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-29T17:36:21.248099] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-29T17:36:21.248595] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-29T17:36:21.248684] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-29T17:36:21.626267] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:36:21.687760] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:36:21.993553] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-29T17:36:22.265404] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T17:36:22.793606] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-29T17:36:23.025770] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T17:36:23.593635] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-29T17:36:23.854807] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T17:36:24.070461] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T17:36:24.393588] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-29T17:36:24.932882] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-29T17:36:25.193680] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-29T17:36:25.810616] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-29T17:36:25.993581] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-29T17:36:26.793544] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-29T17:36:26.824361] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-29T17:36:27.593597] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-29T17:36:27.815304] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T17:36:28.393536] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-29T17:36:28.530875] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T17:36:28.535702] [INFO ] [REMOTE ] BKT: Full fetch complete (17027 records). [2025-10-29T17:36:28.535778] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-29T17:36:28.964608] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-29T17:36:28.964712] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-29T17:36:28.965047] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-29T17:36:28.965086] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-29T17:36:28.965596] [DEBUG] [LOCAL ] BKT: Trimmed 17027 records to 12863 (keeping 200 days of data) [2025-10-29T17:36:29.042430] [DEBUG] [LOCAL ] BKT: Primary data saved (12863 records). [2025-10-29T17:36:29.042567] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-29T17:36:29.042664] [INFO ] [MAIN ] Update Progress: 293/2367 symbols completed. BKT took 27.3s. Estimated remaining: 4h 17m 58s. Rate: 8.0 symbols/min [2025-10-29T17:36:29.194464] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-29T17:36:29.214403] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:36:29.240901] [DEBUG] [LOCAL ] BLD: Loaded 26517 existing records from primary storage. [2025-10-29T17:36:29.241172] [INFO ] [MAIN ] BLD: Loaded 26517 existing records. [2025-10-29T17:36:29.416177] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:36:29.416394] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-29T17:36:29.416441] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-29T17:36:29.417026] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-29T17:36:29.417084] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-29T17:36:29.786668] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:36:29.912338] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-29T17:36:29.993574] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-29T17:36:30.229034] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-29T17:36:30.793539] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-29T17:36:31.086517] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-29T17:36:31.593593] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-29T17:36:31.801328] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T17:36:32.393562] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-29T17:36:32.704498] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T17:36:33.193531] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-29T17:36:33.386677] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T17:36:33.993616] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-29T17:36:34.324511] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T17:36:34.793570] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-29T17:36:35.019198] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-29T17:36:35.593640] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-29T17:36:36.197712] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T17:36:36.208556] [INFO ] [REMOTE ] BKU: Full fetch complete (60905 records). [2025-10-29T17:36:36.208763] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-29T17:36:36.209570] [FATAL] [VALIDATOR ] BKU: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:36:36.209732] [FATAL] [MAIN ] BKU: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:36:36.209809] [WARN ] [MAIN ] BKU: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:36:36.209885] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-29T17:36:36.209951] [DEBUG] [LOCAL ] BKU: No primary data file found to delete. [2025-10-29T17:36:36.209987] [INFO ] [LOCAL ] BKU: Starting deletion of derivative data. [2025-10-29T17:36:36.210178] [DEBUG] [LOCAL ] BKU: Deleted derivative data file. [2025-10-29T17:36:36.210276] [INFO ] [MAIN ] Update Progress: 294/2367 symbols completed. BKU took 30.6s. Estimated remaining: 4h 17m 48s. Rate: 8.0 symbols/min [2025-10-29T17:36:36.407196] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-29T17:36:36.411198] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:36:36.432036] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-29T17:36:36.496075] [DEBUG] [LOCAL ] BLDR: Loaded 51799 existing records from primary storage. [2025-10-29T17:36:36.496381] [INFO ] [MAIN ] BLDR: Loaded 51799 existing records. [2025-10-29T17:36:36.680825] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:36:36.681025] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-29T17:36:36.681072] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-29T17:36:36.681779] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-29T17:36:36.681837] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-29T17:36:37.049278] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:36:37.193559] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-29T17:36:37.320560] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T17:36:37.993598] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-29T17:36:38.047519] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-29T17:36:38.793580] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-29T17:36:39.334900] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T17:36:39.593561] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-29T17:36:39.685951] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T17:36:40.388709] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T17:36:40.397036] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-29T17:36:41.193588] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-29T17:36:41.749454] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-29T17:36:41.993597] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-29T17:36:42.026816] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T17:36:42.793579] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-29T17:36:42.995501] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-29T17:36:43.593613] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-29T17:36:44.063055] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T17:36:44.393597] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-29T17:36:44.813306] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T17:36:44.821268] [INFO ] [REMOTE ] BKV: Full fetch complete (44744 records). [2025-10-29T17:36:44.821474] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-29T17:36:45.198777] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-29T17:36:45.285373] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-29T17:36:45.285495] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-29T17:36:45.286390] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-29T17:36:45.286460] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-29T17:36:45.288008] [DEBUG] [LOCAL ] BKV: Trimmed 44744 records to 28994 (keeping 200 days of data) [2025-10-29T17:36:45.475691] [DEBUG] [LOCAL ] BKV: Primary data saved (28994 records). [2025-10-29T17:36:45.475900] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-29T17:36:45.476043] [INFO ] [MAIN ] Update Progress: 295/2367 symbols completed. BKV took 37.8s. Estimated remaining: 4h 17m 54s. Rate: 8.0 symbols/min [2025-10-29T17:36:45.665970] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:36:45.683818] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T17:36:45.703481] [DEBUG] [LOCAL ] BLE: Loaded 13409 existing records from primary storage. [2025-10-29T17:36:45.703861] [INFO ] [MAIN ] BLE: Loaded 13409 existing records. [2025-10-29T17:36:45.893401] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:36:45.893784] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-29T17:36:45.893852] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-29T17:36:45.894226] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-29T17:36:45.894285] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-29T17:36:46.002548] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-29T17:36:46.305358] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:36:46.325310] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T17:36:46.793533] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-29T17:36:46.879319] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T17:36:47.593560] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-29T17:36:48.073163] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:36:48.393629] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-29T17:36:48.457480] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T17:36:49.047200] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-29T17:36:49.193588] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-29T17:36:49.993600] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-29T17:36:50.017409] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-29T17:36:50.506218] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T17:36:50.793570] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-29T17:36:51.432419] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-29T17:36:51.593580] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-29T17:36:52.393548] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-29T17:36:52.447517] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-29T17:36:53.193612] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-29T17:36:53.877391] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-29T17:36:53.993578] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-29T17:36:54.390247] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T17:36:54.396816] [INFO ] [REMOTE ] BLCO: Full fetch complete (52096 records). [2025-10-29T17:36:54.396959] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-29T17:36:54.799212] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-29T17:36:54.817752] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T17:36:54.818171] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-29T17:36:54.823672] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-29T17:36:54.824786] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-29T17:36:54.824955] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-29T17:36:54.826152] [DEBUG] [LOCAL ] BLCO: Trimmed 52096 records to 34380 (keeping 200 days of data) [2025-10-29T17:36:55.022444] [DEBUG] [LOCAL ] BLCO: Primary data saved (34380 records). [2025-10-29T17:36:55.022578] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-29T17:36:55.022678] [INFO ] [MAIN ] Update Progress: 296/2367 symbols completed. BLCO took 34.2s. Estimated remaining: 4h 18m 1s. Rate: 8.0 symbols/min [2025-10-29T17:36:55.188696] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:36:55.222501] [DEBUG] [LOCAL ] BLK: Loaded 33493 existing records from primary storage. [2025-10-29T17:36:55.222787] [INFO ] [MAIN ] BLK: Loaded 33493 existing records. [2025-10-29T17:36:55.413778] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:36:55.414044] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-29T17:36:55.414101] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-29T17:36:55.414857] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-29T17:36:55.414916] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-29T17:36:55.600338] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-29T17:36:55.776250] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:36:56.204143] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T17:36:56.203728] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T17:36:56.393577] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-29T17:36:57.113529] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T17:36:57.193597] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-29T17:36:57.993569] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-29T17:36:58.460792] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T17:36:58.537820] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-29T17:36:58.793582] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-29T17:36:59.379678] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T17:36:59.593569] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-29T17:37:00.393618] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-29T17:37:00.931536] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T17:37:01.026584] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T17:37:01.193637] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-29T17:37:01.993587] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-29T17:37:02.697595] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-29T17:37:02.793619] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-29T17:37:03.233688] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:37:03.384875] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T17:37:03.387551] [INFO ] [REMOTE ] BLE: Full fetch complete (19513 records). [2025-10-29T17:37:03.387628] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-29T17:37:03.388093] [FATAL] [VALIDATOR ] BLE: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:37:03.388174] [FATAL] [MAIN ] BLE: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:37:03.388216] [WARN ] [MAIN ] BLE: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:37:03.388253] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-29T17:37:03.388319] [DEBUG] [LOCAL ] BLE: No primary data file found to delete. [2025-10-29T17:37:03.388383] [INFO ] [LOCAL ] BLE: Starting deletion of derivative data. [2025-10-29T17:37:03.388600] [DEBUG] [LOCAL ] BLE: Deleted derivative data file. [2025-10-29T17:37:03.388733] [INFO ] [MAIN ] Update Progress: 297/2367 symbols completed. BLE took 17.9s. Estimated remaining: 4h 17m 59s. Rate: 8.0 symbols/min [2025-10-29T17:37:03.563236] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:37:03.603199] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-29T17:37:03.606383] [DEBUG] [LOCAL ] BLND: Loaded 49182 existing records from primary storage. [2025-10-29T17:37:03.606827] [INFO ] [MAIN ] BLND: Loaded 49182 existing records. [2025-10-29T17:37:03.788373] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:37:03.788601] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-29T17:37:03.788701] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-29T17:37:03.789450] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-29T17:37:03.789509] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-29T17:37:04.147903] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:37:04.393611] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-29T17:37:05.196939] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-29T17:37:05.202779] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-29T17:37:05.809081] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T17:37:05.993545] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-29T17:37:06.123687] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T17:37:06.793626] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-29T17:37:07.270524] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:37:07.593621] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-29T17:37:08.065632] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T17:37:08.397638] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-29T17:37:08.401312] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-29T17:37:09.193555] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-29T17:37:09.879045] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T17:37:09.894896] [INFO ] [REMOTE ] BLDR: Full fetch complete (74756 records). [2025-10-29T17:37:09.895183] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-29T17:37:09.998745] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-29T17:37:10.357613] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-29T17:37:10.357772] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-29T17:37:10.358689] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-29T17:37:10.358776] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-29T17:37:10.360534] [DEBUG] [LOCAL ] BLDR: Trimmed 74756 records to 51806 (keeping 200 days of data) [2025-10-29T17:37:10.381316] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-29T17:37:10.693281] [DEBUG] [LOCAL ] BLDR: Primary data saved (51806 records). [2025-10-29T17:37:10.693427] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-29T17:37:10.693507] [INFO ] [MAIN ] Update Progress: 298/2367 symbols completed. BLDR took 34.5s. Estimated remaining: 4h 17m 51s. Rate: 8.0 symbols/min [2025-10-29T17:37:10.798355] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-29T17:37:10.878355] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:37:10.878548] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-29T17:37:10.878599] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-29T17:37:10.878731] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-29T17:37:10.878777] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-29T17:37:10.878818] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-29T17:37:10.878851] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-29T17:37:11.272485] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-29T17:37:11.271567] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:37:11.278296] [INFO ] [REMOTE ] BLD: Full fetch complete (39746 records). [2025-10-29T17:37:11.278409] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-29T17:37:11.606840] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-29T17:37:11.656875] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-29T17:37:11.656995] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-29T17:37:11.657682] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-29T17:37:11.657747] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-29T17:37:11.658727] [DEBUG] [LOCAL ] BLD: Trimmed 39746 records to 26495 (keeping 200 days of data) [2025-10-29T17:37:11.837027] [DEBUG] [LOCAL ] BLD: Primary data saved (26495 records). [2025-10-29T17:37:11.837278] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-29T17:37:11.837451] [INFO ] [MAIN ] Update Progress: 299/2367 symbols completed. BLD took 42.8s. Estimated remaining: 4h 16m 59s. Rate: 8.0 symbols/min [2025-10-29T17:37:11.941998] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:37:11.942694] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-29T17:37:11.943145] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:37:11.983248] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-29T17:37:12.015512] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:37:12.015405] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:37:12.015840] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-29T17:37:12.016424] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-29T17:37:12.016529] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-29T17:37:12.016768] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-29T17:37:12.016908] [INFO ] [MAIN ] Update Progress: 300/2367 symbols completed. BLSH took 1.3s. Estimated remaining: 4h 16m 2s. Rate: 8.1 symbols/min [2025-10-29T17:37:12.158678] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T17:37:12.214039] [DEBUG] [LOCAL ] BLW: Loaded 12656 existing records from primary storage. [2025-10-29T17:37:12.221984] [INFO ] [MAIN ] BLW: Loaded 12656 existing records. [2025-10-29T17:37:12.319722] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:37:12.403524] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-29T17:37:12.434258] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:37:12.434528] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-29T17:37:12.434576] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-29T17:37:12.434806] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-29T17:37:12.434862] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-29T17:37:12.478399] [DEBUG] [LOCAL ] BLX: Loaded 14892 existing records from primary storage. [2025-10-29T17:37:12.516473] [INFO ] [MAIN ] BLX: Loaded 14892 existing records. [2025-10-29T17:37:12.910929] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:37:12.922230] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-29T17:37:12.932725] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-29T17:37:12.967514] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-29T17:37:12.971368] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-29T17:37:12.996913] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:37:13.198792] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-29T17:37:13.341341] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:37:13.657444] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T17:37:13.993583] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-29T17:37:14.660831] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-29T17:37:14.793606] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-29T17:37:15.156690] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T17:37:15.593603] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-29T17:37:16.090791] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T17:37:16.393572] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-29T17:37:16.814394] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T17:37:17.166294] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T17:37:17.193533] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-29T17:37:17.737894] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-29T17:37:17.993531] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-29T17:37:18.677588] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-29T17:37:18.793584] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-29T17:37:19.593596] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-29T17:37:20.129330] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T17:37:20.129745] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-29T17:37:20.393550] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-29T17:37:21.150014] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T17:37:21.193527] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-29T17:37:21.987514] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-29T17:37:21.993511] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-29T17:37:22.619941] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T17:37:22.793584] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-29T17:37:23.593573] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-29T17:37:23.860927] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T17:37:24.393561] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-29T17:37:24.626400] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T17:37:25.193560] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-29T17:37:25.563388] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T17:37:25.753273] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-29T17:37:25.993562] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-29T17:37:26.557358] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-29T17:37:26.793562] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-29T17:37:27.363946] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-29T17:37:27.593582] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-29T17:37:28.393568] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-29T17:37:28.804282] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T17:37:29.175899] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T17:37:29.193521] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-29T17:37:29.816537] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-29T17:37:29.993547] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-29T17:37:30.573200] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-29T17:37:30.793563] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-29T17:37:31.584045] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T17:37:31.591337] [INFO ] [REMOTE ] BLX: Full fetch complete (22488 records). [2025-10-29T17:37:31.591513] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-29T17:37:31.603255] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-29T17:37:32.018851] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-29T17:37:32.018963] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-29T17:37:32.019622] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-29T17:37:32.019697] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-29T17:37:32.020462] [DEBUG] [LOCAL ] BLX: Trimmed 22488 records to 14943 (keeping 200 days of data) [2025-10-29T17:37:32.116218] [DEBUG] [LOCAL ] BLX: Primary data saved (14943 records). [2025-10-29T17:37:32.116406] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-29T17:37:32.116505] [INFO ] [MAIN ] Update Progress: 301/2367 symbols completed. BLX took 20.1s. Estimated remaining: 4h 17m 21s. Rate: 8.0 symbols/min [2025-10-29T17:37:32.295073] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:37:32.333291] [DEBUG] [LOCAL ] BMA: Loaded 36732 existing records from primary storage. [2025-10-29T17:37:32.333718] [INFO ] [MAIN ] BMA: Loaded 36732 existing records. [2025-10-29T17:37:32.404190] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-29T17:37:32.528832] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:37:32.529112] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-29T17:37:32.529166] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-29T17:37:32.529972] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-29T17:37:32.530031] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-29T17:37:32.924737] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:37:32.986445] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:37:33.193563] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-29T17:37:33.904900] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T17:37:33.913504] [INFO ] [REMOTE ] BLK: Full fetch complete (52572 records). [2025-10-29T17:37:33.913687] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-29T17:37:33.998677] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-29T17:37:34.345338] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-29T17:37:34.345440] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-29T17:37:34.346138] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-29T17:37:34.346200] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-29T17:37:34.347419] [DEBUG] [LOCAL ] BLK: Trimmed 52572 records to 33445 (keeping 200 days of data) [2025-10-29T17:37:34.561848] [DEBUG] [LOCAL ] BLK: Primary data saved (33445 records). [2025-10-29T17:37:34.562164] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-29T17:37:34.562306] [INFO ] [MAIN ] Update Progress: 302/2367 symbols completed. BLK took 39.5s. Estimated remaining: 4h 16m 39s. Rate: 8.0 symbols/min [2025-10-29T17:37:34.742740] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:37:34.754703] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T17:37:34.778168] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T17:37:34.792095] [INFO ] [REMOTE ] BLND: Full fetch complete (72164 records). [2025-10-29T17:37:34.792329] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-29T17:37:34.798558] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-29T17:37:34.858842] [DEBUG] [LOCAL ] BME: Loaded 11003 existing records from primary storage. [2025-10-29T17:37:34.882743] [INFO ] [MAIN ] BME: Loaded 11003 existing records. [2025-10-29T17:37:35.313203] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:37:35.324233] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-29T17:37:35.352756] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-29T17:37:35.388886] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-29T17:37:35.411736] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-29T17:37:35.411854] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-29T17:37:35.412156] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-29T17:37:35.445753] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-29T17:37:35.460431] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-29T17:37:35.447491] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T17:37:35.549497] [DEBUG] [LOCAL ] BLND: Trimmed 72164 records to 49168 (keeping 200 days of data) [2025-10-29T17:37:35.619514] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-29T17:37:36.112021] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:37:36.146800] [DEBUG] [LOCAL ] BLND: Primary data saved (49168 records). [2025-10-29T17:37:36.146922] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-29T17:37:36.147915] [INFO ] [MAIN ] Update Progress: 303/2367 symbols completed. BLND took 32.8s. Estimated remaining: 4h 15m 52s. Rate: 8.1 symbols/min [2025-10-29T17:37:36.267920] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T17:37:36.347427] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:37:36.378014] [DEBUG] [LOCAL ] BMEZ: Loaded 24568 existing records from primary storage. [2025-10-29T17:37:36.378387] [INFO ] [MAIN ] BMEZ: Loaded 24568 existing records. [2025-10-29T17:37:36.400001] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-29T17:37:36.583834] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:37:36.584263] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-29T17:37:36.584352] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-29T17:37:36.585036] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-29T17:37:36.585102] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-29T17:37:37.024036] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:37:37.168593] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T17:37:37.193525] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-29T17:37:37.693940] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T17:37:37.993583] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-29T17:37:38.518172] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-29T17:37:38.793570] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-29T17:37:39.420508] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-29T17:37:39.593549] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-29T17:37:40.225252] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T17:37:40.393741] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-29T17:37:41.193562] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-29T17:37:41.450034] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T17:37:41.943960] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-29T17:37:41.947527] [INFO ] [REMOTE ] BLW: Full fetch complete (19152 records). [2025-10-29T17:37:41.947620] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-29T17:37:42.000921] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-29T17:37:42.323781] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-29T17:37:42.323875] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-29T17:37:42.324260] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-29T17:37:42.324303] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-29T17:37:42.325086] [DEBUG] [LOCAL ] BLW: Trimmed 19152 records to 12633 (keeping 200 days of data) [2025-10-29T17:37:42.400472] [DEBUG] [LOCAL ] BLW: Primary data saved (12633 records). [2025-10-29T17:37:42.400622] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-29T17:37:42.400782] [INFO ] [MAIN ] Update Progress: 304/2367 symbols completed. BLW took 30.6s. Estimated remaining: 4h 15m 36s. Rate: 8.1 symbols/min [2025-10-29T17:37:42.568364] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:37:42.591448] [DEBUG] [LOCAL ] BMI: Loaded 24547 existing records from primary storage. [2025-10-29T17:37:42.591736] [INFO ] [MAIN ] BMI: Loaded 24547 existing records. [2025-10-29T17:37:42.767062] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:37:42.767353] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-29T17:37:42.767402] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-29T17:37:42.767841] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-29T17:37:42.767904] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-29T17:37:42.799221] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-29T17:37:43.145294] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:37:43.168019] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T17:37:43.593573] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-29T17:37:43.856745] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T17:37:44.362501] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T17:37:44.393559] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-29T17:37:45.182258] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T17:37:45.193526] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-29T17:37:45.993549] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-29T17:37:46.014789] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T17:37:46.802179] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-29T17:37:46.804699] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T17:37:47.469790] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T17:37:47.593555] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-29T17:37:48.393552] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-29T17:37:48.625325] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T17:37:48.957481] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-29T17:37:49.193610] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-29T17:37:49.993588] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-29T17:37:50.115863] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T17:37:50.793596] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-29T17:37:50.822944] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T17:37:51.593563] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-29T17:37:51.798010] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T17:37:52.393567] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-29T17:37:52.418687] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T17:37:52.797815] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T17:37:53.193617] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-29T17:37:53.764537] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-29T17:37:53.993571] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-29T17:37:54.793713] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-29T17:37:54.987166] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T17:37:55.593591] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-29T17:37:55.784312] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T17:37:56.393532] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-29T17:37:56.412733] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T17:37:57.193624] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-29T17:37:57.325543] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T17:37:57.822163] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-29T17:37:57.993561] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-29T17:37:58.793542] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-29T17:37:58.880151] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T17:37:59.357513] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-29T17:37:59.593593] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-29T17:38:00.249921] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T17:38:00.393570] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-29T17:38:01.193637] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-29T17:38:01.619527] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T17:38:01.889930] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-29T17:38:01.892727] [INFO ] [REMOTE ] BME: Full fetch complete (15458 records). [2025-10-29T17:38:01.892798] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-29T17:38:01.893211] [FATAL] [VALIDATOR ] BME: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:38:01.893290] [FATAL] [MAIN ] BME: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:38:01.893331] [WARN ] [MAIN ] BME: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:38:01.893411] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-29T17:38:01.893474] [DEBUG] [LOCAL ] BME: No primary data file found to delete. [2025-10-29T17:38:01.893508] [INFO ] [LOCAL ] BME: Starting deletion of derivative data. [2025-10-29T17:38:01.893720] [DEBUG] [LOCAL ] BME: Deleted derivative data file. [2025-10-29T17:38:01.893807] [INFO ] [MAIN ] Update Progress: 305/2367 symbols completed. BME took 27.3s. Estimated remaining: 4h 16m 51s. Rate: 8.0 symbols/min [2025-10-29T17:38:01.993799] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-29T17:38:02.064557] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:38:02.069488] [DEBUG] [LOCAL ] BMN: Loaded 2634 existing records from primary storage. [2025-10-29T17:38:02.069691] [INFO ] [MAIN ] BMN: Loaded 2634 existing records. [2025-10-29T17:38:02.248789] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:38:02.249024] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-29T17:38:02.249071] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-29T17:38:02.249280] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-29T17:38:02.249348] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-29T17:38:02.596324] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:38:02.793548] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-29T17:38:03.227164] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-29T17:38:03.598801] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-29T17:38:03.618884] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-29T17:38:03.628682] [INFO ] [REMOTE ] BMA: Full fetch complete (52762 records). [2025-10-29T17:38:03.628819] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-29T17:38:04.008958] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-29T17:38:04.009033] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-29T17:38:04.009624] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-29T17:38:04.009695] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-29T17:38:04.010724] [DEBUG] [LOCAL ] BMA: Trimmed 52762 records to 36780 (keeping 200 days of data) [2025-10-29T17:38:04.255978] [DEBUG] [LOCAL ] BMA: Primary data saved (36780 records). [2025-10-29T17:38:04.256129] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-29T17:38:04.256212] [INFO ] [MAIN ] Update Progress: 306/2367 symbols completed. BMA took 32.1s. Estimated remaining: 4h 16m 9s. Rate: 8.0 symbols/min [2025-10-29T17:38:04.403780] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-29T17:38:04.494528] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:38:04.508205] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T17:38:04.553868] [DEBUG] [LOCAL ] BMO: Loaded 40411 existing records from primary storage. [2025-10-29T17:38:04.554150] [INFO ] [MAIN ] BMO: Loaded 40411 existing records. [2025-10-29T17:38:04.729282] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:38:04.729489] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-29T17:38:04.729536] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-29T17:38:04.730264] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-29T17:38:04.730323] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-29T17:38:04.813620] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T17:38:05.084031] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:38:05.193568] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-29T17:38:05.993580] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-29T17:38:06.363383] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T17:38:06.793614] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-29T17:38:06.951185] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T17:38:07.593539] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-29T17:38:07.728463] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-29T17:38:08.393600] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-29T17:38:08.410130] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T17:38:09.193620] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-29T17:38:09.375605] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T17:38:09.993554] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-29T17:38:10.050201] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T17:38:10.307345] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-29T17:38:10.793569] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-29T17:38:11.157492] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-29T17:38:11.593557] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-29T17:38:12.393619] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-29T17:38:12.531997] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-29T17:38:12.692725] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-29T17:38:13.193607] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-29T17:38:13.993609] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-29T17:38:14.236462] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T17:38:14.242385] [INFO ] [REMOTE ] BMI: Full fetch complete (34198 records). [2025-10-29T17:38:14.242485] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-29T17:38:14.608895] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-29T17:38:14.608983] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-29T17:38:14.609490] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-29T17:38:14.609532] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-29T17:38:14.610388] [DEBUG] [LOCAL ] BMI: Trimmed 34198 records to 24435 (keeping 200 days of data) [2025-10-29T17:38:14.762586] [DEBUG] [LOCAL ] BMI: Primary data saved (24435 records). [2025-10-29T17:38:14.780464] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-29T17:38:14.782840] [INFO ] [MAIN ] Update Progress: 307/2367 symbols completed. BMI took 32.4s. Estimated remaining: 4h 16m 22s. Rate: 8.0 symbols/min [2025-10-29T17:38:14.798812] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-29T17:38:14.830187] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T17:38:14.969013] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:38:15.019391] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-29T17:38:15.019783] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-29T17:38:15.192151] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:38:15.192392] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-29T17:38:15.192451] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-29T17:38:15.193281] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-29T17:38:15.193338] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-29T17:38:15.546613] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:38:15.593545] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-29T17:38:16.038929] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T17:38:16.308208] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T17:38:16.393529] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-29T17:38:17.193707] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-29T17:38:17.457529] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-29T17:38:17.993716] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-29T17:38:18.641676] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-29T17:38:18.793681] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-29T17:38:19.002215] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T17:38:19.007420] [INFO ] [REMOTE ] BMEZ: Full fetch complete (38731 records). [2025-10-29T17:38:19.007508] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-29T17:38:19.390584] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-29T17:38:19.390702] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-29T17:38:19.391264] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-29T17:38:19.391308] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-29T17:38:19.392301] [DEBUG] [LOCAL ] BMEZ: Trimmed 38731 records to 24526 (keeping 200 days of data) [2025-10-29T17:38:19.539285] [DEBUG] [LOCAL ] BMEZ: Primary data saved (24526 records). [2025-10-29T17:38:19.539428] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-29T17:38:19.539508] [INFO ] [MAIN ] Update Progress: 308/2367 symbols completed. BMEZ took 43.4s. Estimated remaining: 4h 15m 56s. Rate: 8.0 symbols/min [2025-10-29T17:38:19.599886] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-29T17:38:19.721462] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:38:19.769138] [DEBUG] [LOCAL ] BN: Loaded 52969 existing records from primary storage. [2025-10-29T17:38:19.769436] [INFO ] [MAIN ] BN: Loaded 52969 existing records. [2025-10-29T17:38:19.952319] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:38:19.952520] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-29T17:38:19.952568] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-29T17:38:19.953365] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-29T17:38:19.953422] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-29T17:38:20.183785] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-29T17:38:20.343502] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:38:20.390668] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-29T17:38:20.399984] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-29T17:38:20.681050] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-29T17:38:21.193718] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-29T17:38:21.993601] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-29T17:38:22.520872] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:38:22.793569] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-29T17:38:23.092474] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-29T17:38:23.273936] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T17:38:23.593602] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-29T17:38:24.393573] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-29T17:38:24.715844] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-29T17:38:24.748407] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T17:38:25.193596] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-29T17:38:25.993575] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-29T17:38:26.377618] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T17:38:26.459565] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-29T17:38:26.461178] [INFO ] [REMOTE ] BMN: Full fetch complete (3756 records). [2025-10-29T17:38:26.461262] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-29T17:38:26.798733] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-29T17:38:26.873578] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-29T17:38:26.873704] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-29T17:38:26.873940] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-29T17:38:26.873985] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-29T17:38:26.874364] [DEBUG] [LOCAL ] BMN: Trimmed 3756 records to 2619 (keeping 200 days of data) [2025-10-29T17:38:26.891145] [DEBUG] [LOCAL ] BMN: Primary data saved (2619 records). [2025-10-29T17:38:26.891276] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-29T17:38:26.891371] [INFO ] [MAIN ] Update Progress: 309/2367 symbols completed. BMN took 25.0s. Estimated remaining: 4h 15m 48s. Rate: 8.0 symbols/min [2025-10-29T17:38:27.086219] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:38:27.117183] [DEBUG] [LOCAL ] BNED: Loaded 27781 existing records from primary storage. [2025-10-29T17:38:27.117546] [INFO ] [MAIN ] BNED: Loaded 27781 existing records. [2025-10-29T17:38:27.312487] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:38:27.312817] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-29T17:38:27.312871] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-29T17:38:27.313394] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-29T17:38:27.313452] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-29T17:38:27.598776] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-29T17:38:27.700141] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:38:28.398719] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-29T17:38:28.422874] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-29T17:38:28.802004] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T17:38:29.193561] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-29T17:38:29.478681] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T17:38:29.993578] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-29T17:38:30.124333] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T17:38:30.793567] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-29T17:38:31.516230] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-29T17:38:31.593570] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-29T17:38:32.192818] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T17:38:32.393553] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-29T17:38:32.886066] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T17:38:33.193551] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-29T17:38:33.515388] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T17:38:33.993532] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-29T17:38:34.084630] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T17:38:34.793568] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-29T17:38:35.028600] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T17:38:35.593562] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-29T17:38:36.345229] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T17:38:36.393607] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-29T17:38:36.753794] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T17:38:36.762739] [INFO ] [REMOTE ] BMO: Full fetch complete (59705 records). [2025-10-29T17:38:36.762899] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-29T17:38:37.146789] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-29T17:38:37.146881] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-29T17:38:37.147592] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-29T17:38:37.147638] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-29T17:38:37.149019] [DEBUG] [LOCAL ] BMO: Trimmed 59705 records to 40374 (keeping 200 days of data) [2025-10-29T17:38:37.206869] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-29T17:38:37.363491] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T17:38:37.438852] [DEBUG] [LOCAL ] BMO: Primary data saved (40374 records). [2025-10-29T17:38:37.438978] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-29T17:38:37.440052] [INFO ] [MAIN ] Update Progress: 310/2367 symbols completed. BMO took 33.2s. Estimated remaining: 4h 16m 1s. Rate: 8.0 symbols/min [2025-10-29T17:38:37.626207] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:38:37.634073] [DEBUG] [LOCAL ] BNH: Loaded 4480 existing records from primary storage. [2025-10-29T17:38:37.634318] [INFO ] [MAIN ] BNH: Loaded 4480 existing records. [2025-10-29T17:38:37.821227] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:38:37.821463] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-29T17:38:37.821510] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-29T17:38:37.821789] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-29T17:38:37.821848] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-29T17:38:38.001329] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-29T17:38:38.210284] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:38:38.517347] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T17:38:38.793572] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-29T17:38:38.974099] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-29T17:38:39.593586] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-29T17:38:40.402286] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-29T17:38:40.408471] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-29T17:38:41.131494] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-29T17:38:41.193523] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-29T17:38:41.496009] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T17:38:41.993559] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-29T17:38:42.473741] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T17:38:42.793579] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-29T17:38:43.219531] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-29T17:38:43.471342] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T17:38:43.593557] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-29T17:38:44.182207] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T17:38:44.193786] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-29T17:38:44.193954] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-29T17:38:44.399415] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-29T17:38:44.589215] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-29T17:38:44.589321] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-29T17:38:44.590184] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-29T17:38:44.590255] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-29T17:38:44.591804] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-29T17:38:44.914524] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-29T17:38:44.914688] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-29T17:38:44.914785] [INFO ] [MAIN ] Update Progress: 311/2367 symbols completed. BMY took 30.1s. Estimated remaining: 4h 15m 54s. Rate: 8.0 symbols/min [2025-10-29T17:38:45.098151] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:38:45.108750] [DEBUG] [LOCAL ] BNJ: Loaded 2411 existing records from primary storage. [2025-10-29T17:38:45.108940] [INFO ] [MAIN ] BNJ: Loaded 2411 existing records. [2025-10-29T17:38:45.203445] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-29T17:38:45.285875] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:38:45.286097] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-29T17:38:45.286145] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-29T17:38:45.286329] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-29T17:38:45.286385] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-29T17:38:45.566212] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T17:38:45.636668] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T17:38:45.682600] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:38:45.993555] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-29T17:38:46.382134] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-29T17:38:46.793551] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-29T17:38:47.593555] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-29T17:38:47.971558] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T17:38:48.112542] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T17:38:48.393623] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-29T17:38:48.794561] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-29T17:38:49.193559] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-29T17:38:49.564850] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-29T17:38:49.993557] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-29T17:38:50.793562] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-29T17:38:50.900569] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-29T17:38:51.065260] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-29T17:38:51.593597] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-29T17:38:51.921812] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-29T17:38:52.393573] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-29T17:38:53.193592] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-29T17:38:53.849953] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T17:38:53.995376] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-29T17:38:53.999572] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-29T17:38:54.453419] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T17:38:54.793586] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-29T17:38:55.593620] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-29T17:38:55.971481] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-29T17:38:56.110891] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T17:38:56.393614] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-29T17:38:56.740189] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-29T17:38:57.193625] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-29T17:38:57.469321] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-29T17:38:57.993557] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-29T17:38:58.793562] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-29T17:38:59.537002] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T17:38:59.548932] [INFO ] [REMOTE ] BN: Full fetch complete (76945 records). [2025-10-29T17:38:59.549084] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-29T17:38:59.598754] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-29T17:39:00.023923] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T17:39:00.024076] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-29T17:39:00.030821] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-29T17:39:00.031981] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-29T17:39:00.032087] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-29T17:39:00.034027] [DEBUG] [LOCAL ] BN: Trimmed 76945 records to 52967 (keeping 200 days of data) [2025-10-29T17:39:00.136816] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-29T17:39:00.376493] [DEBUG] [LOCAL ] BN: Primary data saved (52967 records). [2025-10-29T17:39:00.376667] [INFO ] [MAIN ] BN: Full history saved. [2025-10-29T17:39:00.377414] [INFO ] [MAIN ] Update Progress: 312/2367 symbols completed. BN took 40.8s. Estimated remaining: 4h 16m 39s. Rate: 8.0 symbols/min [2025-10-29T17:39:00.398898] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-29T17:39:00.556873] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:00.600291] [DEBUG] [LOCAL ] BNL: Loaded 46779 existing records from primary storage. [2025-10-29T17:39:00.600610] [INFO ] [MAIN ] BNL: Loaded 46779 existing records. [2025-10-29T17:39:00.787280] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:39:00.787519] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-29T17:39:00.787568] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-29T17:39:00.788336] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-29T17:39:00.788394] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-29T17:39:01.169872] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:01.193591] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-29T17:39:01.469519] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-29T17:39:01.476635] [INFO ] [REMOTE ] BNED: Full fetch complete (41180 records). [2025-10-29T17:39:01.476798] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-29T17:39:01.873604] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-29T17:39:01.873726] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-29T17:39:01.874326] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-29T17:39:01.874367] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-29T17:39:01.875395] [DEBUG] [LOCAL ] BNED: Trimmed 41180 records to 27758 (keeping 200 days of data) [2025-10-29T17:39:01.993579] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-29T17:39:02.046986] [DEBUG] [LOCAL ] BNED: Primary data saved (27758 records). [2025-10-29T17:39:02.047183] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-29T17:39:02.047275] [INFO ] [MAIN ] Update Progress: 313/2367 symbols completed. BNED took 35.2s. Estimated remaining: 4h 15m 53s. Rate: 8.0 symbols/min [2025-10-29T17:39:02.220170] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:02.315030] [DEBUG] [LOCAL ] BNS: Loaded 51279 existing records from primary storage. [2025-10-29T17:39:02.315351] [INFO ] [MAIN ] BNS: Loaded 51279 existing records. [2025-10-29T17:39:02.350091] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-29T17:39:02.502163] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:39:02.502567] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-29T17:39:02.502667] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-29T17:39:02.503456] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-29T17:39:02.503515] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-29T17:39:02.626068] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T17:39:02.798755] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-29T17:39:02.897498] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:03.213247] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-29T17:39:03.593623] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-29T17:39:04.134602] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-29T17:39:04.137157] [INFO ] [REMOTE ] BNH: Full fetch complete (6819 records). [2025-10-29T17:39:04.137351] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-29T17:39:04.398871] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-29T17:39:04.688336] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-29T17:39:04.688463] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-29T17:39:04.688829] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-29T17:39:04.688902] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-29T17:39:04.689501] [DEBUG] [LOCAL ] BNH: Trimmed 6819 records to 4468 (keeping 200 days of data) [2025-10-29T17:39:04.730797] [DEBUG] [LOCAL ] BNH: Primary data saved (4468 records). [2025-10-29T17:39:04.730951] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-29T17:39:04.731038] [INFO ] [MAIN ] Update Progress: 314/2367 symbols completed. BNH took 27.3s. Estimated remaining: 4h 15m 14s. Rate: 8.0 symbols/min [2025-10-29T17:39:05.002893] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:05.008988] [DEBUG] [LOCAL ] BNT: Loaded 3298 existing records from primary storage. [2025-10-29T17:39:05.009236] [INFO ] [MAIN ] BNT: Loaded 3298 existing records. [2025-10-29T17:39:05.189063] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:39:05.189275] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-29T17:39:05.189323] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-29T17:39:05.189528] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-29T17:39:05.189586] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-29T17:39:05.200599] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-29T17:39:05.557320] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:05.593804] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-29T17:39:05.595870] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T17:39:05.993567] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-29T17:39:06.466021] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-29T17:39:06.793587] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-29T17:39:07.593589] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-29T17:39:08.095267] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T17:39:08.393599] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-29T17:39:08.716585] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-29T17:39:08.838311] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T17:39:09.193566] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-29T17:39:09.487956] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-29T17:39:09.993570] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-29T17:39:10.410825] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-29T17:39:10.793547] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-29T17:39:11.211137] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-29T17:39:11.213379] [INFO ] [REMOTE ] BNJ: Full fetch complete (3850 records). [2025-10-29T17:39:11.213561] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-29T17:39:11.598455] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-29T17:39:11.627520] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-29T17:39:11.627667] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-29T17:39:11.628866] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-29T17:39:11.628949] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-29T17:39:11.629554] [DEBUG] [LOCAL ] BNJ: Trimmed 3850 records to 2419 (keeping 200 days of data) [2025-10-29T17:39:11.647321] [DEBUG] [LOCAL ] BNJ: Primary data saved (2419 records). [2025-10-29T17:39:11.647482] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-29T17:39:11.647568] [INFO ] [MAIN ] Update Progress: 315/2367 symbols completed. BNJ took 26.7s. Estimated remaining: 4h 15m 3s. Rate: 8.0 symbols/min [2025-10-29T17:39:11.856362] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:11.864861] [DEBUG] [LOCAL ] BNY: Loaded 7132 existing records from primary storage. [2025-10-29T17:39:11.865069] [INFO ] [MAIN ] BNY: Loaded 7132 existing records. [2025-10-29T17:39:12.059118] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:39:12.059357] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-29T17:39:12.059416] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-29T17:39:12.059679] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-29T17:39:12.059753] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-29T17:39:12.398710] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-29T17:39:12.439537] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:12.910177] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T17:39:12.914289] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T17:39:13.193563] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-29T17:39:13.993611] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-29T17:39:14.346518] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T17:39:14.793563] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-29T17:39:15.165147] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T17:39:15.593609] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-29T17:39:16.044590] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T17:39:16.233520] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-29T17:39:16.393554] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-29T17:39:16.826996] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-29T17:39:17.193563] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-29T17:39:17.754904] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-29T17:39:17.993570] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-29T17:39:18.793554] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-29T17:39:19.027103] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T17:39:19.267189] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-29T17:39:19.593586] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-29T17:39:19.927877] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T17:39:20.393613] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-29T17:39:21.193559] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-29T17:39:21.588073] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-29T17:39:21.704019] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T17:39:21.993574] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-29T17:39:22.793569] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-29T17:39:23.208166] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T17:39:23.237496] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-29T17:39:23.593587] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-29T17:39:24.393600] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-29T17:39:24.759213] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-29T17:39:24.788575] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T17:39:25.193553] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-29T17:39:25.993592] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-29T17:39:26.482457] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T17:39:26.522226] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T17:39:26.793562] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-29T17:39:27.069739] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-29T17:39:27.593817] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-29T17:39:28.393580] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-29T17:39:28.853236] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:39:29.193574] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-29T17:39:29.636520] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T17:39:29.641835] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-29T17:39:29.993568] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-29T17:39:30.436038] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-29T17:39:30.793577] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-29T17:39:31.593572] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-29T17:39:31.979568] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T17:39:32.128941] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-29T17:39:32.131229] [INFO ] [REMOTE ] BNY: Full fetch complete (10427 records). [2025-10-29T17:39:32.131397] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-29T17:39:32.398867] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-29T17:39:32.489588] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-29T17:39:32.489693] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-29T17:39:32.490001] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-29T17:39:32.490061] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-29T17:39:32.490532] [DEBUG] [LOCAL ] BNY: Trimmed 10427 records to 7137 (keeping 200 days of data) [2025-10-29T17:39:32.532044] [DEBUG] [LOCAL ] BNY: Primary data saved (7137 records). [2025-10-29T17:39:32.532168] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-29T17:39:32.532244] [INFO ] [MAIN ] Update Progress: 316/2367 symbols completed. BNY took 20.9s. Estimated remaining: 4h 16m 23s. Rate: 8.0 symbols/min [2025-10-29T17:39:32.703863] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:32.722878] [DEBUG] [LOCAL ] BOC: Loaded 17761 existing records from primary storage. [2025-10-29T17:39:32.723137] [INFO ] [MAIN ] BOC: Loaded 17761 existing records. [2025-10-29T17:39:32.912993] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:39:32.913242] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-29T17:39:32.913292] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-29T17:39:32.913690] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-29T17:39:32.913752] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-29T17:39:33.200880] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-29T17:39:33.322461] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:33.638562] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T17:39:33.648687] [INFO ] [REMOTE ] BNL: Full fetch complete (67286 records). [2025-10-29T17:39:33.648820] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-29T17:39:33.774681] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-29T17:39:33.998760] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-29T17:39:34.072433] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-29T17:39:34.072528] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-29T17:39:34.073294] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-29T17:39:34.073369] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-29T17:39:34.074901] [DEBUG] [LOCAL ] BNL: Trimmed 67286 records to 46765 (keeping 200 days of data) [2025-10-29T17:39:34.353625] [DEBUG] [LOCAL ] BNL: Primary data saved (46765 records). [2025-10-29T17:39:34.353788] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-29T17:39:34.354541] [INFO ] [MAIN ] Update Progress: 317/2367 symbols completed. BNL took 34.0s. Estimated remaining: 4h 15m 39s. Rate: 8.0 symbols/min [2025-10-29T17:39:34.793617] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-29T17:39:34.869288] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T17:39:35.593561] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-29T17:39:36.103898] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T17:39:36.171707] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-29T17:39:36.393567] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-29T17:39:37.193544] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-29T17:39:37.668979] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T17:39:37.871345] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-29T17:39:37.993577] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-29T17:39:38.213830] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-29T17:39:38.793561] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-29T17:39:39.182124] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T17:39:39.593566] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-29T17:39:40.315570] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T17:39:40.393567] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-29T17:39:40.872998] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-29T17:39:40.875003] [INFO ] [REMOTE ] BNT: Full fetch complete (4869 records). [2025-10-29T17:39:40.875100] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-29T17:39:41.196681] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-29T17:39:41.285941] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-29T17:39:41.286036] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-29T17:39:41.286230] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-29T17:39:41.286270] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-29T17:39:41.286715] [DEBUG] [LOCAL ] BNT: Trimmed 4869 records to 3298 (keeping 200 days of data) [2025-10-29T17:39:41.306851] [DEBUG] [LOCAL ] BNT: Primary data saved (3298 records). [2025-10-29T17:39:41.306994] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-29T17:39:41.307094] [INFO ] [MAIN ] Update Progress: 318/2367 symbols completed. BNT took 36.6s. Estimated remaining: 4h 15m 28s. Rate: 8.0 symbols/min [2025-10-29T17:39:41.893539] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-29T17:39:41.993599] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-29T17:39:42.793722] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-29T17:39:43.404986] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T17:39:43.503587] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T17:39:43.514957] [INFO ] [REMOTE ] BNS: Full fetch complete (74541 records). [2025-10-29T17:39:43.515129] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-29T17:39:43.598824] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-29T17:39:43.926097] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-29T17:39:43.926202] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-29T17:39:43.927088] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-29T17:39:43.927152] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-29T17:39:43.928678] [DEBUG] [LOCAL ] BNS: Trimmed 74541 records to 51268 (keeping 200 days of data) [2025-10-29T17:39:44.234212] [DEBUG] [LOCAL ] BNS: Primary data saved (51268 records). [2025-10-29T17:39:44.234365] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-29T17:39:44.234449] [INFO ] [MAIN ] Update Progress: 319/2367 symbols completed. BNS took 42.2s. Estimated remaining: 4h 14m 51s. Rate: 8.0 symbols/min [2025-10-29T17:39:44.305496] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T17:39:44.393603] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-29T17:39:45.175053] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T17:39:45.193553] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-29T17:39:45.767203] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-29T17:39:45.993590] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-29T17:39:46.798466] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T17:39:46.805569] [INFO ] [REMOTE ] BOC: Full fetch complete (25845 records). [2025-10-29T17:39:46.805818] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-29T17:39:47.231961] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-29T17:39:47.232241] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-29T17:39:47.232753] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-29T17:39:47.232819] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-29T17:39:47.233559] [DEBUG] [LOCAL ] BOC: Trimmed 25845 records to 17794 (keeping 200 days of data) [2025-10-29T17:39:47.340728] [DEBUG] [LOCAL ] BOC: Primary data saved (17794 records). [2025-10-29T17:39:47.340909] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-29T17:39:47.341011] [INFO ] [MAIN ] Update Progress: 320/2367 symbols completed. BOC took 14.8s. Estimated remaining: 4h 14m 16s. Rate: 8.1 symbols/min [2025-10-29T17:39:47.931665] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:47.990709] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:47.979022] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-10-29T17:39:48.076332] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-10-29T17:39:48.106067] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-29T17:39:48.104266] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:48.124168] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:39:48.124459] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-29T17:39:48.124917] [DEBUG] [LOCAL ] BOND: No existing data file found in primary storage. [2025-10-29T17:39:48.125097] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-29T17:39:48.125365] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-29T17:39:48.137723] [WARN ] [MAIN ] BOND: No existing data found, performing full refresh instead. [2025-10-29T17:39:48.158113] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-29T17:39:48.174499] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-29T17:39:48.194476] [DEBUG] [LOCAL ] BOND: No primary data file found to delete. [2025-10-29T17:39:48.221114] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-29T17:39:48.365830] [DEBUG] [LOCAL ] BOH: Loaded 30444 existing records from primary storage. [2025-10-29T17:39:48.464611] [INFO ] [MAIN ] BOH: Loaded 30444 existing records. [2025-10-29T17:39:48.576771] [DEBUG] [LOCAL ] BOOT: Loaded 39014 existing records from primary storage. [2025-10-29T17:39:48.641584] [INFO ] [MAIN ] BOOT: Loaded 39014 existing records. [2025-10-29T17:39:49.044766] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:49.132063] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-29T17:39:49.142888] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:39:49.178498] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-29T17:39:49.209979] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-29T17:39:49.243700] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-29T17:39:49.243825] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-29T17:39:49.274334] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:39:49.401142] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-29T17:39:49.419907] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:49.420367] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-29T17:39:49.420308] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-29T17:39:49.445392] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-29T17:39:49.445579] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-29T17:39:49.980600] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:49.990044] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-29T17:39:50.112372] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:39:50.124340] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-29T17:39:50.126398] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T17:39:50.131753] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-29T17:39:50.384433] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T17:39:50.793531] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-29T17:39:50.851026] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T17:39:51.034735] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T17:39:51.326955] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T17:39:51.429783] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T17:39:51.593579] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-29T17:39:52.228110] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-29T17:39:52.393609] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-29T17:39:53.145572] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-29T17:39:53.193516] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-29T17:39:53.755231] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-29T17:39:53.993590] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-29T17:39:54.793622] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-29T17:39:55.152537] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T17:39:55.593584] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-29T17:39:55.620736] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T17:39:56.372009] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T17:39:56.393550] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-29T17:39:57.193540] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-29T17:39:57.296248] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-29T17:39:57.993571] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-29T17:39:58.350050] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T17:39:58.793532] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-29T17:39:58.873048] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T17:39:59.593524] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-29T17:39:59.741011] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-29T17:40:00.393676] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-29T17:40:00.416860] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T17:40:01.193607] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-29T17:40:01.813519] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T17:40:01.993613] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-29T17:40:02.572440] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T17:40:02.644680] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T17:40:02.793740] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-29T17:40:03.593603] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-29T17:40:03.929772] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T17:40:04.393543] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-29T17:40:04.473451] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T17:40:05.193735] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-29T17:40:05.415626] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T17:40:05.716365] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T17:40:05.993559] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-29T17:40:06.793549] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-29T17:40:07.242272] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:40:07.593551] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-29T17:40:07.833058] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T17:40:08.190751] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T17:40:08.393530] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-29T17:40:09.167136] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-29T17:40:09.193593] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-29T17:40:09.993548] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-29T17:40:10.132490] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T17:40:10.793616] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-29T17:40:10.954219] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T17:40:11.593555] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-29T17:40:11.911849] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T17:40:12.190386] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T17:40:12.393598] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-29T17:40:13.193590] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-29T17:40:13.446965] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T17:40:13.993616] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-29T17:40:14.058919] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T17:40:14.063447] [INFO ] [REMOTE ] BOE: Full fetch complete (26568 records). [2025-10-29T17:40:14.063525] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-29T17:40:14.424153] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-29T17:40:14.424246] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-29T17:40:14.424968] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-29T17:40:14.425051] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-29T17:40:14.426113] [DEBUG] [LOCAL ] BOE: Trimmed 26568 records to 17294 (keeping 200 days of data) [2025-10-29T17:40:14.534398] [DEBUG] [LOCAL ] BOE: Primary data saved (17294 records). [2025-10-29T17:40:14.534538] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-29T17:40:14.534608] [INFO ] [MAIN ] Update Progress: 321/2367 symbols completed. BOE took 27.2s. Estimated remaining: 4h 16m 14s. Rate: 8.0 symbols/min [2025-10-29T17:40:14.699806] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:40:14.745574] [DEBUG] [LOCAL ] BORR: Loaded 51050 existing records from primary storage. [2025-10-29T17:40:14.745888] [INFO ] [MAIN ] BORR: Loaded 51050 existing records. [2025-10-29T17:40:14.798812] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-29T17:40:14.920903] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:40:14.921111] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-29T17:40:14.921156] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-29T17:40:14.922083] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-29T17:40:14.922140] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-29T17:40:15.279110] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:40:15.302911] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T17:40:15.593698] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-29T17:40:16.123687] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T17:40:16.131204] [INFO ] [REMOTE ] BOND: Full fetch complete (46650 records). [2025-10-29T17:40:16.131351] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-29T17:40:16.400429] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-29T17:40:16.544114] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-29T17:40:16.544261] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-29T17:40:16.544953] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-29T17:40:16.545093] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-29T17:40:16.546477] [DEBUG] [LOCAL ] BOND: Trimmed 46650 records to 32239 (keeping 200 days of data) [2025-10-29T17:40:16.673506] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T17:40:16.769697] [DEBUG] [LOCAL ] BOND: Primary data saved (32239 records). [2025-10-29T17:40:16.769841] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-29T17:40:16.769913] [INFO ] [MAIN ] Update Progress: 322/2367 symbols completed. BOND took 29.4s. Estimated remaining: 4h 15m 33s. Rate: 8.0 symbols/min [2025-10-29T17:40:16.951108] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:40:16.973228] [DEBUG] [LOCAL ] BOW: Loaded 22520 existing records from primary storage. [2025-10-29T17:40:16.973475] [INFO ] [MAIN ] BOW: Loaded 22520 existing records. [2025-10-29T17:40:17.168212] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:40:17.168411] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-29T17:40:17.168457] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-29T17:40:17.168851] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-29T17:40:17.168911] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-29T17:40:17.202276] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-29T17:40:17.561153] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:40:17.993534] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-29T17:40:18.136841] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-29T17:40:18.168376] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T17:40:18.167469] [INFO ] [REMOTE ] BOH: Full fetch complete (45499 records). [2025-10-29T17:40:18.175898] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-29T17:40:18.561472] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-29T17:40:18.561555] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-29T17:40:18.562190] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-29T17:40:18.562255] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-29T17:40:18.563310] [DEBUG] [LOCAL ] BOH: Trimmed 45499 records to 30400 (keeping 200 days of data) [2025-10-29T17:40:18.742746] [DEBUG] [LOCAL ] BOH: Primary data saved (30400 records). [2025-10-29T17:40:18.742883] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-29T17:40:18.742960] [INFO ] [MAIN ] Update Progress: 323/2367 symbols completed. BOH took 31.4s. Estimated remaining: 4h 14m 51s. Rate: 8.0 symbols/min [2025-10-29T17:40:18.798800] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-29T17:40:18.915304] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:40:18.961750] [DEBUG] [LOCAL ] BOX: Loaded 49960 existing records from primary storage. [2025-10-29T17:40:18.962076] [INFO ] [MAIN ] BOX: Loaded 49960 existing records. [2025-10-29T17:40:19.137507] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:40:19.137770] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-29T17:40:19.137817] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-29T17:40:19.138438] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-29T17:40:19.138494] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-29T17:40:19.525029] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:40:19.565892] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-29T17:40:19.593537] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-29T17:40:20.007461] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T17:40:20.019221] [INFO ] [REMOTE ] BOOT: Full fetch complete (59696 records). [2025-10-29T17:40:20.019403] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-29T17:40:20.399459] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-29T17:40:20.401400] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-29T17:40:20.420223] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-29T17:40:20.424316] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-29T17:40:20.425111] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-29T17:40:20.425177] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-29T17:40:20.426457] [DEBUG] [LOCAL ] BOOT: Trimmed 59696 records to 39038 (keeping 200 days of data) [2025-10-29T17:40:20.656349] [DEBUG] [LOCAL ] BOOT: Primary data saved (39038 records). [2025-10-29T17:40:20.656493] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-29T17:40:20.656570] [INFO ] [MAIN ] Update Progress: 324/2367 symbols completed. BOOT took 33.3s. Estimated remaining: 4h 14m 8s. Rate: 8.0 symbols/min [2025-10-29T17:40:20.825935] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:40:20.875568] [DEBUG] [LOCAL ] BP: Loaded 53705 existing records from primary storage. [2025-10-29T17:40:20.875877] [INFO ] [MAIN ] BP: Loaded 53705 existing records. [2025-10-29T17:40:21.047965] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:40:21.048158] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-29T17:40:21.048205] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-29T17:40:21.049066] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-29T17:40:21.049123] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-29T17:40:21.200727] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-29T17:40:21.397889] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:40:21.680264] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T17:40:21.993568] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-29T17:40:22.562942] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T17:40:22.793556] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-29T17:40:22.898310] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T17:40:23.593615] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-29T17:40:24.162278] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T17:40:24.263314] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T17:40:24.393539] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-29T17:40:25.193629] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-29T17:40:25.993559] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-29T17:40:26.071407] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-29T17:40:26.332038] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T17:40:26.793610] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-29T17:40:27.211214] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T17:40:27.590282] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T17:40:27.596672] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-29T17:40:28.393585] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-29T17:40:28.801897] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T17:40:29.193555] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-29T17:40:29.508430] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-29T17:40:29.884191] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-29T17:40:29.993544] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-29T17:40:30.793593] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-29T17:40:30.869372] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T17:40:31.593533] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-29T17:40:32.110788] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-29T17:40:32.216501] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T17:40:32.393552] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-29T17:40:32.979945] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-29T17:40:33.193622] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-29T17:40:33.993561] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-29T17:40:34.430157] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T17:40:34.777461] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T17:40:34.793513] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-29T17:40:35.420457] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T17:40:35.593545] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-29T17:40:36.393546] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-29T17:40:37.193578] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-29T17:40:37.245604] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-29T17:40:37.723164] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:40:37.957497] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T17:40:37.963185] [INFO ] [REMOTE ] BOW: Full fetch complete (32200 records). [2025-10-29T17:40:37.963268] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-29T17:40:37.998682] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-29T17:40:38.335425] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-29T17:40:38.335520] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-29T17:40:38.336135] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-29T17:40:38.336196] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-29T17:40:38.337196] [DEBUG] [LOCAL ] BOW: Trimmed 32200 records to 22530 (keeping 200 days of data) [2025-10-29T17:40:38.465360] [DEBUG] [LOCAL ] BOW: Primary data saved (22530 records). [2025-10-29T17:40:38.465482] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-29T17:40:38.465579] [INFO ] [MAIN ] Update Progress: 325/2367 symbols completed. BOW took 21.7s. Estimated remaining: 4h 15m 6s. Rate: 8.0 symbols/min [2025-10-29T17:40:38.637067] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:40:38.668931] [DEBUG] [LOCAL ] BR: Loaded 34189 existing records from primary storage. [2025-10-29T17:40:38.669214] [INFO ] [MAIN ] BR: Loaded 34189 existing records. [2025-10-29T17:40:38.798681] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-29T17:40:38.851715] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:40:38.851956] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-29T17:40:38.852004] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-29T17:40:38.852634] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-29T17:40:38.852733] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-29T17:40:39.206246] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:40:39.593555] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-29T17:40:39.738014] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-29T17:40:39.931384] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T17:40:40.393609] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-29T17:40:40.629528] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T17:40:41.193571] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-29T17:40:41.993572] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-29T17:40:42.245007] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-29T17:40:42.383297] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T17:40:42.793553] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-29T17:40:42.902186] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T17:40:43.593621] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-29T17:40:44.393597] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-29T17:40:44.776600] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-29T17:40:44.842446] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T17:40:45.193553] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-29T17:40:45.529520] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T17:40:45.993597] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-29T17:40:46.793634] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-29T17:40:47.013067] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-29T17:40:47.068178] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-29T17:40:47.593613] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-29T17:40:48.083124] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T17:40:48.393561] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-29T17:40:49.198784] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-29T17:40:49.229988] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-29T17:40:49.945664] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T17:40:49.993565] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-29T17:40:50.406898] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T17:40:50.793558] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-29T17:40:51.552581] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-29T17:40:51.593531] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-29T17:40:51.922418] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T17:40:52.393627] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-29T17:40:53.193533] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-29T17:40:53.371785] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-29T17:40:53.383182] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-29T17:40:53.383329] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-29T17:40:53.799477] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-29T17:40:53.799620] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-29T17:40:53.800572] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-29T17:40:53.800686] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-29T17:40:53.834402] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 53705 (keeping 200 days of data) [2025-10-29T17:40:53.836737] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T17:40:54.021771] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-29T17:40:54.187619] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T17:40:54.219700] [DEBUG] [LOCAL ] BP: Primary data saved (53705 records). [2025-10-29T17:40:54.219856] [INFO ] [MAIN ] BP: Full history saved. [2025-10-29T17:40:54.219941] [INFO ] [MAIN ] Update Progress: 326/2367 symbols completed. BP took 33.6s. Estimated remaining: 4h 15m 50s. Rate: 8.0 symbols/min [2025-10-29T17:40:54.418108] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:40:54.462276] [DEBUG] [LOCAL ] BRBR: Loaded 51854 existing records from primary storage. [2025-10-29T17:40:54.462597] [INFO ] [MAIN ] BRBR: Loaded 51854 existing records. [2025-10-29T17:40:54.639155] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:40:54.639371] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-29T17:40:54.639418] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-29T17:40:54.640149] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-29T17:40:54.640223] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-29T17:40:54.796149] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-29T17:40:54.994103] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:40:55.480191] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T17:40:55.490846] [INFO ] [REMOTE ] BORR: Full fetch complete (74531 records). [2025-10-29T17:40:55.490971] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-29T17:40:55.593593] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-29T17:40:55.915365] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-29T17:40:55.915453] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-29T17:40:55.916263] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-29T17:40:55.916327] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-29T17:40:55.917796] [DEBUG] [LOCAL ] BORR: Trimmed 74531 records to 51031 (keeping 200 days of data) [2025-10-29T17:40:56.200514] [DEBUG] [LOCAL ] BORR: Primary data saved (51031 records). [2025-10-29T17:40:56.200673] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-29T17:40:56.201343] [INFO ] [MAIN ] Update Progress: 327/2367 symbols completed. BORR took 41.7s. Estimated remaining: 4h 15m 8s. Rate: 8.0 symbols/min [2025-10-29T17:40:56.372616] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:40:56.401312] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-29T17:40:56.408431] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-29T17:40:56.424718] [INFO ] [REMOTE ] BOX: Full fetch complete (72320 records). [2025-10-29T17:40:56.424922] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-29T17:40:56.484016] [DEBUG] [LOCAL ] BRC: Loaded 17861 existing records from primary storage. [2025-10-29T17:40:56.504349] [INFO ] [MAIN ] BRC: Loaded 17861 existing records. [2025-10-29T17:40:56.850155] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:40:56.876902] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-29T17:40:56.882172] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-29T17:40:56.909524] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-29T17:40:56.934100] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-29T17:40:57.186451] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-29T17:40:57.196871] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-29T17:40:57.208002] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-29T17:40:57.226929] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-29T17:40:57.342721] [DEBUG] [LOCAL ] BOX: Trimmed 72320 records to 49974 (keeping 200 days of data) [2025-10-29T17:40:57.482224] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-29T17:40:57.563673] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-29T17:40:57.646081] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:40:57.841027] [DEBUG] [LOCAL ] BOX: Primary data saved (49974 records). [2025-10-29T17:40:57.841426] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-29T17:40:57.841724] [INFO ] [MAIN ] Update Progress: 328/2367 symbols completed. BOX took 39.1s. Estimated remaining: 4h 14m 24s. Rate: 8.0 symbols/min [2025-10-29T17:40:57.875465] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T17:40:57.999062] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-29T17:40:58.022287] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:40:58.060100] [DEBUG] [LOCAL ] BRCC: Loaded 39997 existing records from primary storage. [2025-10-29T17:40:58.060422] [INFO ] [MAIN ] BRCC: Loaded 39997 existing records. [2025-10-29T17:40:58.277942] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:40:58.278181] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-29T17:40:58.278229] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-29T17:40:58.278977] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-29T17:40:58.279037] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-29T17:40:58.641751] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:40:58.793547] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-29T17:40:58.813611] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-29T17:40:58.953132] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-29T17:40:59.593557] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-29T17:40:59.747175] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T17:41:00.393618] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-29T17:41:01.004842] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T17:41:01.183099] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T17:41:01.193514] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-29T17:41:01.999015] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-29T17:41:02.006834] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T17:41:02.793584] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-29T17:41:03.042095] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T17:41:03.593629] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-29T17:41:04.141792] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T17:41:04.308355] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T17:41:04.393524] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-29T17:41:05.101462] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-29T17:41:05.193560] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-29T17:41:05.993611] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-29T17:41:06.299052] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:41:06.793613] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-29T17:41:07.334396] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T17:41:07.593574] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-29T17:41:07.922386] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T17:41:08.331033] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T17:41:08.393567] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-29T17:41:09.193579] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-29T17:41:09.506162] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T17:41:09.513985] [INFO ] [REMOTE ] BR: Full fetch complete (49979 records). [2025-10-29T17:41:09.514138] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-29T17:41:09.923486] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-29T17:41:09.923629] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-29T17:41:09.924365] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-29T17:41:09.924500] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-29T17:41:09.925780] [DEBUG] [LOCAL ] BR: Trimmed 49979 records to 34227 (keeping 200 days of data) [2025-10-29T17:41:09.994017] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-29T17:41:10.049372] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-29T17:41:10.165720] [DEBUG] [LOCAL ] BR: Primary data saved (34227 records). [2025-10-29T17:41:10.165866] [INFO ] [MAIN ] BR: Full history saved. [2025-10-29T17:41:10.165972] [INFO ] [MAIN ] Update Progress: 329/2367 symbols completed. BR took 31.7s. Estimated remaining: 4h 14m 46s. Rate: 8.0 symbols/min [2025-10-29T17:41:10.349265] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:10.349463] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-29T17:41:10.349500] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-29T17:41:10.349614] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-29T17:41:10.349687] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-29T17:41:10.349746] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-29T17:41:10.349779] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-29T17:41:10.705600] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:10.793546] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-29T17:41:10.943505] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:41:10.943843] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-29T17:41:10.944016] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:41:10.944090] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-29T17:41:10.944151] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:41:10.944218] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-29T17:41:10.944279] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-29T17:41:10.944315] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-29T17:41:10.944353] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-29T17:41:10.944399] [INFO ] [MAIN ] Update Progress: 330/2367 symbols completed. BRCE took 0.8s. Estimated remaining: 4h 13m 57s. Rate: 8.0 symbols/min [2025-10-29T17:41:11.114494] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:11.114746] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-29T17:41:11.114813] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-29T17:41:11.114993] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-29T17:41:11.115065] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-29T17:41:11.115244] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-29T17:41:11.115299] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-29T17:41:11.235487] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T17:41:11.501571] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:11.593514] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-29T17:41:11.768583] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:41:11.768936] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-29T17:41:11.769018] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:41:11.769065] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-29T17:41:11.769098] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:41:11.769131] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-29T17:41:11.769179] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-29T17:41:11.769220] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-29T17:41:11.769257] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-29T17:41:11.769300] [INFO ] [MAIN ] Update Progress: 331/2367 symbols completed. BRIE took 0.8s. Estimated remaining: 4h 13m 9s. Rate: 8.0 symbols/min [2025-10-29T17:41:11.938541] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:11.986835] [DEBUG] [LOCAL ] BRO: Loaded 52100 existing records from primary storage. [2025-10-29T17:41:11.987130] [INFO ] [MAIN ] BRO: Loaded 52100 existing records. [2025-10-29T17:41:12.162027] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:41:12.162234] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-29T17:41:12.162280] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-29T17:41:12.163160] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-29T17:41:12.163216] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-29T17:41:12.399827] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-29T17:41:12.522736] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:13.193545] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-29T17:41:13.705970] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T17:41:13.770791] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-29T17:41:13.993563] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-29T17:41:14.645622] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-29T17:41:14.793587] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-29T17:41:15.593548] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-29T17:41:16.124833] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T17:41:16.393588] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-29T17:41:17.028090] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T17:41:17.193608] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-29T17:41:17.425776] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T17:41:17.927814] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-29T17:41:17.931718] [INFO ] [REMOTE ] BRC: Full fetch complete (28164 records). [2025-10-29T17:41:17.931848] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-29T17:41:17.998703] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-29T17:41:18.307688] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-29T17:41:18.307821] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-29T17:41:18.308281] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-29T17:41:18.308343] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-29T17:41:18.309149] [DEBUG] [LOCAL ] BRC: Trimmed 28164 records to 17821 (keeping 200 days of data) [2025-10-29T17:41:18.420815] [DEBUG] [LOCAL ] BRC: Primary data saved (17821 records). [2025-10-29T17:41:18.420987] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-29T17:41:18.421122] [INFO ] [MAIN ] Update Progress: 332/2367 symbols completed. BRC took 22.2s. Estimated remaining: 4h 12m 57s. Rate: 8.0 symbols/min [2025-10-29T17:41:18.590929] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:18.640939] [DEBUG] [LOCAL ] BROS: Loaded 53295 existing records from primary storage. [2025-10-29T17:41:18.641248] [INFO ] [MAIN ] BROS: Loaded 53295 existing records. [2025-10-29T17:41:18.797822] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-29T17:41:18.824945] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:41:18.825973] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-29T17:41:18.826033] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-29T17:41:18.826736] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-29T17:41:18.826793] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-29T17:41:19.205835] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:19.228187] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T17:41:19.593548] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-29T17:41:20.227619] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-29T17:41:20.393593] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-29T17:41:21.193556] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-29T17:41:21.241640] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-29T17:41:21.522470] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T17:41:21.993557] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-29T17:41:22.473280] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T17:41:22.793595] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-29T17:41:23.112265] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T17:41:23.593602] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-29T17:41:23.967164] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T17:41:24.393625] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-29T17:41:25.008578] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-29T17:41:25.193564] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-29T17:41:25.295955] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T17:41:25.993560] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-29T17:41:26.720763] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T17:41:26.793618] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-29T17:41:27.313795] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T17:41:27.593698] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-29T17:41:27.859271] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-29T17:41:28.393607] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-29T17:41:29.062163] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T17:41:29.193556] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-29T17:41:29.878585] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T17:41:29.894457] [INFO ] [REMOTE ] BRBR: Full fetch complete (73378 records). [2025-10-29T17:41:29.894721] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-29T17:41:30.005727] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-29T17:41:30.338996] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-29T17:41:30.339083] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-29T17:41:30.339897] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-29T17:41:30.339963] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-29T17:41:30.341407] [DEBUG] [LOCAL ] BRBR: Trimmed 73378 records to 51878 (keeping 200 days of data) [2025-10-29T17:41:30.636798] [DEBUG] [LOCAL ] BRBR: Primary data saved (51878 records). [2025-10-29T17:41:30.636927] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-29T17:41:30.637005] [INFO ] [MAIN ] Update Progress: 333/2367 symbols completed. BRBR took 36.4s. Estimated remaining: 4h 13m 18s. Rate: 8.0 symbols/min [2025-10-29T17:41:30.808183] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-29T17:41:30.810772] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:30.812130] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-29T17:41:30.812215] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-29T17:41:30.812401] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-29T17:41:30.812500] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-29T17:41:30.813126] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-29T17:41:30.813212] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-29T17:41:30.962269] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-29T17:41:31.233730] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:31.286807] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T17:41:31.297077] [INFO ] [REMOTE ] BRCC: Full fetch complete (57373 records). [2025-10-29T17:41:31.297337] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-29T17:41:31.602758] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-29T17:41:31.739427] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-29T17:41:31.739548] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-29T17:41:31.740723] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-29T17:41:31.740793] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-29T17:41:31.742556] [DEBUG] [LOCAL ] BRCC: Trimmed 57373 records to 40040 (keeping 200 days of data) [2025-10-29T17:41:31.828472] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:41:31.859837] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-29T17:41:31.860926] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:41:31.865054] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-29T17:41:31.872742] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:41:31.872866] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-29T17:41:31.872944] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-29T17:41:31.872991] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-29T17:41:31.873030] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-29T17:41:31.873084] [INFO ] [MAIN ] Update Progress: 334/2367 symbols completed. BRSL took 1.2s. Estimated remaining: 4h 12m 33s. Rate: 8.1 symbols/min [2025-10-29T17:41:32.111564] [DEBUG] [LOCAL ] BRCC: Primary data saved (40040 records). [2025-10-29T17:41:32.137908] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-29T17:41:32.155983] [INFO ] [MAIN ] Update Progress: 335/2367 symbols completed. BRCC took 34.3s. Estimated remaining: 4h 11m 42s. Rate: 8.1 symbols/min [2025-10-29T17:41:32.181762] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:32.367817] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:32.411948] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-29T17:41:32.436699] [DEBUG] [LOCAL ] BRSP: Loaded 35933 existing records from primary storage. [2025-10-29T17:41:32.437225] [DEBUG] [LOCAL ] BRT: Loaded 5156 existing records from primary storage. [2025-10-29T17:41:32.437884] [INFO ] [MAIN ] BRT: Loaded 5156 existing records. [2025-10-29T17:41:32.438094] [INFO ] [MAIN ] BRSP: Loaded 35933 existing records. [2025-10-29T17:41:32.464146] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-29T17:41:32.882982] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:41:32.894284] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-29T17:41:32.924327] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:41:32.924549] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-29T17:41:32.925139] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-29T17:41:32.925237] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-29T17:41:32.925558] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-29T17:41:32.925618] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-29T17:41:32.931044] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-29T17:41:32.950589] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-29T17:41:33.212822] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-29T17:41:33.762771] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:33.784701] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:33.959300] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-29T17:41:33.993564] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-29T17:41:34.652442] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-29T17:41:34.793680] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-29T17:41:35.043925] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T17:41:35.593596] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-29T17:41:36.044967] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T17:41:36.393573] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-29T17:41:36.773770] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T17:41:36.980750] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T17:41:37.193557] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-29T17:41:37.560771] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T17:41:37.993537] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-29T17:41:38.793682] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-29T17:41:39.458885] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T17:41:39.593518] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-29T17:41:39.863447] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T17:41:40.008595] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T17:41:40.393580] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-29T17:41:41.193556] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-29T17:41:41.876698] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T17:41:41.993572] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-29T17:41:42.214525] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T17:41:42.438113] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-29T17:41:42.793578] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-29T17:41:43.148503] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-29T17:41:43.593619] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-29T17:41:43.956620] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-29T17:41:44.393605] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-29T17:41:45.193575] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-29T17:41:45.993525] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-29T17:41:46.227931] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-29T17:41:46.239112] [INFO ] [REMOTE ] BROS: Full fetch complete (77274 records). [2025-10-29T17:41:46.239244] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-29T17:41:46.507145] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-29T17:41:46.644887] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-29T17:41:46.645005] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-29T17:41:46.645878] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-29T17:41:46.646083] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-29T17:41:46.648104] [DEBUG] [LOCAL ] BROS: Trimmed 77274 records to 53294 (keeping 200 days of data) [2025-10-29T17:41:46.777297] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-29T17:41:46.800062] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-29T17:41:47.034267] [DEBUG] [LOCAL ] BROS: Primary data saved (53294 records). [2025-10-29T17:41:47.034428] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-29T17:41:47.034995] [INFO ] [MAIN ] Update Progress: 336/2367 symbols completed. BROS took 28.6s. Estimated remaining: 4h 12m 19s. Rate: 8.0 symbols/min [2025-10-29T17:41:47.241975] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:47.264453] [DEBUG] [LOCAL ] BRW: Loaded 20781 existing records from primary storage. [2025-10-29T17:41:47.264728] [INFO ] [MAIN ] BRW: Loaded 20781 existing records. [2025-10-29T17:41:47.471251] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:41:47.471504] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-29T17:41:47.471571] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-29T17:41:47.472103] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-29T17:41:47.472163] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-29T17:41:47.598730] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-29T17:41:47.863160] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:48.398670] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-29T17:41:48.413283] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-29T17:41:48.990347] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T17:41:49.024133] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-29T17:41:49.193600] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-29T17:41:49.993578] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-29T17:41:50.050132] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T17:41:50.793575] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-29T17:41:50.925118] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T17:41:51.384636] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-29T17:41:51.593574] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-29T17:41:52.382604] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T17:41:52.393536] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-29T17:41:53.193531] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-29T17:41:53.409176] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-29T17:41:53.993634] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-29T17:41:54.465591] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-29T17:41:54.490852] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T17:41:54.793626] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-29T17:41:55.421721] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-29T17:41:55.593563] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-29T17:41:56.178409] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T17:41:56.393591] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-29T17:41:56.948252] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-29T17:41:56.951218] [INFO ] [REMOTE ] BRT: Full fetch complete (7144 records). [2025-10-29T17:41:56.951314] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-29T17:41:57.199481] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-29T17:41:57.322150] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-29T17:41:57.322233] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-29T17:41:57.322438] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-29T17:41:57.322477] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-29T17:41:57.322904] [DEBUG] [LOCAL ] BRT: Trimmed 7144 records to 5180 (keeping 200 days of data) [2025-10-29T17:41:57.354103] [DEBUG] [LOCAL ] BRT: Primary data saved (5180 records). [2025-10-29T17:41:57.354247] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-29T17:41:57.354329] [INFO ] [MAIN ] Update Progress: 337/2367 symbols completed. BRT took 25.2s. Estimated remaining: 4h 12m 29s. Rate: 8.0 symbols/min [2025-10-29T17:41:57.527091] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:57.571863] [DEBUG] [LOCAL ] BRX: Loaded 51800 existing records from primary storage. [2025-10-29T17:41:57.572200] [INFO ] [MAIN ] BRX: Loaded 51800 existing records. [2025-10-29T17:41:57.773303] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:41:57.773576] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-29T17:41:57.773626] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-29T17:41:57.774638] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-29T17:41:57.774728] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-29T17:41:57.998849] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-29T17:41:58.168299] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:41:58.792593] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T17:41:58.803531] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-29T17:41:58.808113] [INFO ] [REMOTE ] BRO: Full fetch complete (75169 records). [2025-10-29T17:41:58.808369] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-29T17:41:59.229053] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-29T17:41:59.229162] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-29T17:41:59.230088] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-29T17:41:59.230166] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-29T17:41:59.256294] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:41:59.264351] [DEBUG] [LOCAL ] BRO: Trimmed 75169 records to 52110 (keeping 200 days of data) [2025-10-29T17:41:59.580604] [DEBUG] [LOCAL ] BRO: Primary data saved (52110 records). [2025-10-29T17:41:59.580766] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-29T17:41:59.580851] [INFO ] [MAIN ] Update Progress: 338/2367 symbols completed. BRO took 47.8s. Estimated remaining: 4h 11m 50s. Rate: 8.1 symbols/min [2025-10-29T17:41:59.601670] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-29T17:41:59.765572] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:41:59.795366] [DEBUG] [LOCAL ] BSAC: Loaded 32305 existing records from primary storage. [2025-10-29T17:41:59.795627] [INFO ] [MAIN ] BSAC: Loaded 32305 existing records. [2025-10-29T17:41:59.994549] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:41:59.994822] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-29T17:41:59.994880] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-29T17:41:59.995596] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-29T17:41:59.995743] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-29T17:42:00.208853] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-29T17:42:00.415781] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-29T17:42:00.421704] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:00.866403] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T17:42:01.193529] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-29T17:42:01.235615] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T17:42:01.993568] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-29T17:42:02.262363] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-29T17:42:02.270485] [INFO ] [REMOTE ] BRSP: Full fetch complete (53556 records). [2025-10-29T17:42:02.270737] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-29T17:42:02.271511] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:42:02.271603] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:42:02.271683] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:42:02.271747] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-29T17:42:02.271817] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-29T17:42:02.271853] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-10-29T17:42:02.272095] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-10-29T17:42:02.272210] [INFO ] [MAIN ] Update Progress: 339/2367 symbols completed. BRSP took 30.4s. Estimated remaining: 4h 11m 14s. Rate: 8.1 symbols/min [2025-10-29T17:42:02.464230] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:42:02.503571] [DEBUG] [LOCAL ] BSBR: Loaded 35513 existing records from primary storage. [2025-10-29T17:42:02.504066] [INFO ] [MAIN ] BSBR: Loaded 35513 existing records. [2025-10-29T17:42:02.650600] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T17:42:02.727982] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:42:02.728276] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-29T17:42:02.728331] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-29T17:42:02.729099] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-29T17:42:02.729160] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-29T17:42:02.798893] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-29T17:42:03.144909] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:03.593712] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-29T17:42:03.677370] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T17:42:04.393609] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-29T17:42:04.435074] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T17:42:05.193606] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-29T17:42:05.561308] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T17:42:05.850140] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T17:42:05.993684] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-29T17:42:06.793584] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-29T17:42:06.979389] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T17:42:07.593609] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-29T17:42:07.618097] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T17:42:08.393565] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-29T17:42:09.000356] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T17:42:09.193541] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-29T17:42:09.278244] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T17:42:09.993707] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-29T17:42:10.342012] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T17:42:10.793545] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-29T17:42:10.949454] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T17:42:10.955587] [INFO ] [REMOTE ] BRW: Full fetch complete (30018 records). [2025-10-29T17:42:10.955886] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-29T17:42:11.369756] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-29T17:42:11.369866] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-29T17:42:11.370710] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-29T17:42:11.370780] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-29T17:42:11.371826] [DEBUG] [LOCAL ] BRW: Trimmed 30018 records to 20780 (keeping 200 days of data) [2025-10-29T17:42:11.507967] [DEBUG] [LOCAL ] BRW: Primary data saved (20780 records). [2025-10-29T17:42:11.508154] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-29T17:42:11.508262] [INFO ] [MAIN ] Update Progress: 340/2367 symbols completed. BRW took 24.5s. Estimated remaining: 4h 11m 18s. Rate: 8.1 symbols/min [2025-10-29T17:42:11.595070] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-29T17:42:11.718041] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:42:11.739322] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-29T17:42:11.756223] [DEBUG] [LOCAL ] BSL: Loaded 7990 existing records from primary storage. [2025-10-29T17:42:11.756787] [INFO ] [MAIN ] BSL: Loaded 7990 existing records. [2025-10-29T17:42:11.958831] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:42:11.959179] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-29T17:42:11.959238] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-29T17:42:11.959637] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-29T17:42:11.959737] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-29T17:42:12.361016] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:12.393547] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-29T17:42:12.880992] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T17:42:12.942788] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-29T17:42:13.193566] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-29T17:42:13.993577] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-29T17:42:14.322981] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T17:42:14.793592] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-29T17:42:15.222981] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T17:42:15.593539] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-29T17:42:15.807207] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T17:42:16.391013] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-29T17:42:16.400259] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-29T17:42:17.193576] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-29T17:42:17.614768] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-29T17:42:17.851850] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-29T17:42:17.993568] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-29T17:42:18.793569] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-29T17:42:18.836280] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-29T17:42:19.593571] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-29T17:42:20.134986] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T17:42:20.393532] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-29T17:42:20.460309] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T17:42:20.880822] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-29T17:42:21.193566] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-29T17:42:21.698901] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T17:42:21.993566] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-29T17:42:22.793585] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-29T17:42:23.143703] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T17:42:23.593567] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-29T17:42:23.741411] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T17:42:24.393592] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-29T17:42:24.877011] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T17:42:24.889636] [INFO ] [REMOTE ] BRX: Full fetch complete (75184 records). [2025-10-29T17:42:24.889847] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-29T17:42:25.203927] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-29T17:42:25.337139] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-29T17:42:25.337313] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-29T17:42:25.338169] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-29T17:42:25.338333] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-29T17:42:25.361627] [DEBUG] [LOCAL ] BRX: Trimmed 75184 records to 51812 (keeping 200 days of data) [2025-10-29T17:42:25.362857] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T17:42:25.671174] [DEBUG] [LOCAL ] BRX: Primary data saved (51812 records). [2025-10-29T17:42:25.671298] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-29T17:42:25.671374] [INFO ] [MAIN ] Update Progress: 341/2367 symbols completed. BRX took 28.3s. Estimated remaining: 4h 11m 50s. Rate: 8.0 symbols/min [2025-10-29T17:42:25.847840] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:42:25.879177] [DEBUG] [LOCAL ] BSM: Loaded 31800 existing records from primary storage. [2025-10-29T17:42:25.879424] [INFO ] [MAIN ] BSM: Loaded 31800 existing records. [2025-10-29T17:42:25.998815] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-29T17:42:26.078570] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:42:26.078920] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-29T17:42:26.079165] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-29T17:42:26.085491] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-29T17:42:26.096003] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-29T17:42:26.102272] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T17:42:26.488222] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:26.793554] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-29T17:42:27.118370] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T17:42:27.125560] [INFO ] [REMOTE ] BSAC: Full fetch complete (45569 records). [2025-10-29T17:42:27.126002] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-29T17:42:27.507776] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-29T17:42:27.507857] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-29T17:42:27.508437] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-29T17:42:27.508476] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-29T17:42:27.509506] [DEBUG] [LOCAL ] BSAC: Trimmed 45569 records to 32220 (keeping 200 days of data) [2025-10-29T17:42:27.595283] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-29T17:42:27.728401] [DEBUG] [LOCAL ] BSAC: Primary data saved (32220 records). [2025-10-29T17:42:27.728715] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-29T17:42:27.728936] [INFO ] [MAIN ] Update Progress: 342/2367 symbols completed. BSAC took 28.1s. Estimated remaining: 4h 11m 11s. Rate: 8.1 symbols/min [2025-10-29T17:42:27.842538] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-29T17:42:27.955283] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:42:27.955541] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-10-29T17:42:27.955581] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-10-29T17:42:27.955736] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-29T17:42:27.955785] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-29T17:42:27.955829] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-29T17:42:27.955862] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-29T17:42:28.351462] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:28.393523] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-29T17:42:28.599343] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-29T17:42:29.193534] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-29T17:42:29.353769] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-29T17:42:29.993600] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-29T17:42:30.185864] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T17:42:30.793530] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-29T17:42:30.828685] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-29T17:42:31.593553] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-29T17:42:31.698950] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-29T17:42:32.393525] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-29T17:42:32.483614] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-29T17:42:33.193579] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-29T17:42:33.280825] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T17:42:33.993550] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-29T17:42:34.176583] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T17:42:34.793578] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-29T17:42:34.899322] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T17:42:35.593552] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-29T17:42:35.717320] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T17:42:36.393616] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-29T17:42:36.407186] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T17:42:37.201268] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-29T17:42:37.207882] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T17:42:37.980556] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T17:42:37.993524] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-29T17:42:38.793364] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T17:42:38.793585] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-29T17:42:39.593573] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-29T17:42:39.767117] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T17:42:40.129799] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-29T17:42:40.393619] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-29T17:42:41.193624] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-29T17:42:41.522970] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-29T17:42:41.531078] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T17:42:41.993590] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-29T17:42:42.793576] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-29T17:42:42.834854] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T17:42:43.593598] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-29T17:42:43.841681] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T17:42:44.393622] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-29T17:42:44.538590] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T17:42:44.546194] [INFO ] [REMOTE ] BSBR: Full fetch complete (50891 records). [2025-10-29T17:42:44.546340] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-29T17:42:44.928217] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-29T17:42:44.928301] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-29T17:42:44.928953] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-29T17:42:44.929014] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-29T17:42:44.930123] [DEBUG] [LOCAL ] BSBR: Trimmed 50891 records to 35555 (keeping 200 days of data) [2025-10-29T17:42:45.127291] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T17:42:45.149021] [DEBUG] [LOCAL ] BSBR: Primary data saved (35555 records). [2025-10-29T17:42:45.149147] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-29T17:42:45.149221] [INFO ] [MAIN ] Update Progress: 343/2367 symbols completed. BSBR took 42.9s. Estimated remaining: 4h 12m 2s. Rate: 8.0 symbols/min [2025-10-29T17:42:45.198711] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-29T17:42:45.336513] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:42:45.360161] [DEBUG] [LOCAL ] BSTZ: Loaded 24145 existing records from primary storage. [2025-10-29T17:42:45.360419] [INFO ] [MAIN ] BSTZ: Loaded 24145 existing records. [2025-10-29T17:42:45.550198] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:42:45.550498] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-29T17:42:45.550554] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-29T17:42:45.551051] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-29T17:42:45.551109] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-29T17:42:45.915928] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:45.993527] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-29T17:42:46.205135] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T17:42:46.721194] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-29T17:42:46.793621] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-29T17:42:47.593555] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-29T17:42:47.769529] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T17:42:47.776483] [INFO ] [REMOTE ] BSM: Full fetch complete (46402 records). [2025-10-29T17:42:47.776607] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-29T17:42:48.157463] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-29T17:42:48.157546] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-29T17:42:48.158175] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-29T17:42:48.158239] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-29T17:42:48.159367] [DEBUG] [LOCAL ] BSM: Trimmed 46402 records to 31732 (keeping 200 days of data) [2025-10-29T17:42:48.351042] [DEBUG] [LOCAL ] BSM: Primary data saved (31732 records). [2025-10-29T17:42:48.351199] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-29T17:42:48.351321] [INFO ] [MAIN ] Update Progress: 344/2367 symbols completed. BSM took 22.7s. Estimated remaining: 4h 11m 30s. Rate: 8.0 symbols/min [2025-10-29T17:42:48.402774] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-29T17:42:48.539513] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:42:48.557355] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T17:42:48.612258] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-29T17:42:48.612547] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-29T17:42:48.801909] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:42:48.802113] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-29T17:42:48.802160] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-29T17:42:48.803075] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-29T17:42:48.803138] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-29T17:42:48.985723] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-29T17:42:49.171394] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:49.193532] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-29T17:42:49.993606] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-29T17:42:50.633203] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T17:42:50.759469] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T17:42:50.793583] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-29T17:42:51.511606] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-29T17:42:51.593555] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-29T17:42:52.288826] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T17:42:52.393614] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-29T17:42:53.193573] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-29T17:42:53.343275] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T17:42:53.351901] [INFO ] [REMOTE ] BST: Full fetch complete (28147 records). [2025-10-29T17:42:53.352050] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-29T17:42:53.746454] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-29T17:42:53.746538] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-29T17:42:53.747042] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-29T17:42:53.747106] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-29T17:42:53.747835] [DEBUG] [LOCAL ] BST: Trimmed 28147 records to 17904 (keeping 200 days of data) [2025-10-29T17:42:53.857394] [DEBUG] [LOCAL ] BST: Primary data saved (17904 records). [2025-10-29T17:42:53.857537] [INFO ] [MAIN ] BST: Full history saved. [2025-10-29T17:42:53.857609] [INFO ] [MAIN ] Update Progress: 345/2367 symbols completed. BST took 26.1s. Estimated remaining: 4h 11m 11s. Rate: 8.1 symbols/min [2025-10-29T17:42:53.998433] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-29T17:42:54.028988] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:42:54.036287] [DEBUG] [LOCAL ] BTA: Loaded 5643 existing records from primary storage. [2025-10-29T17:42:54.036476] [INFO ] [MAIN ] BTA: Loaded 5643 existing records. [2025-10-29T17:42:54.216927] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:42:54.217159] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-29T17:42:54.217212] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-29T17:42:54.217424] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-29T17:42:54.217480] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-29T17:42:54.583202] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:54.584538] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T17:42:54.617790] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T17:42:54.793574] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-29T17:42:55.333895] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T17:42:55.593638] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-29T17:42:56.393715] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-29T17:42:56.877924] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T17:42:57.068191] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-29T17:42:57.070971] [INFO ] [REMOTE ] BSL: Full fetch complete (13069 records). [2025-10-29T17:42:57.071064] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-29T17:42:57.198773] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-29T17:42:57.446483] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-29T17:42:57.446581] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-29T17:42:57.446937] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-29T17:42:57.446999] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-29T17:42:57.447585] [DEBUG] [LOCAL ] BSL: Trimmed 13069 records to 8001 (keeping 200 days of data) [2025-10-29T17:42:57.497357] [DEBUG] [LOCAL ] BSL: Primary data saved (8001 records). [2025-10-29T17:42:57.497498] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-29T17:42:57.497577] [INFO ] [MAIN ] Update Progress: 346/2367 symbols completed. BSL took 46.0s. Estimated remaining: 4h 10m 41s. Rate: 8.1 symbols/min [2025-10-29T17:42:57.664998] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:42:57.717155] [DEBUG] [LOCAL ] BTE: Loaded 52665 existing records from primary storage. [2025-10-29T17:42:57.717569] [INFO ] [MAIN ] BTE: Loaded 52665 existing records. [2025-10-29T17:42:57.919331] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:42:57.927941] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-29T17:42:57.927746] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-29T17:42:57.928049] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-29T17:42:57.931639] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-29T17:42:57.931731] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-29T17:42:57.998744] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-29T17:42:58.300102] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:42:58.793615] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-29T17:42:59.477950] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T17:42:59.593584] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-29T17:42:59.736176] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T17:43:00.127804] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T17:43:00.393575] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-29T17:43:00.796003] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T17:43:01.193569] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-29T17:43:01.720918] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T17:43:01.993823] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-29T17:43:02.702070] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T17:43:02.793820] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-29T17:43:03.593558] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-29T17:43:04.046859] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T17:43:04.357224] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T17:43:04.393590] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-29T17:43:05.186107] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T17:43:05.193510] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-29T17:43:05.993545] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-29T17:43:06.067397] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T17:43:06.793615] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-29T17:43:07.481662] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-29T17:43:07.593591] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-29T17:43:07.915551] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T17:43:08.393593] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-29T17:43:08.870959] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T17:43:08.915039] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-29T17:43:09.193577] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-29T17:43:09.993575] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-29T17:43:10.456522] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T17:43:10.493019] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T17:43:10.793593] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-29T17:43:11.196253] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-29T17:43:11.593605] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-29T17:43:12.393582] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-29T17:43:12.420332] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T17:43:13.193609] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-29T17:43:13.685219] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-29T17:43:13.739179] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T17:43:13.993568] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-29T17:43:14.793532] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-29T17:43:14.955043] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-29T17:43:15.188365] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T17:43:15.593630] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-29T17:43:16.156936] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-29T17:43:16.158826] [INFO ] [REMOTE ] BTA: Full fetch complete (8882 records). [2025-10-29T17:43:16.158913] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-29T17:43:16.398975] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-29T17:43:16.533066] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-29T17:43:16.533139] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-29T17:43:16.533385] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-29T17:43:16.533425] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-29T17:43:16.533872] [DEBUG] [LOCAL ] BTA: Trimmed 8882 records to 5582 (keeping 200 days of data) [2025-10-29T17:43:16.567215] [DEBUG] [LOCAL ] BTA: Primary data saved (5582 records). [2025-10-29T17:43:16.567357] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-29T17:43:16.567442] [INFO ] [MAIN ] Update Progress: 347/2367 symbols completed. BTA took 22.7s. Estimated remaining: 4h 11m 41s. Rate: 8.0 symbols/min [2025-10-29T17:43:16.746732] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:43:16.793871] [DEBUG] [LOCAL ] BTI: Loaded 53583 existing records from primary storage. [2025-10-29T17:43:16.794169] [INFO ] [MAIN ] BTI: Loaded 53583 existing records. [2025-10-29T17:43:16.986948] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:43:16.987245] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-29T17:43:16.987323] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-29T17:43:16.988579] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-29T17:43:16.988660] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-29T17:43:17.199886] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-29T17:43:17.369576] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:43:17.993603] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-29T17:43:18.056491] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-29T17:43:18.582334] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T17:43:18.793555] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-29T17:43:19.593542] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-29T17:43:19.666222] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-29T17:43:19.986397] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-29T17:43:20.360164] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T17:43:20.366000] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36009 records). [2025-10-29T17:43:20.366188] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-29T17:43:20.400923] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-29T17:43:20.757917] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-29T17:43:20.757994] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-29T17:43:20.758745] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-29T17:43:20.758806] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-29T17:43:20.759550] [DEBUG] [LOCAL ] BSTZ: Trimmed 36009 records to 24123 (keeping 200 days of data) [2025-10-29T17:43:20.902513] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24123 records). [2025-10-29T17:43:20.902679] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-29T17:43:20.902772] [INFO ] [MAIN ] Update Progress: 348/2367 symbols completed. BSTZ took 35.8s. Estimated remaining: 4h 11m 16s. Rate: 8.0 symbols/min [2025-10-29T17:43:21.073087] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:43:21.081900] [DEBUG] [LOCAL ] BTO: Loaded 8608 existing records from primary storage. [2025-10-29T17:43:21.082093] [INFO ] [MAIN ] BTO: Loaded 8608 existing records. [2025-10-29T17:43:21.198711] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-29T17:43:21.267537] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:43:21.267746] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-29T17:43:21.267797] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-29T17:43:21.268085] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-29T17:43:21.268145] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-29T17:43:21.628972] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:43:21.933869] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-29T17:43:21.993560] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-29T17:43:22.533345] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T17:43:22.793568] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-29T17:43:23.206511] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T17:43:23.416426] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-29T17:43:23.593619] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-29T17:43:24.393568] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-29T17:43:24.989816] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T17:43:25.001853] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-29T17:43:25.002079] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-29T17:43:25.198902] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-29T17:43:25.334892] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-29T17:43:25.449568] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-29T17:43:25.449671] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-29T17:43:25.450484] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-29T17:43:25.450526] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-29T17:43:25.451987] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 53688 (keeping 200 days of data) [2025-10-29T17:43:25.763436] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-29T17:43:25.763560] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-29T17:43:25.763635] [INFO ] [MAIN ] Update Progress: 349/2367 symbols completed. BSX took 37.4s. Estimated remaining: 4h 10m 53s. Rate: 8.0 symbols/min [2025-10-29T17:43:25.885723] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T17:43:25.945707] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:43:25.960974] [DEBUG] [LOCAL ] BTT: Loaded 15008 existing records from primary storage. [2025-10-29T17:43:25.961210] [INFO ] [MAIN ] BTT: Loaded 15008 existing records. [2025-10-29T17:43:25.999030] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-29T17:43:26.144597] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:43:26.144890] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-29T17:43:26.144939] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-29T17:43:26.145364] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-29T17:43:26.145422] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-29T17:43:26.495300] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:43:26.793557] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-29T17:43:27.344748] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T17:43:27.593605] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-29T17:43:28.114982] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-29T17:43:28.241792] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T17:43:28.393590] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-29T17:43:28.904484] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T17:43:29.193583] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-29T17:43:29.894269] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-29T17:43:29.993564] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-29T17:43:30.793590] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-29T17:43:31.593554] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-29T17:43:31.635501] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-29T17:43:32.067581] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T17:43:32.106325] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T17:43:32.393606] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-29T17:43:32.879157] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-29T17:43:33.193580] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-29T17:43:33.993692] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-29T17:43:34.468352] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T17:43:34.793569] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-29T17:43:35.450180] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-29T17:43:35.593567] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-29T17:43:36.204603] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T17:43:36.255671] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T17:43:36.266838] [INFO ] [REMOTE ] BTE: Full fetch complete (76351 records). [2025-10-29T17:43:36.266961] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-29T17:43:36.408257] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-29T17:43:36.659245] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-29T17:43:36.659326] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-29T17:43:36.660138] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-29T17:43:36.660202] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-29T17:43:36.661683] [DEBUG] [LOCAL ] BTE: Trimmed 76351 records to 52664 (keeping 200 days of data) [2025-10-29T17:43:36.968312] [DEBUG] [LOCAL ] BTE: Primary data saved (52664 records). [2025-10-29T17:43:36.968423] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-29T17:43:36.968498] [INFO ] [MAIN ] Update Progress: 350/2367 symbols completed. BTE took 39.5s. Estimated remaining: 4h 11m 7s. Rate: 8.0 symbols/min [2025-10-29T17:43:37.140753] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:43:37.188505] [DEBUG] [LOCAL ] BTU: Loaded 53318 existing records from primary storage. [2025-10-29T17:43:37.188870] [INFO ] [MAIN ] BTU: Loaded 53318 existing records. [2025-10-29T17:43:37.199889] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-29T17:43:37.371963] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:43:37.372189] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-29T17:43:37.372261] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-29T17:43:37.373392] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-29T17:43:37.373455] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-29T17:43:37.756271] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:43:37.993571] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-29T17:43:38.015188] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-29T17:43:38.350362] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-29T17:43:38.631035] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-29T17:43:38.793614] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-29T17:43:39.576484] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-29T17:43:39.593514] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-29T17:43:40.267304] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T17:43:40.393522] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-29T17:43:41.051273] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T17:43:41.193568] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-29T17:43:41.993546] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-29T17:43:42.601625] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-29T17:43:42.793619] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-29T17:43:43.494033] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-29T17:43:43.593624] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-29T17:43:43.851059] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T17:43:44.393613] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-29T17:43:45.011104] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-29T17:43:45.074659] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T17:43:45.193620] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-29T17:43:45.993572] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-29T17:43:46.486038] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-29T17:43:46.793736] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-29T17:43:47.041495] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-29T17:43:47.053575] [INFO ] [REMOTE ] BTI: Full fetch complete (77660 records). [2025-10-29T17:43:47.053821] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-29T17:43:47.530187] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-29T17:43:47.530296] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-29T17:43:47.531544] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-29T17:43:47.531615] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-29T17:43:47.533713] [DEBUG] [LOCAL ] BTI: Trimmed 77660 records to 53583 (keeping 200 days of data) [2025-10-29T17:43:47.600162] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-29T17:43:47.900938] [DEBUG] [LOCAL ] BTI: Primary data saved (53583 records). [2025-10-29T17:43:47.901151] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-29T17:43:47.901272] [INFO ] [MAIN ] Update Progress: 351/2367 symbols completed. BTI took 31.3s. Estimated remaining: 4h 11m 20s. Rate: 8.0 symbols/min [2025-10-29T17:43:48.101461] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:43:48.101817] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-29T17:43:48.101973] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-29T17:43:48.102177] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-29T17:43:48.102275] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-29T17:43:48.102462] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-29T17:43:48.102557] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-29T17:43:48.312402] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T17:43:48.398392] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-29T17:43:48.546574] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-29T17:43:48.615004] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:43:49.193583] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-29T17:43:49.221250] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T17:43:49.339878] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:43:49.340381] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-29T17:43:49.340480] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:43:49.340591] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-29T17:43:49.340690] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:43:49.340771] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-29T17:43:49.340844] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-29T17:43:49.340883] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-29T17:43:49.340922] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-29T17:43:49.340973] [INFO ] [MAIN ] Update Progress: 352/2367 symbols completed. BTX took 1.4s. Estimated remaining: 4h 10m 37s. Rate: 8.0 symbols/min [2025-10-29T17:43:49.536101] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:43:49.563892] [DEBUG] [LOCAL ] BTZ: Loaded 21866 existing records from primary storage. [2025-10-29T17:43:49.564367] [INFO ] [MAIN ] BTZ: Loaded 21866 existing records. [2025-10-29T17:43:49.767217] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:43:49.767530] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-29T17:43:49.767584] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-29T17:43:49.768211] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-29T17:43:49.768272] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-29T17:43:49.998841] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-29T17:43:50.151045] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:43:50.766297] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T17:43:50.793521] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-29T17:43:51.476832] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-29T17:43:51.480492] [INFO ] [REMOTE ] BTT: Full fetch complete (22448 records). [2025-10-29T17:43:51.480629] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-29T17:43:51.596425] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-29T17:43:51.899445] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-29T17:43:51.899599] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-29T17:43:51.900260] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-29T17:43:51.900334] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-29T17:43:51.901528] [DEBUG] [LOCAL ] BTT: Trimmed 22448 records to 14930 (keeping 200 days of data) [2025-10-29T17:43:52.009214] [DEBUG] [LOCAL ] BTT: Primary data saved (14930 records). [2025-10-29T17:43:52.009373] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-29T17:43:52.009466] [INFO ] [MAIN ] Update Progress: 353/2367 symbols completed. BTT took 26.2s. Estimated remaining: 4h 10m 3s. Rate: 8.1 symbols/min [2025-10-29T17:43:52.182117] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:43:52.227561] [DEBUG] [LOCAL ] BUD: Loaded 52576 existing records from primary storage. [2025-10-29T17:43:52.227905] [INFO ] [MAIN ] BUD: Loaded 52576 existing records. [2025-10-29T17:43:52.400430] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-29T17:43:52.405712] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:43:52.406940] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-29T17:43:52.407085] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-29T17:43:52.408169] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-29T17:43:52.408257] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-29T17:43:52.596711] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-29T17:43:52.780858] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:43:53.193602] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-29T17:43:53.951866] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T17:43:53.993580] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-29T17:43:54.547681] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T17:43:54.793560] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-29T17:43:55.294153] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T17:43:55.593575] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-29T17:43:56.181833] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T17:43:56.185745] [INFO ] [REMOTE ] BTO: Full fetch complete (13292 records). [2025-10-29T17:43:56.195286] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-29T17:43:56.245315] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T17:43:56.398637] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-29T17:43:56.648405] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-29T17:43:56.648481] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-29T17:43:56.648793] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-29T17:43:56.648854] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-29T17:43:56.649318] [DEBUG] [LOCAL ] BTO: Trimmed 13292 records to 8607 (keeping 200 days of data) [2025-10-29T17:43:56.699860] [DEBUG] [LOCAL ] BTO: Primary data saved (8607 records). [2025-10-29T17:43:56.699988] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-29T17:43:56.700064] [INFO ] [MAIN ] Update Progress: 354/2367 symbols completed. BTO took 35.8s. Estimated remaining: 4h 9m 40s. Rate: 8.1 symbols/min [2025-10-29T17:43:56.865477] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:43:56.876381] [DEBUG] [LOCAL ] BUI: Loaded 11546 existing records from primary storage. [2025-10-29T17:43:56.876581] [INFO ] [MAIN ] BUI: Loaded 11546 existing records. [2025-10-29T17:43:57.059339] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:43:57.059568] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-29T17:43:57.059622] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-29T17:43:57.059982] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-29T17:43:57.060038] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-29T17:43:57.198720] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-29T17:43:57.413928] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:43:57.845723] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-29T17:43:57.993549] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-29T17:43:58.694352] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-29T17:43:58.793560] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-29T17:43:59.467902] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T17:43:59.601156] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-29T17:43:59.623605] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-29T17:44:00.222595] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T17:44:00.393576] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-29T17:44:00.950866] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-29T17:44:01.193553] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-29T17:44:01.993586] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-29T17:44:02.158222] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-29T17:44:02.793592] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-29T17:44:03.446789] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T17:44:03.593557] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-29T17:44:04.258770] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T17:44:04.295764] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-29T17:44:04.393558] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-29T17:44:05.193557] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-29T17:44:05.720876] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T17:44:05.993565] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-29T17:44:06.796940] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-29T17:44:06.805322] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-29T17:44:07.358079] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-29T17:44:07.475984] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T17:44:07.487219] [INFO ] [REMOTE ] BTU: Full fetch complete (77304 records). [2025-10-29T17:44:07.487360] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-29T17:44:07.598771] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-29T17:44:07.888865] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-29T17:44:07.888953] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-29T17:44:07.889911] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-29T17:44:07.889979] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-29T17:44:07.891421] [DEBUG] [LOCAL ] BTU: Trimmed 77304 records to 53317 (keeping 200 days of data) [2025-10-29T17:44:08.214285] [DEBUG] [LOCAL ] BTU: Primary data saved (53317 records). [2025-10-29T17:44:08.214433] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-29T17:44:08.215269] [INFO ] [MAIN ] Update Progress: 355/2367 symbols completed. BTU took 31.2s. Estimated remaining: 4h 9m 55s. Rate: 8.1 symbols/min [2025-10-29T17:44:08.391600] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:44:08.393605] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-29T17:44:08.437017] [DEBUG] [LOCAL ] BUR: Loaded 45403 existing records from primary storage. [2025-10-29T17:44:08.437330] [INFO ] [MAIN ] BUR: Loaded 45403 existing records. [2025-10-29T17:44:08.621171] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:44:08.621418] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-29T17:44:08.621517] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-29T17:44:08.622631] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-29T17:44:08.622739] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-29T17:44:08.999438] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:44:09.036423] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-29T17:44:09.193532] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-29T17:44:09.268445] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-29T17:44:09.993566] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-29T17:44:10.370886] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T17:44:10.618852] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T17:44:10.793573] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-29T17:44:11.593559] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-29T17:44:11.913883] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T17:44:12.264082] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-29T17:44:12.393575] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-29T17:44:13.193557] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-29T17:44:13.527621] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T17:44:13.993558] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-29T17:44:14.513294] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-29T17:44:14.660923] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T17:44:14.793580] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-29T17:44:15.593552] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-29T17:44:15.773097] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-29T17:44:16.393562] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-29T17:44:17.064204] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T17:44:17.193564] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-29T17:44:17.618796] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:44:17.828217] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T17:44:17.993556] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-29T17:44:18.722933] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-29T17:44:18.727045] [INFO ] [REMOTE ] BUI: Full fetch complete (16465 records). [2025-10-29T17:44:18.727135] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-29T17:44:18.798717] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-29T17:44:19.098111] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-29T17:44:19.098187] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-29T17:44:19.098529] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-29T17:44:19.098567] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-29T17:44:19.099071] [DEBUG] [LOCAL ] BUI: Trimmed 16465 records to 11528 (keeping 200 days of data) [2025-10-29T17:44:19.166405] [DEBUG] [LOCAL ] BUI: Primary data saved (11528 records). [2025-10-29T17:44:19.166530] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-29T17:44:19.166604] [INFO ] [MAIN ] Update Progress: 356/2367 symbols completed. BUI took 22.5s. Estimated remaining: 4h 10m 8s. Rate: 8.0 symbols/min [2025-10-29T17:44:19.334602] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:44:19.372362] [DEBUG] [LOCAL ] BURL: Loaded 45055 existing records from primary storage. [2025-10-29T17:44:19.372633] [INFO ] [MAIN ] BURL: Loaded 45055 existing records. [2025-10-29T17:44:19.547597] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:44:19.547808] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-29T17:44:19.547855] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-29T17:44:19.548599] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-29T17:44:19.548698] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-29T17:44:19.594194] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-29T17:44:19.823460] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-29T17:44:19.943305] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:44:20.393545] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-29T17:44:21.205851] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-29T17:44:21.220167] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-29T17:44:21.590611] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T17:44:21.888097] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T17:44:21.993622] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-29T17:44:22.793578] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-29T17:44:23.210000] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T17:44:23.593607] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-29T17:44:24.359809] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-29T17:44:24.387472] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T17:44:24.387751] [INFO ] [REMOTE ] BUD: Full fetch complete (76481 records). [2025-10-29T17:44:24.393561] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-29T17:44:24.393676] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-29T17:44:24.848005] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-29T17:44:24.848119] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-29T17:44:24.849467] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-29T17:44:24.849537] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-29T17:44:24.851600] [DEBUG] [LOCAL ] BUD: Trimmed 76481 records to 52576 (keeping 200 days of data) [2025-10-29T17:44:25.195731] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-29T17:44:25.203585] [DEBUG] [LOCAL ] BUD: Primary data saved (52576 records). [2025-10-29T17:44:25.205161] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-29T17:44:25.205306] [INFO ] [MAIN ] Update Progress: 357/2367 symbols completed. BUD took 33.2s. Estimated remaining: 4h 9m 52s. Rate: 8.0 symbols/min [2025-10-29T17:44:25.227002] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T17:44:25.993630] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-29T17:44:26.464281] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T17:44:26.793742] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-29T17:44:27.304638] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T17:44:27.593578] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-29T17:44:28.163311] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T17:44:28.393560] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-29T17:44:28.691414] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-29T17:44:29.193606] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-29T17:44:29.577676] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T17:44:29.947280] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T17:44:29.993572] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-29T17:44:30.793573] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-29T17:44:31.404585] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T17:44:31.593586] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-29T17:44:31.893826] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T17:44:32.393609] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-29T17:44:32.804223] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T17:44:33.191585] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T17:44:33.196715] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-29T17:44:33.197111] [INFO ] [REMOTE ] BTZ: Full fetch complete (33176 records). [2025-10-29T17:44:33.198110] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-29T17:44:33.567378] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-29T17:44:33.567461] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-29T17:44:33.567958] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-29T17:44:33.568018] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-29T17:44:33.568863] [DEBUG] [LOCAL ] BTZ: Trimmed 33176 records to 21816 (keeping 200 days of data) [2025-10-29T17:44:33.695242] [DEBUG] [LOCAL ] BTZ: Primary data saved (21816 records). [2025-10-29T17:44:33.695358] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-29T17:44:33.695428] [INFO ] [MAIN ] Update Progress: 358/2367 symbols completed. BTZ took 44.4s. Estimated remaining: 4h 9m 50s. Rate: 8.0 symbols/min [2025-10-29T17:44:33.993563] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-29T17:44:34.371034] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T17:44:34.793568] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-29T17:44:35.317580] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T17:44:35.593571] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-29T17:44:35.994271] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T17:44:36.393708] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-29T17:44:36.917166] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T17:44:36.927553] [INFO ] [REMOTE ] BUR: Full fetch complete (64856 records). [2025-10-29T17:44:36.927825] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-29T17:44:37.341426] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-29T17:44:37.341596] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-29T17:44:37.342443] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-29T17:44:37.342507] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-29T17:44:37.343883] [DEBUG] [LOCAL ] BUR: Trimmed 64856 records to 45471 (keeping 200 days of data) [2025-10-29T17:44:37.652385] [DEBUG] [LOCAL ] BUR: Primary data saved (45471 records). [2025-10-29T17:44:37.652782] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-29T17:44:37.654157] [INFO ] [MAIN ] Update Progress: 359/2367 symbols completed. BUR took 29.4s. Estimated remaining: 4h 9m 23s. Rate: 8.1 symbols/min [2025-10-29T17:44:37.655456] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T17:44:37.665864] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-29T17:44:38.937514] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-29T17:44:38.947747] [INFO ] [REMOTE ] BURL: Full fetch complete (65605 records). [2025-10-29T17:44:38.947916] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-29T17:44:39.334468] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-29T17:44:39.334547] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-29T17:44:39.335286] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-29T17:44:39.335348] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-29T17:44:39.336621] [DEBUG] [LOCAL ] BURL: Trimmed 65605 records to 45002 (keeping 200 days of data) [2025-10-29T17:44:39.598479] [DEBUG] [LOCAL ] BURL: Primary data saved (45002 records). [2025-10-29T17:44:39.598608] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-29T17:44:39.598713] [INFO ] [MAIN ] Update Progress: 360/2367 symbols completed. BURL took 20.4s. Estimated remaining: 4h 8m 45s. Rate: 8.1 symbols/min [2025-10-29T17:44:40.243275] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:44:40.246715] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:44:40.326543] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:44:40.322717] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:44:40.343011] [DEBUG] [LOCAL ] BUXX: Loaded 15150 existing records from primary storage. [2025-10-29T17:44:40.343586] [INFO ] [MAIN ] BUXX: Loaded 15150 existing records. [2025-10-29T17:44:40.529866] [DEBUG] [LOCAL ] BW: Loaded 40394 existing records from primary storage. [2025-10-29T17:44:40.529185] [DEBUG] [LOCAL ] BV: Loaded 38278 existing records from primary storage. [2025-10-29T17:44:40.584474] [DEBUG] [LOCAL ] BVN: Loaded 44573 existing records from primary storage. [2025-10-29T17:44:40.615018] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:44:40.608099] [INFO ] [MAIN ] BVN: Loaded 44573 existing records. [2025-10-29T17:44:40.620688] [INFO ] [MAIN ] BV: Loaded 38278 existing records. [2025-10-29T17:44:40.611728] [INFO ] [MAIN ] BW: Loaded 40394 existing records. [2025-10-29T17:44:40.615393] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-29T17:44:40.648772] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-29T17:44:40.732070] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-29T17:44:40.797782] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-29T17:44:41.242928] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:44:41.279217] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:44:41.307014] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-29T17:44:41.317441] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-29T17:44:41.322671] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-29T17:44:41.301284] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:44:41.327991] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-29T17:44:41.351899] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-29T17:44:41.352020] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-29T17:44:41.380412] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-29T17:44:41.380500] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-29T17:44:41.377859] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-29T17:44:41.404256] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-29T17:44:41.440131] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-29T17:44:41.503970] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-29T17:44:42.029259] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:44:42.161863] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-29T17:44:42.591000] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:44:42.618525] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-29T17:44:42.666024] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:44:42.677998] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-29T17:44:42.760336] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:44:42.761451] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-29T17:44:42.983786] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T17:44:42.986798] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-29T17:44:43.362101] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-29T17:44:43.364938] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-29T17:44:43.481443] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T17:44:43.487574] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-29T17:44:43.905391] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T17:44:43.915423] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-29T17:44:43.916667] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-29T17:44:44.035763] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T17:44:44.393520] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-29T17:44:44.467053] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T17:44:44.940717] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-29T17:44:45.059397] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T17:44:45.193604] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-29T17:44:45.993617] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-29T17:44:46.175720] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T17:44:46.793611] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-29T17:44:46.991062] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:44:47.593594] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-29T17:44:47.822248] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T17:44:48.328698] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-29T17:44:48.393552] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-29T17:44:49.193567] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-29T17:44:49.491306] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T17:44:49.993616] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-29T17:44:50.438839] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-29T17:44:50.511091] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-29T17:44:50.793623] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-29T17:44:51.593558] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-29T17:44:51.759812] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-29T17:44:52.393616] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-29T17:44:52.656529] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T17:44:53.193622] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-29T17:44:53.572930] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T17:44:53.900966] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T17:44:53.993613] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-29T17:44:54.793550] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-29T17:44:54.980679] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T17:44:55.593603] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-29T17:44:55.941370] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:44:56.393630] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-29T17:44:56.724430] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T17:44:57.193590] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-29T17:44:57.770865] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T17:44:57.993581] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-29T17:44:58.287344] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T17:44:58.793740] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-29T17:44:59.022747] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T17:44:59.593590] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-29T17:45:00.094834] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T17:45:00.120869] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T17:45:00.393685] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-29T17:45:01.193758] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-29T17:45:01.762823] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T17:45:01.779831] [INFO ] [REMOTE ] BW: Full fetch complete (59292 records). [2025-10-29T17:45:01.780107] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-29T17:45:01.978529] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T17:45:01.997056] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-29T17:45:02.375260] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-29T17:45:02.375422] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-29T17:45:02.377037] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-29T17:45:02.377124] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-29T17:45:02.379243] [DEBUG] [LOCAL ] BW: Trimmed 59292 records to 40402 (keeping 200 days of data) [2025-10-29T17:45:02.631587] [DEBUG] [LOCAL ] BW: Primary data saved (40402 records). [2025-10-29T17:45:02.631800] [INFO ] [MAIN ] BW: Full history saved. [2025-10-29T17:45:02.631905] [INFO ] [MAIN ] Update Progress: 361/2367 symbols completed. BW took 23.0s. Estimated remaining: 4h 10m 4s. Rate: 8.0 symbols/min [2025-10-29T17:45:02.794746] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-29T17:45:02.814433] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:02.869327] [DEBUG] [LOCAL ] BWA: Loaded 52002 existing records from primary storage. [2025-10-29T17:45:02.869796] [INFO ] [MAIN ] BWA: Loaded 52002 existing records. [2025-10-29T17:45:03.069022] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:45:03.069293] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-29T17:45:03.069345] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-29T17:45:03.070519] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-29T17:45:03.070583] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-29T17:45:03.471891] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:03.505862] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T17:45:03.593589] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-29T17:45:03.632446] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-29T17:45:03.636314] [INFO ] [REMOTE ] BUXX: Full fetch complete (20670 records). [2025-10-29T17:45:03.636459] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-29T17:45:03.637169] [FATAL] [VALIDATOR ] BUXX: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:45:03.637270] [FATAL] [MAIN ] BUXX: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:45:03.637314] [WARN ] [MAIN ] BUXX: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:45:03.637357] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-29T17:45:03.637422] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-29T17:45:03.637459] [INFO ] [LOCAL ] BUXX: Starting deletion of derivative data. [2025-10-29T17:45:03.637736] [DEBUG] [LOCAL ] BUXX: Deleted derivative data file. [2025-10-29T17:45:03.637841] [INFO ] [MAIN ] Update Progress: 362/2367 symbols completed. BUXX took 24.0s. Estimated remaining: 4h 9m 21s. Rate: 8.0 symbols/min [2025-10-29T17:45:03.814458] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:03.826476] [DEBUG] [LOCAL ] BWG: Loaded 12358 existing records from primary storage. [2025-10-29T17:45:03.826763] [INFO ] [MAIN ] BWG: Loaded 12358 existing records. [2025-10-29T17:45:04.000426] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:45:04.000638] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-29T17:45:04.000721] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-29T17:45:04.001191] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-29T17:45:04.001249] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-29T17:45:04.353993] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:04.393556] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-29T17:45:05.017015] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-29T17:45:05.193574] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-29T17:45:05.254315] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T17:45:05.993694] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-29T17:45:06.742677] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-29T17:45:06.793548] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-29T17:45:06.977167] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T17:45:07.275029] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-29T17:45:07.593583] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-29T17:45:08.393566] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-29T17:45:09.059710] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T17:45:09.193560] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-29T17:45:09.881561] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T17:45:09.993552] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-29T17:45:10.805248] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-29T17:45:10.839803] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-29T17:45:11.018504] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T17:45:11.593569] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-29T17:45:12.145472] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T17:45:12.393532] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-29T17:45:12.424044] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T17:45:13.193567] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-29T17:45:13.594806] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T17:45:13.592395] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T17:45:13.993555] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-29T17:45:14.793616] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-29T17:45:15.271066] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T17:45:15.316528] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-29T17:45:15.593569] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-29T17:45:16.263182] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T17:45:16.393555] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-29T17:45:17.193577] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-29T17:45:17.640407] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T17:45:17.993544] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-29T17:45:18.358012] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T17:45:18.367571] [INFO ] [REMOTE ] BV: Full fetch complete (55217 records). [2025-10-29T17:45:18.367726] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-29T17:45:18.756348] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-29T17:45:18.756435] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-29T17:45:18.757130] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-29T17:45:18.757201] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-29T17:45:18.758392] [DEBUG] [LOCAL ] BV: Trimmed 55217 records to 38296 (keeping 200 days of data) [2025-10-29T17:45:18.813624] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-29T17:45:18.985166] [DEBUG] [LOCAL ] BV: Primary data saved (38296 records). [2025-10-29T17:45:18.985302] [INFO ] [MAIN ] BV: Full history saved. [2025-10-29T17:45:18.985378] [INFO ] [MAIN ] Update Progress: 363/2367 symbols completed. BV took 39.4s. Estimated remaining: 4h 9m 57s. Rate: 8.0 symbols/min [2025-10-29T17:45:19.189088] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:19.218773] [DEBUG] [LOCAL ] BWLP: Loaded 31688 existing records from primary storage. [2025-10-29T17:45:19.219059] [INFO ] [MAIN ] BWLP: Loaded 31688 existing records. [2025-10-29T17:45:19.380412] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-29T17:45:19.417707] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:45:19.421264] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-29T17:45:19.421453] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-29T17:45:19.422336] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-29T17:45:19.422452] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-29T17:45:19.596855] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-29T17:45:19.723040] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-29T17:45:19.781307] [INFO ] [REMOTE ] BVN: Full fetch complete (63826 records). [2025-10-29T17:45:19.821476] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-29T17:45:19.867865] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:20.272315] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-29T17:45:20.272403] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-29T17:45:20.273145] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-29T17:45:20.273208] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-29T17:45:20.274484] [DEBUG] [LOCAL ] BVN: Trimmed 63826 records to 44527 (keeping 200 days of data) [2025-10-29T17:45:20.435091] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-29T17:45:20.526671] [DEBUG] [LOCAL ] BVN: Primary data saved (44527 records). [2025-10-29T17:45:20.526809] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-29T17:45:20.527857] [INFO ] [MAIN ] Update Progress: 364/2367 symbols completed. BVN took 40.9s. Estimated remaining: 4h 9m 17s. Rate: 8.0 symbols/min [2025-10-29T17:45:20.699399] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:20.709439] [DEBUG] [LOCAL ] BWMX: Loaded 8027 existing records from primary storage. [2025-10-29T17:45:20.709684] [INFO ] [MAIN ] BWMX: Loaded 8027 existing records. [2025-10-29T17:45:20.892180] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:45:20.892629] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-29T17:45:20.892807] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-29T17:45:20.893217] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-29T17:45:20.893277] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-29T17:45:21.181912] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T17:45:21.198524] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-29T17:45:21.289036] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:21.319040] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-29T17:45:21.993557] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-29T17:45:22.342173] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T17:45:22.793541] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-29T17:45:23.232606] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T17:45:23.324147] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T17:45:23.593562] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-29T17:45:24.161357] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-29T17:45:24.393621] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-29T17:45:25.034456] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-29T17:45:25.193608] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-29T17:45:25.993543] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-29T17:45:26.144477] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T17:45:26.400880] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T17:45:26.793556] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-29T17:45:27.171070] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T17:45:27.593558] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-29T17:45:28.393598] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-29T17:45:28.820578] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-29T17:45:29.158069] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-29T17:45:29.193594] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-29T17:45:29.940718] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-29T17:45:29.946708] [INFO ] [REMOTE ] BWG: Full fetch complete (17533 records). [2025-10-29T17:45:29.946886] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-29T17:45:29.998823] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-29T17:45:30.415949] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-29T17:45:30.416044] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-29T17:45:30.416446] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-29T17:45:30.416487] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-29T17:45:30.417063] [DEBUG] [LOCAL ] BWG: Trimmed 17533 records to 12322 (keeping 200 days of data) [2025-10-29T17:45:30.491054] [DEBUG] [LOCAL ] BWG: Primary data saved (12322 records). [2025-10-29T17:45:30.491199] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-29T17:45:30.491280] [INFO ] [MAIN ] Update Progress: 365/2367 symbols completed. BWG took 26.9s. Estimated remaining: 4h 9m 23s. Rate: 8.0 symbols/min [2025-10-29T17:45:30.685384] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:30.692328] [DEBUG] [LOCAL ] BWNB: Loaded 4035 existing records from primary storage. [2025-10-29T17:45:30.692568] [INFO ] [MAIN ] BWNB: Loaded 4035 existing records. [2025-10-29T17:45:30.798719] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-29T17:45:30.901087] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:45:30.901379] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-29T17:45:30.901435] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-29T17:45:30.901941] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-29T17:45:30.902173] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-29T17:45:31.284470] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:31.296535] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T17:45:31.593554] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-29T17:45:31.657889] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T17:45:31.669476] [INFO ] [REMOTE ] BWA: Full fetch complete (75848 records). [2025-10-29T17:45:31.669704] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-29T17:45:32.106862] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-29T17:45:32.107103] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-29T17:45:32.108288] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-29T17:45:32.108377] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-29T17:45:32.118756] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-29T17:45:32.123332] [DEBUG] [LOCAL ] BWA: Trimmed 75848 records to 51996 (keeping 200 days of data) [2025-10-29T17:45:32.398269] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-29T17:45:32.441501] [DEBUG] [LOCAL ] BWA: Primary data saved (51996 records). [2025-10-29T17:45:32.441679] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-29T17:45:32.441778] [INFO ] [MAIN ] Update Progress: 366/2367 symbols completed. BWA took 29.8s. Estimated remaining: 4h 8m 45s. Rate: 8.0 symbols/min [2025-10-29T17:45:32.635364] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:32.635595] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-10-29T17:45:32.635676] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-10-29T17:45:32.635819] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-29T17:45:32.635877] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-29T17:45:32.635971] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-10-29T17:45:32.636016] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-29T17:45:33.046919] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T17:45:33.067757] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:33.193597] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-29T17:45:33.587867] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-29T17:45:33.993574] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-29T17:45:34.318629] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-29T17:45:34.793571] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-29T17:45:35.593606] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-29T17:45:35.973968] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T17:45:36.071889] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-29T17:45:36.393568] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-29T17:45:36.877520] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-29T17:45:37.193555] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-29T17:45:37.993538] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-29T17:45:38.200176] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T17:45:38.239205] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-29T17:45:38.793584] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-29T17:45:39.593611] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-29T17:45:39.797292] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T17:45:40.022265] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-29T17:45:40.393560] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-29T17:45:40.828943] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-29T17:45:41.193619] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-29T17:45:41.624299] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-29T17:45:41.993570] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-29T17:45:42.484595] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-29T17:45:42.793599] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-29T17:45:43.593599] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-29T17:45:44.025822] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T17:45:44.111329] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-29T17:45:44.393567] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-29T17:45:45.193580] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-29T17:45:45.388169] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T17:45:45.705210] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-29T17:45:45.993531] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-29T17:45:46.612042] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T17:45:46.614013] [INFO ] [REMOTE ] BWMX: Full fetch complete (10046 records). [2025-10-29T17:45:46.614080] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-29T17:45:46.614433] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:45:46.614513] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:45:46.614554] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:45:46.614592] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-29T17:45:46.614665] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-29T17:45:46.614722] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-10-29T17:45:46.614961] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-10-29T17:45:46.615046] [INFO ] [MAIN ] Update Progress: 367/2367 symbols completed. BWMX took 26.1s. Estimated remaining: 4h 9m 15s. Rate: 8.0 symbols/min [2025-10-29T17:45:46.790207] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:46.793544] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-29T17:45:46.834739] [DEBUG] [LOCAL ] BWXT: Loaded 47089 existing records from primary storage. [2025-10-29T17:45:46.835026] [INFO ] [MAIN ] BWXT: Loaded 47089 existing records. [2025-10-29T17:45:47.026984] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:45:47.027245] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-29T17:45:47.027300] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-29T17:45:47.028288] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-29T17:45:47.028346] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-29T17:45:47.385108] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:47.593561] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-29T17:45:47.845431] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T17:45:48.393599] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-29T17:45:48.702086] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-29T17:45:48.853349] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T17:45:49.193581] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-29T17:45:49.600736] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T17:45:49.993543] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-29T17:45:50.368570] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-29T17:45:50.793571] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-29T17:45:51.593561] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-29T17:45:51.715603] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-29T17:45:52.092893] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-29T17:45:52.094422] [INFO ] [REMOTE ] BWSN: Full fetch complete (6445 records). [2025-10-29T17:45:52.094491] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-29T17:45:52.405311] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-29T17:45:52.446580] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-29T17:45:52.446688] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-29T17:45:52.446901] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-29T17:45:52.446942] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-29T17:45:52.447322] [DEBUG] [LOCAL ] BWSN: Trimmed 6445 records to 5024 (keeping 200 days of data) [2025-10-29T17:45:52.478242] [DEBUG] [LOCAL ] BWSN: Primary data saved (5024 records). [2025-10-29T17:45:52.478360] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-29T17:45:52.478430] [INFO ] [MAIN ] Update Progress: 368/2367 symbols completed. BWSN took 20.0s. Estimated remaining: 4h 8m 58s. Rate: 8.0 symbols/min [2025-10-29T17:45:52.642957] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:52.696122] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-29T17:45:52.696435] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-29T17:45:52.875925] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:45:52.876136] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-29T17:45:52.876183] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-29T17:45:52.877230] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-29T17:45:52.877288] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-29T17:45:53.199426] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-29T17:45:53.244876] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:53.594597] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T17:45:53.993597] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-29T17:45:54.457824] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-29T17:45:54.465932] [INFO ] [REMOTE ] BWLP: Full fetch complete (47821 records). [2025-10-29T17:45:54.466206] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-29T17:45:54.798954] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-29T17:45:54.927125] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-29T17:45:54.927209] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-29T17:45:54.927979] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-29T17:45:54.928043] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-29T17:45:54.929160] [DEBUG] [LOCAL ] BWLP: Trimmed 47821 records to 31700 (keeping 200 days of data) [2025-10-29T17:45:55.117217] [DEBUG] [LOCAL ] BWLP: Primary data saved (31700 records). [2025-10-29T17:45:55.117350] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-29T17:45:55.117426] [INFO ] [MAIN ] Update Progress: 369/2367 symbols completed. BWLP took 36.1s. Estimated remaining: 4h 8m 25s. Rate: 8.0 symbols/min [2025-10-29T17:45:55.320302] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:45:55.352430] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T17:45:55.367745] [DEBUG] [LOCAL ] BXC: Loaded 13065 existing records from primary storage. [2025-10-29T17:45:55.367992] [INFO ] [MAIN ] BXC: Loaded 13065 existing records. [2025-10-29T17:45:55.546519] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:45:55.546776] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-29T17:45:55.546826] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-29T17:45:55.547141] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-29T17:45:55.547197] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-29T17:45:55.600209] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-29T17:45:55.902896] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:45:56.366700] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-29T17:45:56.393528] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-29T17:45:56.829835] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-29T17:45:56.835521] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T17:45:57.193594] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-29T17:45:57.993552] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-29T17:45:58.437076] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:45:58.495570] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T17:45:58.793616] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-29T17:45:59.593615] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-29T17:46:00.009709] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-29T17:46:00.147851] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T17:46:00.393558] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-29T17:46:00.779102] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-29T17:46:01.193561] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-29T17:46:01.572404] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-29T17:46:01.993614] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-29T17:46:02.793560] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-29T17:46:03.301550] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T17:46:03.378566] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-29T17:46:03.593577] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-29T17:46:03.948607] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-29T17:46:04.393555] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-29T17:46:04.766519] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-29T17:46:04.767991] [INFO ] [REMOTE ] BWNB: Full fetch complete (5574 records). [2025-10-29T17:46:04.768087] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-29T17:46:04.768624] [FATAL] [VALIDATOR ] BWNB: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:46:04.768881] [FATAL] [MAIN ] BWNB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:46:04.768959] [WARN ] [MAIN ] BWNB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:46:04.769051] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-29T17:46:04.769150] [DEBUG] [LOCAL ] BWNB: No primary data file found to delete. [2025-10-29T17:46:04.769224] [INFO ] [LOCAL ] BWNB: Starting deletion of derivative data. [2025-10-29T17:46:04.769468] [DEBUG] [LOCAL ] BWNB: Deleted derivative data file. [2025-10-29T17:46:04.769575] [INFO ] [MAIN ] Update Progress: 370/2367 symbols completed. BWNB took 34.3s. Estimated remaining: 4h 8m 29s. Rate: 8.0 symbols/min [2025-10-29T17:46:04.940987] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:46:04.941154] [DEBUG] [LOCAL ] BXMT: No existing data file found in primary storage. [2025-10-29T17:46:04.941190] [WARN ] [MAIN ] BXMT: No existing data found, performing full refresh instead. [2025-10-29T17:46:04.941299] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-29T17:46:04.941338] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-29T17:46:04.941378] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-10-29T17:46:04.941409] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-29T17:46:05.198795] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-29T17:46:05.292416] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:46:05.993573] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-29T17:46:06.798792] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-29T17:46:06.816315] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-29T17:46:07.181766] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T17:46:07.315034] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T17:46:07.593561] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-29T17:46:08.393571] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-29T17:46:08.785015] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T17:46:08.937198] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T17:46:09.193580] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-29T17:46:09.993574] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-29T17:46:10.464839] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T17:46:10.793587] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-29T17:46:11.474424] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-29T17:46:11.593554] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-29T17:46:12.141463] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T17:46:12.345550] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-29T17:46:12.393544] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-29T17:46:13.003357] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-29T17:46:13.193548] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-29T17:46:13.993563] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-29T17:46:14.636598] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-29T17:46:14.720158] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T17:46:14.793551] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-29T17:46:15.511368] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T17:46:15.593596] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-29T17:46:16.182022] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T17:46:16.393634] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-29T17:46:17.193572] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-29T17:46:17.805345] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-29T17:46:17.983855] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-29T17:46:17.994568] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-29T17:46:18.793631] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-29T17:46:19.400847] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-29T17:46:19.404351] [INFO ] [REMOTE ] BXC: Full fetch complete (18298 records). [2025-10-29T17:46:19.404460] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-29T17:46:19.593830] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-29T17:46:19.823695] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-29T17:46:19.823844] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-29T17:46:19.824255] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-29T17:46:19.834203] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-29T17:46:19.853702] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-29T17:46:19.864421] [DEBUG] [LOCAL ] BXC: Trimmed 18298 records to 13068 (keeping 200 days of data) [2025-10-29T17:46:19.942890] [DEBUG] [LOCAL ] BXC: Primary data saved (13068 records). [2025-10-29T17:46:19.943022] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-29T17:46:19.943099] [INFO ] [MAIN ] Update Progress: 371/2367 symbols completed. BXC took 24.8s. Estimated remaining: 4h 9m 3s. Rate: 8.0 symbols/min [2025-10-29T17:46:20.113683] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:46:20.132470] [DEBUG] [LOCAL ] BXMX: Loaded 18686 existing records from primary storage. [2025-10-29T17:46:20.132741] [INFO ] [MAIN ] BXMX: Loaded 18686 existing records. [2025-10-29T17:46:20.308634] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:46:20.308867] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-29T17:46:20.308913] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-29T17:46:20.309289] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-29T17:46:20.309345] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-29T17:46:20.398630] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-29T17:46:20.660452] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:46:21.146523] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T17:46:21.193524] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-29T17:46:21.880124] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-29T17:46:21.993555] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-29T17:46:22.359808] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:46:22.793571] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-29T17:46:23.532371] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-29T17:46:23.593567] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-29T17:46:24.243749] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-29T17:46:24.337065] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-29T17:46:24.393594] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-29T17:46:25.193626] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-29T17:46:25.993620] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-29T17:46:26.283208] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-29T17:46:26.294038] [INFO ] [REMOTE ] BWXT: Full fetch complete (68093 records). [2025-10-29T17:46:26.294220] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-29T17:46:26.740473] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T17:46:26.752590] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-29T17:46:26.753193] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-29T17:46:26.754065] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-29T17:46:26.754153] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-29T17:46:26.755721] [DEBUG] [LOCAL ] BWXT: Trimmed 68093 records to 47088 (keeping 200 days of data) [2025-10-29T17:46:26.813156] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-29T17:46:26.886493] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T17:46:27.076928] [DEBUG] [LOCAL ] BWXT: Primary data saved (47088 records). [2025-10-29T17:46:27.077093] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-29T17:46:27.078095] [INFO ] [MAIN ] Update Progress: 372/2367 symbols completed. BWXT took 40.5s. Estimated remaining: 4h 8m 54s. Rate: 8.0 symbols/min [2025-10-29T17:46:27.254376] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:46:27.302231] [DEBUG] [LOCAL ] BXP: Loaded 49707 existing records from primary storage. [2025-10-29T17:46:27.302533] [INFO ] [MAIN ] BXP: Loaded 49707 existing records. [2025-10-29T17:46:27.487835] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:46:27.488054] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-29T17:46:27.488101] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-29T17:46:27.488853] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-29T17:46:27.488910] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-29T17:46:27.598857] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-29T17:46:27.845308] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:46:27.874272] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-29T17:46:28.393574] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-29T17:46:29.084730] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T17:46:29.193562] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-29T17:46:29.670850] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T17:46:29.880619] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T17:46:29.993582] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-29T17:46:30.793681] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-29T17:46:30.821238] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T17:46:31.593596] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-29T17:46:32.138528] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T17:46:32.393534] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-29T17:46:33.053270] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-29T17:46:33.086045] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-29T17:46:33.193572] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-29T17:46:33.993558] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-29T17:46:34.529304] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T17:46:34.540404] [INFO ] [REMOTE ] BXMT: Full fetch complete (69852 records). [2025-10-29T17:46:34.540536] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-29T17:46:34.804062] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-29T17:46:34.861046] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T17:46:34.959679] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-29T17:46:34.959769] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-29T17:46:34.960594] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-29T17:46:34.960679] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-29T17:46:34.962008] [DEBUG] [LOCAL ] BXMT: Trimmed 69852 records to 47117 (keeping 200 days of data) [2025-10-29T17:46:35.243871] [DEBUG] [LOCAL ] BXMT: Primary data saved (47117 records). [2025-10-29T17:46:35.243995] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-29T17:46:35.244065] [INFO ] [MAIN ] Update Progress: 373/2367 symbols completed. BXMT took 30.5s. Estimated remaining: 4h 8m 50s. Rate: 8.0 symbols/min [2025-10-29T17:46:35.410476] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:46:35.410723] [DEBUG] [LOCAL ] BXSL: No existing data file found in primary storage. [2025-10-29T17:46:35.410772] [WARN ] [MAIN ] BXSL: No existing data found, performing full refresh instead. [2025-10-29T17:46:35.410846] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-29T17:46:35.410882] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-29T17:46:35.410921] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-29T17:46:35.410953] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-29T17:46:35.600124] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-29T17:46:35.764440] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:46:36.036544] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T17:46:36.393584] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-29T17:46:37.193551] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-29T17:46:37.428977] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-29T17:46:37.440581] [INFO ] [REMOTE ] BX: Full fetch complete (77611 records). [2025-10-29T17:46:37.440780] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-29T17:46:37.870892] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-29T17:46:37.871004] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-29T17:46:37.871983] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-29T17:46:37.872145] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-29T17:46:37.873989] [DEBUG] [LOCAL ] BX: Trimmed 77611 records to 53481 (keeping 200 days of data) [2025-10-29T17:46:37.970800] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-29T17:46:38.015029] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-29T17:46:38.259635] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T17:46:38.278800] [DEBUG] [LOCAL ] BX: Primary data saved (53481 records). [2025-10-29T17:46:38.278938] [INFO ] [MAIN ] BX: Full history saved. [2025-10-29T17:46:38.279016] [INFO ] [MAIN ] Update Progress: 374/2367 symbols completed. BX took 45.8s. Estimated remaining: 4h 8m 19s. Rate: 8.0 symbols/min [2025-10-29T17:46:38.468198] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:46:38.487136] [DEBUG] [LOCAL ] BY: Loaded 21442 existing records from primary storage. [2025-10-29T17:46:38.487392] [INFO ] [MAIN ] BY: Loaded 21442 existing records. [2025-10-29T17:46:38.678014] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:46:38.678266] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-29T17:46:38.678318] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-29T17:46:38.678800] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-29T17:46:38.678860] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-29T17:46:38.798745] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-29T17:46:39.047546] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:46:39.229016] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T17:46:39.500723] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T17:46:39.593606] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-29T17:46:40.393526] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-29T17:46:40.484717] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-29T17:46:41.193577] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-29T17:46:41.787300] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T17:46:41.864298] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T17:46:41.993550] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-29T17:46:42.793561] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-29T17:46:42.996604] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T17:46:43.370949] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-29T17:46:43.593578] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-29T17:46:44.393535] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-29T17:46:44.795883] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T17:46:45.193569] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-29T17:46:45.604029] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T17:46:45.703019] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T17:46:45.993553] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-29T17:46:46.793598] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-29T17:46:47.255943] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T17:46:47.593555] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-29T17:46:48.086467] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T17:46:48.198873] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-29T17:46:48.203176] [INFO ] [REMOTE ] BXMX: Full fetch complete (28318 records). [2025-10-29T17:46:48.203258] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-29T17:46:48.203706] [FATAL] [VALIDATOR ] BXMX: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:46:48.203786] [FATAL] [MAIN ] BXMX: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:46:48.203828] [WARN ] [MAIN ] BXMX: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:46:48.203867] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-29T17:46:48.203920] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-10-29T17:46:48.203957] [INFO ] [LOCAL ] BXMX: Starting deletion of derivative data. [2025-10-29T17:46:48.204128] [DEBUG] [LOCAL ] BXMX: Deleted derivative data file. [2025-10-29T17:46:48.204209] [INFO ] [MAIN ] Update Progress: 375/2367 symbols completed. BXMX took 28.3s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-10-29T17:46:48.369988] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:46:48.393556] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-29T17:46:48.407902] [DEBUG] [LOCAL ] BYD: Loaded 44940 existing records from primary storage. [2025-10-29T17:46:48.408154] [INFO ] [MAIN ] BYD: Loaded 44940 existing records. [2025-10-29T17:46:48.589075] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:46:48.589332] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-29T17:46:48.589382] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-29T17:46:48.590296] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-29T17:46:48.590353] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-29T17:46:48.946266] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:46:49.193565] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-29T17:46:49.316396] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T17:46:49.993611] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-29T17:46:50.459949] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T17:46:50.793623] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-29T17:46:51.210677] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T17:46:51.368166] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T17:46:51.593572] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-29T17:46:52.393572] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-29T17:46:52.834320] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:46:53.162984] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-29T17:46:53.193527] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-29T17:46:53.961246] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T17:46:53.993534] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-29T17:46:54.731946] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T17:46:54.793594] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-29T17:46:55.593545] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-29T17:46:55.994614] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T17:46:56.393565] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-29T17:46:56.873367] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T17:46:57.081166] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T17:46:57.193586] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-29T17:46:57.993557] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-29T17:46:58.507292] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T17:46:58.793545] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-29T17:46:59.206148] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T17:46:59.216882] [INFO ] [REMOTE ] BXP: Full fetch complete (72221 records). [2025-10-29T17:46:59.217047] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-29T17:46:59.596164] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-29T17:46:59.618232] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-29T17:46:59.618340] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-29T17:46:59.619955] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-29T17:46:59.620151] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-29T17:46:59.621665] [DEBUG] [LOCAL ] BXP: Trimmed 72221 records to 49716 (keeping 200 days of data) [2025-10-29T17:46:59.931252] [DEBUG] [LOCAL ] BXP: Primary data saved (49716 records). [2025-10-29T17:46:59.931389] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-29T17:46:59.932335] [INFO ] [MAIN ] Update Progress: 376/2367 symbols completed. BXP took 32.9s. Estimated remaining: 4h 8m 39s. Rate: 8.0 symbols/min [2025-10-29T17:47:00.105785] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:47:00.134616] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T17:47:00.148783] [DEBUG] [LOCAL ] BYM: Loaded 11239 existing records from primary storage. [2025-10-29T17:47:00.149011] [INFO ] [MAIN ] BYM: Loaded 11239 existing records. [2025-10-29T17:47:00.324861] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:47:00.325102] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-29T17:47:00.325152] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-29T17:47:00.325437] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-29T17:47:00.325494] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-29T17:47:00.403916] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-29T17:47:00.525274] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T17:47:00.604035] [INFO ] [REMOTE ] BY: Full fetch complete (29648 records). [2025-10-29T17:47:00.624614] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-29T17:47:00.636227] [FATAL] [VALIDATOR ] BY: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:47:00.646619] [FATAL] [MAIN ] BY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:47:00.680111] [WARN ] [MAIN ] BY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:47:00.683708] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-29T17:47:00.702927] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:47:00.703123] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-29T17:47:00.703226] [INFO ] [LOCAL ] BY: Starting deletion of derivative data. [2025-10-29T17:47:00.703743] [DEBUG] [LOCAL ] BY: Deleted derivative data file. [2025-10-29T17:47:00.703868] [INFO ] [MAIN ] Update Progress: 377/2367 symbols completed. BY took 22.4s. Estimated remaining: 4h 7m 56s. Rate: 8.0 symbols/min [2025-10-29T17:47:00.873803] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:47:00.902718] [DEBUG] [LOCAL ] BZH: Loaded 31574 existing records from primary storage. [2025-10-29T17:47:00.902995] [INFO ] [MAIN ] BZH: Loaded 31574 existing records. [2025-10-29T17:47:01.080732] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:47:01.080976] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-29T17:47:01.081024] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-29T17:47:01.081690] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-29T17:47:01.081749] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-29T17:47:01.198668] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-29T17:47:01.445175] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:47:01.667682] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T17:47:01.993566] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-29T17:47:02.542435] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T17:47:02.793588] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-29T17:47:03.022176] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-29T17:47:03.593563] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-29T17:47:04.055690] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:47:04.264204] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T17:47:04.393573] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-29T17:47:05.193579] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-29T17:47:05.331461] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T17:47:05.674669] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-29T17:47:05.993608] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-29T17:47:06.591390] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-29T17:47:06.793710] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-29T17:47:07.401443] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-29T17:47:07.593582] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-29T17:47:08.393530] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-29T17:47:08.477492] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T17:47:09.193567] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-29T17:47:09.745203] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T17:47:09.993589] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-29T17:47:10.188670] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-29T17:47:10.582132] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T17:47:10.793558] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-29T17:47:11.593550] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-29T17:47:11.807699] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T17:47:12.393703] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-29T17:47:12.891556] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T17:47:13.177971] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T17:47:13.193516] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-29T17:47:13.962617] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T17:47:13.993512] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-29T17:47:14.793554] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-29T17:47:14.826368] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T17:47:15.593593] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-29T17:47:16.393530] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-29T17:47:16.463724] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-29T17:47:16.474715] [INFO ] [REMOTE ] BXSL: Full fetch complete (70242 records). [2025-10-29T17:47:16.474837] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-29T17:47:16.885710] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-29T17:47:16.885811] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-29T17:47:16.886592] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-29T17:47:16.886787] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-29T17:47:16.913081] [DEBUG] [LOCAL ] BXSL: Trimmed 70242 records to 48171 (keeping 200 days of data) [2025-10-29T17:47:16.915018] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-29T17:47:17.201834] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-29T17:47:17.227907] [DEBUG] [LOCAL ] BXSL: Primary data saved (48171 records). [2025-10-29T17:47:17.228046] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-29T17:47:17.228117] [INFO ] [MAIN ] Update Progress: 378/2367 symbols completed. BXSL took 42.0s. Estimated remaining: 4h 8m 36s. Rate: 8.0 symbols/min [2025-10-29T17:47:17.409162] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:47:17.430499] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T17:47:17.480548] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-29T17:47:17.480900] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-29T17:47:17.663805] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:47:17.664040] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-29T17:47:17.664095] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-29T17:47:17.665236] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-29T17:47:17.665297] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-29T17:47:17.993839] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-29T17:47:18.018765] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:47:18.287327] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T17:47:18.793603] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-29T17:47:18.975301] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T17:47:18.981255] [INFO ] [REMOTE ] BZH: Full fetch complete (46878 records). [2025-10-29T17:47:18.981376] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-29T17:47:18.981997] [FATAL] [VALIDATOR ] BZH: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:47:18.982077] [FATAL] [MAIN ] BZH: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:47:18.982118] [WARN ] [MAIN ] BZH: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:47:18.982155] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-29T17:47:18.982208] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-10-29T17:47:18.982246] [INFO ] [LOCAL ] BZH: Starting deletion of derivative data. [2025-10-29T17:47:18.982433] [DEBUG] [LOCAL ] BZH: Deleted derivative data file. [2025-10-29T17:47:18.982523] [INFO ] [MAIN ] Update Progress: 379/2367 symbols completed. BZH took 18.3s. Estimated remaining: 4h 7m 59s. Rate: 8.0 symbols/min [2025-10-29T17:47:19.147519] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:47:19.164954] [DEBUG] [LOCAL ] CAAP: Loaded 19752 existing records from primary storage. [2025-10-29T17:47:19.165179] [INFO ] [MAIN ] CAAP: Loaded 19752 existing records. [2025-10-29T17:47:19.336959] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:47:19.337172] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-29T17:47:19.337218] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-29T17:47:19.337729] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-29T17:47:19.337788] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-29T17:47:19.602852] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-29T17:47:19.703509] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:47:20.042570] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T17:47:20.227614] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T17:47:20.393707] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-29T17:47:21.193733] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-29T17:47:21.548350] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T17:47:21.993712] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-29T17:47:22.704877] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T17:47:22.799010] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-29T17:47:22.820107] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-29T17:47:23.593556] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-29T17:47:24.001359] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T17:47:24.145191] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-29T17:47:24.393605] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-29T17:47:25.193609] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-29T17:47:25.761139] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T17:47:25.836621] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T17:47:25.993559] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-29T17:47:26.793614] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-29T17:47:27.514281] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T17:47:27.600258] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-29T17:47:27.628550] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-29T17:47:28.296894] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T17:47:28.393561] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-29T17:47:29.063376] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T17:47:29.193592] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-29T17:47:29.818265] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T17:47:29.993612] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-29T17:47:30.607254] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-29T17:47:30.793610] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-29T17:47:31.333585] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T17:47:31.593578] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-29T17:47:32.393627] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-29T17:47:32.975412] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:47:32.986142] [INFO ] [REMOTE ] BYD: Full fetch complete (65668 records). [2025-10-29T17:47:32.986295] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-29T17:47:33.202737] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-29T17:47:33.348482] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T17:47:33.446214] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-29T17:47:33.446302] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-29T17:47:33.447145] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-29T17:47:33.447212] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-29T17:47:33.448555] [DEBUG] [LOCAL ] BYD: Trimmed 65668 records to 44947 (keeping 200 days of data) [2025-10-29T17:47:33.717502] [DEBUG] [LOCAL ] BYD: Primary data saved (44947 records). [2025-10-29T17:47:33.717632] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-29T17:47:33.717747] [INFO ] [MAIN ] Update Progress: 380/2367 symbols completed. BYD took 45.5s. Estimated remaining: 4h 8m 29s. Rate: 8.0 symbols/min [2025-10-29T17:47:33.915974] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:47:33.934856] [DEBUG] [LOCAL ] CABO: Loaded 16475 existing records from primary storage. [2025-10-29T17:47:33.935123] [INFO ] [MAIN ] CABO: Loaded 16475 existing records. [2025-10-29T17:47:33.999597] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-29T17:47:34.123406] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:47:34.123741] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-29T17:47:34.123795] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-29T17:47:34.124203] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-29T17:47:34.124262] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-29T17:47:34.475061] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:47:34.667736] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-29T17:47:34.670846] [INFO ] [REMOTE ] BYM: Full fetch complete (17330 records). [2025-10-29T17:47:34.670930] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-29T17:47:34.798675] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-29T17:47:35.061942] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-29T17:47:35.062094] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-29T17:47:35.062735] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-29T17:47:35.062871] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-29T17:47:35.063683] [DEBUG] [LOCAL ] BYM: Trimmed 17330 records to 11222 (keeping 200 days of data) [2025-10-29T17:47:35.130920] [DEBUG] [LOCAL ] BYM: Primary data saved (11222 records). [2025-10-29T17:47:35.131198] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-29T17:47:35.131339] [INFO ] [MAIN ] Update Progress: 381/2367 symbols completed. BYM took 35.2s. Estimated remaining: 4h 7m 50s. Rate: 8.0 symbols/min [2025-10-29T17:47:35.291271] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-29T17:47:35.346558] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:47:35.368222] [DEBUG] [LOCAL ] CACI: Loaded 21921 existing records from primary storage. [2025-10-29T17:47:35.368492] [INFO ] [MAIN ] CACI: Loaded 21921 existing records. [2025-10-29T17:47:35.564950] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:47:35.565426] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-29T17:47:35.565508] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-29T17:47:35.577309] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-29T17:47:35.577845] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-29T17:47:35.577751] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T17:47:35.599778] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-29T17:47:35.972410] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:47:36.393568] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-29T17:47:36.996558] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T17:47:37.203702] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-29T17:47:37.228129] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-29T17:47:37.993540] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-29T17:47:38.033997] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T17:47:38.793540] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-29T17:47:39.391910] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-29T17:47:39.445585] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-29T17:47:39.593560] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-29T17:47:40.393611] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-29T17:47:41.193539] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-29T17:47:41.236252] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T17:47:41.383699] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T17:47:41.993545] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-29T17:47:42.120325] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T17:47:42.125436] [INFO ] [REMOTE ] CAAP: Full fetch complete (28184 records). [2025-10-29T17:47:42.125513] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-29T17:47:42.514422] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-29T17:47:42.514499] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-29T17:47:42.515024] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-29T17:47:42.515086] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-29T17:47:42.515809] [DEBUG] [LOCAL ] CAAP: Trimmed 28184 records to 19799 (keeping 200 days of data) [2025-10-29T17:47:42.625604] [DEBUG] [LOCAL ] CAAP: Primary data saved (19799 records). [2025-10-29T17:47:42.625764] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-29T17:47:42.625845] [INFO ] [MAIN ] Update Progress: 382/2367 symbols completed. CAAP took 23.6s. Estimated remaining: 4h 7m 42s. Rate: 8.0 symbols/min [2025-10-29T17:47:42.802530] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-29T17:47:42.805627] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:47:42.847179] [DEBUG] [LOCAL ] CADE: Loaded 49726 existing records from primary storage. [2025-10-29T17:47:42.847470] [INFO ] [MAIN ] CADE: Loaded 49726 existing records. [2025-10-29T17:47:43.034729] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:47:43.034959] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-29T17:47:43.035006] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-29T17:47:43.036046] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-29T17:47:43.036104] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-29T17:47:43.418904] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:47:43.525554] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T17:47:43.593521] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-29T17:47:43.763807] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T17:47:44.393576] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-29T17:47:45.193579] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-29T17:47:45.194722] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-29T17:47:45.394713] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-29T17:47:45.906562] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-29T17:47:45.993517] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-29T17:47:46.793558] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-29T17:47:47.593556] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-29T17:47:47.835282] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-29T17:47:47.877996] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-29T17:47:48.393565] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-29T17:47:49.193519] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-29T17:47:49.391063] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-29T17:47:49.402276] [INFO ] [REMOTE ] C: Full fetch complete (77919 records). [2025-10-29T17:47:49.402407] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-29T17:47:49.817309] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-29T17:47:49.817669] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-29T17:47:49.819813] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T17:47:49.818812] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-29T17:47:49.827332] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-29T17:47:49.829215] [DEBUG] [LOCAL ] C: Trimmed 77919 records to 53741 (keeping 200 days of data) [2025-10-29T17:47:49.955800] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T17:47:50.024523] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-29T17:47:50.170914] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-10-29T17:47:50.171059] [INFO ] [MAIN ] C: Full history saved. [2025-10-29T17:47:50.171143] [INFO ] [MAIN ] Update Progress: 383/2367 symbols completed. C took 32.9s. Estimated remaining: 4h 7m 35s. Rate: 8.0 symbols/min [2025-10-29T17:47:50.353060] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:47:50.386114] [DEBUG] [LOCAL ] CAE: Loaded 38660 existing records from primary storage. [2025-10-29T17:47:50.386397] [INFO ] [MAIN ] CAE: Loaded 38660 existing records. [2025-10-29T17:47:50.576714] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:47:50.576950] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-29T17:47:50.577004] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-29T17:47:50.577738] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-29T17:47:50.577801] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-29T17:47:50.803881] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-29T17:47:50.959311] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:47:50.974403] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T17:47:51.546712] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T17:47:51.593567] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-29T17:47:52.303684] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-29T17:47:52.393556] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-29T17:47:53.170867] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T17:47:53.193527] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-29T17:47:53.939961] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T17:47:53.993551] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-29T17:47:54.654330] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T17:47:54.793563] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-29T17:47:55.593581] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-29T17:47:55.760861] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T17:47:56.298043] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-29T17:47:56.393571] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-29T17:47:57.193582] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-29T17:47:57.607469] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T17:47:57.950704] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T17:47:57.993534] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-29T17:47:58.539846] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T17:47:58.793594] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-29T17:47:59.593564] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-29T17:48:00.033531] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T17:48:00.393565] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-29T17:48:00.407407] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-29T17:48:00.411761] [INFO ] [REMOTE ] CACI: Full fetch complete (38256 records). [2025-10-29T17:48:00.411843] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-29T17:48:00.820988] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-29T17:48:00.821072] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-29T17:48:00.821588] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-29T17:48:00.821628] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-29T17:48:00.822449] [DEBUG] [LOCAL ] CACI: Trimmed 38256 records to 21764 (keeping 200 days of data) [2025-10-29T17:48:00.948476] [DEBUG] [LOCAL ] CACI: Primary data saved (21764 records). [2025-10-29T17:48:00.948593] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-29T17:48:00.948688] [INFO ] [MAIN ] Update Progress: 384/2367 symbols completed. CACI took 25.8s. Estimated remaining: 4h 7m 45s. Rate: 8.0 symbols/min [2025-10-29T17:48:01.115066] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:48:01.119729] [DEBUG] [LOCAL ] CAF: Loaded 3372 existing records from primary storage. [2025-10-29T17:48:01.119873] [INFO ] [MAIN ] CAF: Loaded 3372 existing records. [2025-10-29T17:48:01.198724] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-29T17:48:01.298669] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:48:01.298872] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-29T17:48:01.298922] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-29T17:48:01.299095] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-29T17:48:01.299136] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-29T17:48:01.670475] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:48:01.692872] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T17:48:01.993545] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-29T17:48:02.429480] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T17:48:02.793578] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-29T17:48:03.015568] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-29T17:48:03.237178] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T17:48:03.593554] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-29T17:48:03.969557] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-29T17:48:04.393557] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-29T17:48:05.193559] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-29T17:48:05.475674] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T17:48:05.565787] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-29T17:48:05.993555] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-29T17:48:06.793575] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-29T17:48:07.233054] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T17:48:07.593552] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-29T17:48:07.888060] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T17:48:08.393563] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-29T17:48:08.832259] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:48:09.172399] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-29T17:48:09.175468] [INFO ] [REMOTE ] CABO: Full fetch complete (23061 records). [2025-10-29T17:48:09.175605] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-29T17:48:09.198789] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-29T17:48:09.582371] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-29T17:48:09.582451] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-29T17:48:09.582872] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-29T17:48:09.582931] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-29T17:48:09.583589] [DEBUG] [LOCAL ] CABO: Trimmed 23061 records to 16438 (keeping 200 days of data) [2025-10-29T17:48:09.682420] [DEBUG] [LOCAL ] CABO: Primary data saved (16438 records). [2025-10-29T17:48:09.682564] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-29T17:48:09.682667] [INFO ] [MAIN ] Update Progress: 385/2367 symbols completed. CABO took 36.0s. Estimated remaining: 4h 7m 44s. Rate: 8.0 symbols/min [2025-10-29T17:48:09.860108] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:48:09.912222] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-29T17:48:09.912554] [INFO ] [MAIN ] CAG: Loaded 53666 existing records. [2025-10-29T17:48:09.998706] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-29T17:48:10.104273] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:48:10.104531] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-29T17:48:10.104580] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-29T17:48:10.105358] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-29T17:48:10.105418] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-29T17:48:10.470983] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-29T17:48:10.509892] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:48:10.530394] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T17:48:10.793564] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-29T17:48:11.593555] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-29T17:48:11.937280] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T17:48:12.393581] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-29T17:48:12.766336] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T17:48:13.193581] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-29T17:48:13.961115] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-29T17:48:13.993529] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-29T17:48:14.605263] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-29T17:48:14.616358] [INFO ] [REMOTE ] CADE: Full fetch complete (70862 records). [2025-10-29T17:48:14.616499] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-29T17:48:14.805485] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-29T17:48:15.009059] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-29T17:48:15.009164] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-29T17:48:15.010011] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-29T17:48:15.010092] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-29T17:48:15.011578] [DEBUG] [LOCAL ] CADE: Trimmed 70862 records to 49755 (keeping 200 days of data) [2025-10-29T17:48:15.256114] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T17:48:15.364552] [DEBUG] [LOCAL ] CADE: Primary data saved (49755 records). [2025-10-29T17:48:15.364719] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-29T17:48:15.364809] [INFO ] [MAIN ] Update Progress: 386/2367 symbols completed. CADE took 32.7s. Estimated remaining: 4h 7m 27s. Rate: 8.0 symbols/min [2025-10-29T17:48:15.476672] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T17:48:15.540892] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:48:15.587579] [DEBUG] [LOCAL ] CAH: Loaded 51348 existing records from primary storage. [2025-10-29T17:48:15.587940] [INFO ] [MAIN ] CAH: Loaded 51348 existing records. [2025-10-29T17:48:15.598730] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-29T17:48:15.779902] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:48:15.780103] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-29T17:48:15.780174] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-29T17:48:15.781009] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-29T17:48:15.781070] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-29T17:48:16.170065] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:48:16.393553] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-29T17:48:16.953688] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T17:48:17.193522] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-29T17:48:17.692999] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T17:48:17.993551] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-29T17:48:18.793584] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-29T17:48:19.103206] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:48:19.117226] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-29T17:48:19.593561] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-29T17:48:20.393562] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-29T17:48:20.747304] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-29T17:48:20.832861] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T17:48:21.193569] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-29T17:48:21.993581] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-29T17:48:22.272456] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T17:48:22.793561] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-29T17:48:23.158169] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T17:48:23.378301] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T17:48:23.593553] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-29T17:48:23.991337] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T17:48:24.393616] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-29T17:48:24.826158] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T17:48:24.827552] [INFO ] [REMOTE ] CAF: Full fetch complete (5574 records). [2025-10-29T17:48:24.827622] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-29T17:48:25.184591] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-29T17:48:25.184732] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-29T17:48:25.184923] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-29T17:48:25.184963] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-29T17:48:25.185320] [DEBUG] [LOCAL ] CAF: Trimmed 5574 records to 3345 (keeping 200 days of data) [2025-10-29T17:48:25.195126] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-29T17:48:25.206371] [DEBUG] [LOCAL ] CAF: Primary data saved (3345 records). [2025-10-29T17:48:25.206447] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-29T17:48:25.206517] [INFO ] [MAIN ] Update Progress: 387/2367 symbols completed. CAF took 24.3s. Estimated remaining: 4h 7m 31s. Rate: 8.0 symbols/min [2025-10-29T17:48:25.402091] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:48:25.449834] [DEBUG] [LOCAL ] CAL: Loaded 42431 existing records from primary storage. [2025-10-29T17:48:25.450123] [INFO ] [MAIN ] CAL: Loaded 42431 existing records. [2025-10-29T17:48:25.642493] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:48:25.642732] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-29T17:48:25.642784] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-29T17:48:25.643561] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-29T17:48:25.643617] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-29T17:48:25.995032] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-29T17:48:26.022037] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:48:26.305961] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T17:48:26.793565] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-29T17:48:27.244688] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:48:27.593569] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-29T17:48:28.039436] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T17:48:28.048081] [INFO ] [REMOTE ] CAE: Full fetch complete (56600 records). [2025-10-29T17:48:28.048227] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-29T17:48:28.399588] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-29T17:48:28.433744] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-29T17:48:28.434570] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-29T17:48:28.435282] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-29T17:48:28.435345] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-29T17:48:28.436557] [DEBUG] [LOCAL ] CAE: Trimmed 56600 records to 38626 (keeping 200 days of data) [2025-10-29T17:48:28.655415] [DEBUG] [LOCAL ] CAE: Primary data saved (38626 records). [2025-10-29T17:48:28.655766] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-29T17:48:28.655872] [INFO ] [MAIN ] Update Progress: 388/2367 symbols completed. CAE took 38.5s. Estimated remaining: 4h 7m 3s. Rate: 8.0 symbols/min [2025-10-29T17:48:28.855931] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:48:28.853416] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T17:48:28.898351] [DEBUG] [LOCAL ] CALX: Loaded 36838 existing records from primary storage. [2025-10-29T17:48:28.898706] [INFO ] [MAIN ] CALX: Loaded 36838 existing records. [2025-10-29T17:48:29.081224] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:48:29.081505] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-29T17:48:29.081587] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-29T17:48:29.082587] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-29T17:48:29.082695] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-29T17:48:29.198733] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-29T17:48:29.453629] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:48:29.870402] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-29T17:48:29.993569] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-29T17:48:30.396772] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T17:48:30.793702] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-29T17:48:31.301113] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T17:48:31.593587] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-29T17:48:31.870432] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T17:48:32.393538] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-29T17:48:32.857488] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T17:48:33.193540] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-29T17:48:33.608528] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T17:48:33.993604] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-29T17:48:34.291242] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T17:48:34.590637] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (17.40 seconds). [2025-10-29T17:48:34.793601] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-29T17:48:35.168500] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T17:48:35.593573] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-29T17:48:36.182057] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T17:48:36.393564] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-29T17:48:36.941185] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T17:48:37.193638] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-29T17:48:37.707433] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T17:48:37.993581] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-29T17:48:38.041726] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T17:48:38.793571] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-29T17:48:39.152255] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-29T17:48:39.593553] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-29T17:48:40.202880] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T17:48:40.393560] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-29T17:48:40.763618] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T17:48:41.193573] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-29T17:48:41.593372] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T17:48:41.993624] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-29T17:48:42.180353] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T17:48:42.793569] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-29T17:48:43.534844] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-29T17:48:43.593537] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-29T17:48:43.887211] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T17:48:44.393551] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-29T17:48:44.873172] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T17:48:45.193613] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-29T17:48:45.911074] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T17:48:45.921947] [INFO ] [REMOTE ] CAH: Full fetch complete (74871 records). [2025-10-29T17:48:45.922112] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-29T17:48:45.998623] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-29T17:48:46.325467] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-29T17:48:46.325661] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-29T17:48:46.329498] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-29T17:48:46.329751] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-29T17:48:46.353043] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T17:48:46.352024] [DEBUG] [LOCAL ] CAH: Trimmed 74871 records to 51345 (keeping 200 days of data) [2025-10-29T17:48:46.671142] [DEBUG] [LOCAL ] CAH: Primary data saved (51345 records). [2025-10-29T17:48:46.671297] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-29T17:48:46.671378] [INFO ] [MAIN ] Update Progress: 389/2367 symbols completed. CAH took 31.3s. Estimated remaining: 4h 7m 49s. Rate: 8.0 symbols/min [2025-10-29T17:48:46.808399] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-29T17:48:46.839233] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:48:46.865107] [DEBUG] [LOCAL ] CANG: Loaded 27056 existing records from primary storage. [2025-10-29T17:48:46.865356] [INFO ] [MAIN ] CANG: Loaded 27056 existing records. [2025-10-29T17:48:47.039077] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:48:47.039297] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-29T17:48:47.039343] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-29T17:48:47.039823] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-29T17:48:47.039881] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-29T17:48:47.411102] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:48:47.531426] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-29T17:48:47.593542] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-29T17:48:47.873005] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-29T17:48:48.393565] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-29T17:48:49.193601] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-29T17:48:49.249501] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T17:48:49.263556] [INFO ] [REMOTE ] CAG: Full fetch complete (77827 records). [2025-10-29T17:48:49.263841] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-29T17:48:49.584538] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T17:48:49.704694] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-29T17:48:49.704811] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-29T17:48:49.705694] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-29T17:48:49.705758] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-29T17:48:49.707287] [DEBUG] [LOCAL ] CAG: Trimmed 77827 records to 53666 (keeping 200 days of data) [2025-10-29T17:48:50.003380] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-29T17:48:50.032077] [DEBUG] [LOCAL ] CAG: Primary data saved (53666 records). [2025-10-29T17:48:50.032231] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-29T17:48:50.032315] [INFO ] [MAIN ] Update Progress: 390/2367 symbols completed. CAG took 40.3s. Estimated remaining: 4h 7m 21s. Rate: 8.0 symbols/min [2025-10-29T17:48:50.227533] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:48:50.234254] [DEBUG] [LOCAL ] CAPL: Loaded 5245 existing records from primary storage. [2025-10-29T17:48:50.234456] [INFO ] [MAIN ] CAPL: Loaded 5245 existing records. [2025-10-29T17:48:50.431411] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:48:50.435775] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:48:50.448268] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-29T17:48:50.448361] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-29T17:48:50.448923] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-29T17:48:50.448998] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-29T17:48:50.805431] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-29T17:48:50.843450] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:48:50.858863] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T17:48:51.593562] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-29T17:48:52.123259] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-29T17:48:52.126894] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T17:48:52.135383] [INFO ] [REMOTE ] CAL: Full fetch complete (61939 records). [2025-10-29T17:48:52.135469] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-29T17:48:52.398751] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-29T17:48:52.513913] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-29T17:48:52.513983] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-29T17:48:52.514699] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-29T17:48:52.514759] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-29T17:48:52.515857] [DEBUG] [LOCAL ] CAL: Trimmed 61939 records to 42422 (keeping 200 days of data) [2025-10-29T17:48:52.762097] [DEBUG] [LOCAL ] CAL: Primary data saved (42422 records). [2025-10-29T17:48:52.762213] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-29T17:48:52.762285] [INFO ] [MAIN ] Update Progress: 391/2367 symbols completed. CAL took 27.6s. Estimated remaining: 4h 6m 49s. Rate: 8.0 symbols/min [2025-10-29T17:48:52.932342] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:48:52.979036] [DEBUG] [LOCAL ] CARR: Loaded 53601 existing records from primary storage. [2025-10-29T17:48:52.979320] [INFO ] [MAIN ] CARR: Loaded 53601 existing records. [2025-10-29T17:48:53.153953] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:48:53.154163] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-29T17:48:53.154210] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-29T17:48:53.155300] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-29T17:48:53.155355] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-29T17:48:53.208068] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-29T17:48:53.504795] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T17:48:53.545160] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:48:53.993522] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-29T17:48:54.181862] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-29T17:48:54.610990] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-29T17:48:54.793546] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-29T17:48:55.506225] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-29T17:48:55.593608] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-29T17:48:56.393566] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-29T17:48:56.410203] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T17:48:57.193552] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-29T17:48:57.459991] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T17:48:57.993577] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-29T17:48:58.219466] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T17:48:58.793569] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-29T17:48:59.129482] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-29T17:48:59.305864] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T17:48:59.593562] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-29T17:49:00.050562] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T17:49:00.393570] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-29T17:49:01.193621] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-29T17:49:01.634038] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:49:01.993584] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-29T17:49:02.014070] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T17:49:02.793566] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-29T17:49:03.125073] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T17:49:03.593568] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-29T17:49:03.806079] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T17:49:04.393555] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-29T17:49:04.862251] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T17:49:05.193555] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-29T17:49:05.504236] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T17:49:05.511977] [INFO ] [REMOTE ] CALX: Full fetch complete (54063 records). [2025-10-29T17:49:05.512140] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-29T17:49:06.005600] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-29T17:49:06.090969] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-29T17:49:06.091088] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-29T17:49:06.092411] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-29T17:49:06.092583] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-29T17:49:06.094451] [DEBUG] [LOCAL ] CALX: Trimmed 54063 records to 36866 (keeping 200 days of data) [2025-10-29T17:49:06.372388] [DEBUG] [LOCAL ] CALX: Primary data saved (36866 records). [2025-10-29T17:49:06.372846] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-29T17:49:06.372981] [INFO ] [MAIN ] Update Progress: 392/2367 symbols completed. CALX took 37.7s. Estimated remaining: 4h 7m 12s. Rate: 8.0 symbols/min [2025-10-29T17:49:06.584279] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:49:06.621200] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T17:49:06.661924] [DEBUG] [LOCAL ] CARS: Loaded 39539 existing records from primary storage. [2025-10-29T17:49:06.662277] [INFO ] [MAIN ] CARS: Loaded 39539 existing records. [2025-10-29T17:49:06.798668] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-29T17:49:06.858253] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:49:06.858512] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-29T17:49:06.858570] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-29T17:49:06.859173] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-29T17:49:06.859230] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-29T17:49:07.174521] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T17:49:07.265597] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:49:07.593561] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-29T17:49:08.035259] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:49:08.371512] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T17:49:08.393517] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-29T17:49:09.193549] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-29T17:49:09.214554] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-29T17:49:09.750183] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-29T17:49:09.993536] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-29T17:49:10.355071] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-29T17:49:10.793571] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-29T17:49:11.593536] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-29T17:49:11.905111] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T17:49:12.393583] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-29T17:49:12.921074] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T17:49:13.193552] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-29T17:49:13.590208] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T17:49:13.596359] [INFO ] [REMOTE ] CANG: Full fetch complete (39026 records). [2025-10-29T17:49:13.596479] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-29T17:49:13.982387] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-29T17:49:13.982473] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-29T17:49:13.983083] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-29T17:49:13.983147] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-29T17:49:13.984149] [DEBUG] [LOCAL ] CANG: Trimmed 39026 records to 27056 (keeping 200 days of data) [2025-10-29T17:49:14.026293] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-29T17:49:14.136563] [DEBUG] [LOCAL ] CANG: Primary data saved (27056 records). [2025-10-29T17:49:14.136761] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-29T17:49:14.136889] [INFO ] [MAIN ] Update Progress: 393/2367 symbols completed. CANG took 27.5s. Estimated remaining: 4h 7m 6s. Rate: 8.0 symbols/min [2025-10-29T17:49:14.315180] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:49:14.364099] [DEBUG] [LOCAL ] CAT: Loaded 52900 existing records from primary storage. [2025-10-29T17:49:14.364439] [INFO ] [MAIN ] CAT: Loaded 52900 existing records. [2025-10-29T17:49:14.561240] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:49:14.561507] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-29T17:49:14.561611] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-29T17:49:14.562728] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-29T17:49:14.562788] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-29T17:49:14.798683] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-29T17:49:14.891691] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-29T17:49:15.015982] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:49:15.130279] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T17:49:15.189489] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T17:49:15.593544] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-29T17:49:15.990482] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-29T17:49:16.393551] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-29T17:49:17.193611] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-29T17:49:17.641378] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-29T17:49:17.851890] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-29T17:49:17.993559] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-29T17:49:18.793571] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-29T17:49:19.214917] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-29T17:49:19.367218] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-29T17:49:19.593636] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-29T17:49:20.393623] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-29T17:49:21.079127] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-29T17:49:21.193561] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-29T17:49:21.719663] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T17:49:21.993562] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-29T17:49:22.758856] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T17:49:22.758462] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-29T17:49:22.773677] [INFO ] [REMOTE ] CAPL: Full fetch complete (8674 records). [2025-10-29T17:49:22.773815] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-29T17:49:22.774956] [FATAL] [VALIDATOR ] CAPL: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:49:22.775060] [FATAL] [MAIN ] CAPL: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:49:22.775104] [WARN ] [MAIN ] CAPL: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:49:22.775144] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-29T17:49:22.775200] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-29T17:49:22.775236] [INFO ] [LOCAL ] CAPL: Starting deletion of derivative data. [2025-10-29T17:49:22.775389] [DEBUG] [LOCAL ] CAPL: Deleted derivative data file. [2025-10-29T17:49:22.775464] [INFO ] [MAIN ] Update Progress: 394/2367 symbols completed. CAPL took 32.7s. Estimated remaining: 4h 7m 4s. Rate: 8.0 symbols/min [2025-10-29T17:49:22.798706] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-29T17:49:22.951287] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:49:22.959545] [DEBUG] [LOCAL ] CATO: Loaded 6662 existing records from primary storage. [2025-10-29T17:49:22.959802] [INFO ] [MAIN ] CATO: Loaded 6662 existing records. [2025-10-29T17:49:23.134519] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:49:23.134756] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-29T17:49:23.134812] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-29T17:49:23.135022] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-29T17:49:23.135061] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-29T17:49:23.522295] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:49:23.593541] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-29T17:49:24.146743] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-29T17:49:24.393152] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-29T17:49:24.403433] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-29T17:49:25.193568] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-29T17:49:25.993551] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-29T17:49:26.167361] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-29T17:49:26.179264] [INFO ] [REMOTE ] CARR: Full fetch complete (77770 records). [2025-10-29T17:49:26.179416] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-29T17:49:26.458839] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-29T17:49:26.615960] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-29T17:49:26.652205] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-29T17:49:26.652324] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-29T17:49:26.653882] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-29T17:49:26.653950] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-29T17:49:26.655706] [DEBUG] [LOCAL ] CARR: Trimmed 77770 records to 53601 (keeping 200 days of data) [2025-10-29T17:49:26.830577] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-29T17:49:26.977263] [DEBUG] [LOCAL ] CARR: Primary data saved (53601 records). [2025-10-29T17:49:26.977399] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-29T17:49:26.978447] [INFO ] [MAIN ] Update Progress: 395/2367 symbols completed. CARR took 34.2s. Estimated remaining: 4h 6m 40s. Rate: 8.0 symbols/min [2025-10-29T17:49:27.142789] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:49:27.192428] [DEBUG] [LOCAL ] CAVA: Loaded 53531 existing records from primary storage. [2025-10-29T17:49:27.192805] [INFO ] [MAIN ] CAVA: Loaded 53531 existing records. [2025-10-29T17:49:27.368994] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:49:27.376270] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-29T17:49:27.376547] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-29T17:49:27.376636] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-29T17:49:27.380279] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-29T17:49:27.380336] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-29T17:49:27.600523] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-29T17:49:27.750800] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:49:28.393555] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-29T17:49:28.627426] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T17:49:29.193575] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-29T17:49:29.885019] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-29T17:49:29.993530] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-29T17:49:30.206185] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T17:49:30.330997] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-29T17:49:30.793578] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-29T17:49:31.593579] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-29T17:49:32.003239] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-29T17:49:32.171916] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T17:49:32.393629] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-29T17:49:33.193566] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-29T17:49:33.619811] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-29T17:49:33.993530] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-29T17:49:34.038287] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T17:49:34.793583] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-29T17:49:34.829805] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-29T17:49:35.593601] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-29T17:49:36.389636] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-29T17:49:36.399284] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-29T17:49:36.567467] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T17:49:36.920339] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T17:49:37.193619] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-29T17:49:37.993495] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-29T17:49:38.484912] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T17:49:38.493706] [INFO ] [REMOTE ] CARS: Full fetch complete (56795 records). [2025-10-29T17:49:38.493833] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-29T17:49:38.797180] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-29T17:49:38.892779] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-29T17:49:38.892883] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-29T17:49:38.893615] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-29T17:49:38.893701] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-29T17:49:38.894860] [DEBUG] [LOCAL ] CARS: Trimmed 56795 records to 39477 (keeping 200 days of data) [2025-10-29T17:49:39.117254] [DEBUG] [LOCAL ] CARS: Primary data saved (39477 records). [2025-10-29T17:49:39.117404] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-29T17:49:39.117484] [INFO ] [MAIN ] Update Progress: 396/2367 symbols completed. CARS took 32.7s. Estimated remaining: 4h 6m 56s. Rate: 8.0 symbols/min [2025-10-29T17:49:39.283687] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:49:39.327605] [DEBUG] [LOCAL ] CB: Loaded 49912 existing records from primary storage. [2025-10-29T17:49:39.327933] [INFO ] [MAIN ] CB: Loaded 49912 existing records. [2025-10-29T17:49:39.506737] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:49:39.506985] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-29T17:49:39.507104] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-29T17:49:39.507969] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-29T17:49:39.508032] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-29T17:49:39.601364] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-29T17:49:39.904867] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:49:39.899324] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-29T17:49:40.151904] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-29T17:49:40.357041] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-29T17:49:40.393557] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-29T17:49:41.193553] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-29T17:49:41.950814] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-29T17:49:41.993615] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-29T17:49:42.457269] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-29T17:49:42.793607] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-29T17:49:42.915836] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-29T17:49:43.593576] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-29T17:49:44.249369] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T17:49:44.251189] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-29T17:49:44.254016] [INFO ] [REMOTE ] CATO: Full fetch complete (10577 records). [2025-10-29T17:49:44.265019] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-29T17:49:44.398764] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-29T17:49:44.702566] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-29T17:49:44.702699] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-29T17:49:44.703078] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-29T17:49:44.703129] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-29T17:49:44.703825] [DEBUG] [LOCAL ] CATO: Trimmed 10577 records to 6626 (keeping 200 days of data) [2025-10-29T17:49:44.745685] [DEBUG] [LOCAL ] CATO: Primary data saved (6626 records). [2025-10-29T17:49:44.745883] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-29T17:49:44.746026] [INFO ] [MAIN ] Update Progress: 397/2367 symbols completed. CATO took 22.0s. Estimated remaining: 4h 6m 39s. Rate: 8.0 symbols/min [2025-10-29T17:49:45.193630] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-29T17:49:45.954321] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-29T17:49:45.993521] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-29T17:49:46.793636] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-29T17:49:46.971161] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-29T17:49:46.983397] [INFO ] [REMOTE ] CAT: Full fetch complete (76859 records). [2025-10-29T17:49:46.983557] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-29T17:49:47.379410] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-29T17:49:47.379492] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-29T17:49:47.380382] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-29T17:49:47.380461] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-29T17:49:47.382027] [DEBUG] [LOCAL ] CAT: Trimmed 76859 records to 52901 (keeping 200 days of data) [2025-10-29T17:49:47.731012] [DEBUG] [LOCAL ] CAT: Primary data saved (52901 records). [2025-10-29T17:49:47.731291] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-29T17:49:47.731390] [INFO ] [MAIN ] Update Progress: 398/2367 symbols completed. CAT took 33.6s. Estimated remaining: 4h 6m 9s. Rate: 8.0 symbols/min [2025-10-29T17:49:47.764071] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-29T17:49:47.776156] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-29T17:49:47.887126] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T17:49:48.393563] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-29T17:49:49.308776] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T17:49:49.321112] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-29T17:49:49.718981] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T17:49:49.993618] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-29T17:49:50.972329] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-29T17:49:50.984765] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-29T17:49:51.316227] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T17:49:51.593566] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-29T17:49:52.496579] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-29T17:49:52.513097] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-29T17:49:52.877670] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T17:49:53.193640] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-29T17:49:54.002402] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T17:49:54.015064] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-29T17:49:54.517856] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T17:49:54.793555] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-29T17:49:55.836793] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-29T17:49:55.850013] [INFO ] [REMOTE ] CAVA: Full fetch complete (77464 records). [2025-10-29T17:49:55.850303] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-29T17:49:56.317360] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-29T17:49:56.317541] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-29T17:49:56.319247] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-29T17:49:56.319376] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-29T17:49:56.321965] [DEBUG] [LOCAL ] CAVA: Trimmed 77464 records to 53532 (keeping 200 days of data) [2025-10-29T17:49:56.464613] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-29T17:49:56.500920] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-29T17:49:56.712308] [DEBUG] [LOCAL ] CAVA: Primary data saved (53532 records). [2025-10-29T17:49:56.712519] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-29T17:49:56.713391] [INFO ] [MAIN ] Update Progress: 399/2367 symbols completed. CAVA took 29.7s. Estimated remaining: 4h 6m 9s. Rate: 8.0 symbols/min [2025-10-29T17:49:57.859187] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T17:49:57.870409] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-29T17:49:59.247410] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:49:59.258120] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-29T17:50:00.918321] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T17:50:00.930023] [INFO ] [REMOTE ] CB: Full fetch complete (72826 records). [2025-10-29T17:50:00.930202] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-29T17:50:01.350937] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-29T17:50:01.351028] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-29T17:50:01.351881] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-29T17:50:01.351948] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-29T17:50:01.353388] [DEBUG] [LOCAL ] CB: Trimmed 72826 records to 49898 (keeping 200 days of data) [2025-10-29T17:50:01.695755] [DEBUG] [LOCAL ] CB: Primary data saved (49898 records). [2025-10-29T17:50:01.696019] [INFO ] [MAIN ] CB: Full history saved. [2025-10-29T17:50:01.696593] [INFO ] [MAIN ] Update Progress: 400/2367 symbols completed. CB took 22.6s. Estimated remaining: 4h 5m 49s. Rate: 8.0 symbols/min [2025-10-29T17:50:02.531467] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:02.530280] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:02.606451] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:02.628204] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:02.628850] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-29T17:50:02.632931] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-29T17:50:02.632849] [DEBUG] [LOCAL ] CBNA: Loaded 2806 existing records from primary storage. [2025-10-29T17:50:02.633224] [INFO ] [MAIN ] CBNA: Loaded 2806 existing records. [2025-10-29T17:50:02.645699] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-29T17:50:02.666571] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-29T17:50:02.710096] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-29T17:50:02.721327] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-29T17:50:02.738320] [DEBUG] [LOCAL ] CBAN: Loaded 10006 existing records from primary storage. [2025-10-29T17:50:02.744847] [DEBUG] [LOCAL ] CBL: Loaded 15582 existing records from primary storage. [2025-10-29T17:50:02.769199] [INFO ] [MAIN ] CBAN: Loaded 10006 existing records. [2025-10-29T17:50:02.817104] [INFO ] [MAIN ] CBL: Loaded 15582 existing records. [2025-10-29T17:50:03.189719] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:03.222729] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-29T17:50:03.235371] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-29T17:50:03.322661] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-29T17:50:03.407238] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-29T17:50:03.503420] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:03.574327] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-29T17:50:03.574161] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:03.606713] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-29T17:50:03.655301] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-29T17:50:03.655428] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-29T17:50:03.718295] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-29T17:50:03.728695] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-29T17:50:03.687925] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-29T17:50:03.755974] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-29T17:50:03.932841] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:03.996950] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-29T17:50:04.357237] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:50:04.455726] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-29T17:50:04.488376] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:50:04.584797] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:04.595560] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-29T17:50:04.590032] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-29T17:50:04.712401] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:04.682996] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:50:04.748054] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-29T17:50:04.778749] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-29T17:50:04.753913] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-29T17:50:04.778999] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-29T17:50:04.780043] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-29T17:50:04.780141] [INFO ] [MAIN ] Update Progress: 401/2367 symbols completed. CBO took 3.1s. Estimated remaining: 4h 5m 20s. Rate: 8.0 symbols/min [2025-10-29T17:50:04.972434] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:04.978458] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-29T17:50:05.046014] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:05.090842] [DEBUG] [LOCAL ] CBRE: Loaded 50235 existing records from primary storage. [2025-10-29T17:50:05.091146] [INFO ] [MAIN ] CBRE: Loaded 50235 existing records. [2025-10-29T17:50:05.266684] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:05.266969] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-29T17:50:05.267032] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-29T17:50:05.267960] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-29T17:50:05.268020] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-29T17:50:05.380890] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-29T17:50:05.393316] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-29T17:50:05.598598] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T17:50:05.627783] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-29T17:50:05.667119] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:05.667696] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-29T17:50:05.779606] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-29T17:50:05.784165] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-29T17:50:05.806449] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T17:50:05.807841] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-29T17:50:06.060660] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-29T17:50:06.061837] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-29T17:50:06.234430] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T17:50:06.237490] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-29T17:50:06.325853] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-29T17:50:06.392509] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T17:50:06.793544] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-29T17:50:06.831459] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-29T17:50:06.932537] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T17:50:07.082010] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-29T17:50:07.593589] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-29T17:50:08.147259] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-29T17:50:08.393569] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-29T17:50:08.935965] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-29T17:50:09.193617] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-29T17:50:09.515509] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-29T17:50:09.993571] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-29T17:50:10.296480] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-29T17:50:10.793554] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-29T17:50:11.111119] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-29T17:50:11.593573] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-29T17:50:12.393551] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-29T17:50:12.501954] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T17:50:13.069169] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-29T17:50:13.193584] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-29T17:50:13.756275] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-29T17:50:13.993560] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-29T17:50:14.498159] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-29T17:50:14.793571] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-29T17:50:15.218989] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-29T17:50:15.593605] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-29T17:50:16.244419] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-29T17:50:16.393553] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-29T17:50:17.193557] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-29T17:50:17.617384] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T17:50:17.769529] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-29T17:50:17.771927] [INFO ] [REMOTE ] CBAN: Full fetch complete (16394 records). [2025-10-29T17:50:17.772047] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-29T17:50:17.998759] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-29T17:50:18.152884] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-29T17:50:18.152967] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-29T17:50:18.153377] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-29T17:50:18.153419] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-29T17:50:18.154124] [DEBUG] [LOCAL ] CBAN: Trimmed 16394 records to 9961 (keeping 200 days of data) [2025-10-29T17:50:18.213744] [DEBUG] [LOCAL ] CBAN: Primary data saved (9961 records). [2025-10-29T17:50:18.213872] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-29T17:50:18.213949] [INFO ] [MAIN ] Update Progress: 402/2367 symbols completed. CBAN took 16.5s. Estimated remaining: 4h 5m 41s. Rate: 8.0 symbols/min [2025-10-29T17:50:18.382245] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:18.409944] [DEBUG] [LOCAL ] CBT: Loaded 30466 existing records from primary storage. [2025-10-29T17:50:18.410202] [INFO ] [MAIN ] CBT: Loaded 30466 existing records. [2025-10-29T17:50:18.604517] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:18.604770] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-29T17:50:18.604846] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-29T17:50:18.605465] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-29T17:50:18.605521] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-29T17:50:18.812401] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-29T17:50:18.975856] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-29T17:50:19.009694] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:19.593560] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-29T17:50:20.104863] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-29T17:50:20.292621] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T17:50:20.393533] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-29T17:50:20.936415] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-29T17:50:21.193536] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-29T17:50:21.993594] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-29T17:50:22.526916] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T17:50:22.639102] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T17:50:22.793581] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-29T17:50:23.593603] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-29T17:50:24.023125] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T17:50:24.060387] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-29T17:50:24.061392] [INFO ] [REMOTE ] CBNA: Full fetch complete (4178 records). [2025-10-29T17:50:24.061460] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-29T17:50:24.407489] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-29T17:50:24.450301] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-29T17:50:24.450375] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-29T17:50:24.450508] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-29T17:50:24.450545] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-29T17:50:24.450927] [DEBUG] [LOCAL ] CBNA: Trimmed 4178 records to 2764 (keeping 200 days of data) [2025-10-29T17:50:24.466501] [DEBUG] [LOCAL ] CBNA: Primary data saved (2764 records). [2025-10-29T17:50:24.466564] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-29T17:50:24.466631] [INFO ] [MAIN ] Update Progress: 403/2367 symbols completed. CBNA took 22.8s. Estimated remaining: 4h 5m 28s. Rate: 8.0 symbols/min [2025-10-29T17:50:24.670788] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:24.691987] [DEBUG] [LOCAL ] CBU: Loaded 22252 existing records from primary storage. [2025-10-29T17:50:24.692232] [INFO ] [MAIN ] CBU: Loaded 22252 existing records. [2025-10-29T17:50:24.878550] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:24.878801] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-29T17:50:24.878849] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-29T17:50:24.879284] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-29T17:50:24.879341] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-29T17:50:25.203854] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-29T17:50:25.234630] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T17:50:25.275306] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:25.993619] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-29T17:50:26.306321] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T17:50:26.769338] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T17:50:26.793583] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-29T17:50:27.320757] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T17:50:27.593573] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-29T17:50:28.393595] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-29T17:50:28.543388] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T17:50:29.193569] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-29T17:50:29.636528] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T17:50:29.963568] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T17:50:29.967020] [INFO ] [REMOTE ] CBL: Full fetch complete (24471 records). [2025-10-29T17:50:29.967103] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-29T17:50:29.998689] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-29T17:50:30.368819] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-29T17:50:30.368953] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-29T17:50:30.369425] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-29T17:50:30.369468] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-29T17:50:30.370156] [DEBUG] [LOCAL ] CBL: Trimmed 24471 records to 15560 (keeping 200 days of data) [2025-10-29T17:50:30.474075] [DEBUG] [LOCAL ] CBL: Primary data saved (15560 records). [2025-10-29T17:50:30.474207] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-29T17:50:30.474282] [INFO ] [MAIN ] Update Progress: 404/2367 symbols completed. CBL took 28.8s. Estimated remaining: 4h 5m 13s. Rate: 8.0 symbols/min [2025-10-29T17:50:30.654790] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:30.654968] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-29T17:50:30.655074] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-29T17:50:30.655186] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-29T17:50:30.655228] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-29T17:50:30.655271] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-29T17:50:30.655305] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-29T17:50:30.800594] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-29T17:50:30.865956] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T17:50:31.067210] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:31.593562] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-29T17:50:32.146049] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T17:50:32.373113] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T17:50:32.393523] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-29T17:50:32.539999] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:50:32.540302] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-29T17:50:32.540412] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:50:32.540463] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-29T17:50:32.540551] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:50:32.540632] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-29T17:50:32.540752] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-29T17:50:32.540837] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-29T17:50:32.540921] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-29T17:50:32.540985] [INFO ] [MAIN ] Update Progress: 405/2367 symbols completed. CBX took 2.1s. Estimated remaining: 4h 4m 39s. Rate: 8.0 symbols/min [2025-10-29T17:50:32.716010] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:32.746014] [DEBUG] [LOCAL ] CBZ: Loaded 34214 existing records from primary storage. [2025-10-29T17:50:32.746297] [INFO ] [MAIN ] CBZ: Loaded 34214 existing records. [2025-10-29T17:50:32.922628] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:32.922870] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-29T17:50:32.922954] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-29T17:50:32.923581] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-29T17:50:32.923638] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-29T17:50:33.198683] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-29T17:50:33.313841] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:33.993592] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-29T17:50:34.259218] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T17:50:34.793547] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-29T17:50:34.839492] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-29T17:50:35.561954] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T17:50:35.593513] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-29T17:50:36.280553] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T17:50:36.393590] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-29T17:50:37.193599] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-29T17:50:37.329276] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T17:50:37.956772] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T17:50:37.993568] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-29T17:50:38.793568] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-29T17:50:39.173950] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T17:50:39.593567] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-29T17:50:39.878974] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T17:50:40.393557] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-29T17:50:40.419053] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-29T17:50:41.075681] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-29T17:50:41.193554] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-29T17:50:41.800332] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T17:50:41.993545] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-29T17:50:42.793539] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-29T17:50:42.859397] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T17:50:43.593518] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-29T17:50:43.753291] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T17:50:44.393589] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-29T17:50:44.968580] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:50:44.979189] [INFO ] [REMOTE ] CBRE: Full fetch complete (73718 records). [2025-10-29T17:50:44.979334] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-29T17:50:45.198710] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-29T17:50:45.449111] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-29T17:50:45.449231] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-29T17:50:45.450202] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-29T17:50:45.450335] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-29T17:50:45.459769] [DEBUG] [LOCAL ] CBRE: Trimmed 73718 records to 50224 (keeping 200 days of data) [2025-10-29T17:50:45.478074] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T17:50:45.901073] [DEBUG] [LOCAL ] CBRE: Primary data saved (50224 records). [2025-10-29T17:50:45.901322] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-29T17:50:45.901449] [INFO ] [MAIN ] Update Progress: 406/2367 symbols completed. CBRE took 41.1s. Estimated remaining: 4h 5m 0s. Rate: 8.0 symbols/min [2025-10-29T17:50:45.994042] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-29T17:50:46.090477] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T17:50:46.239412] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:46.292245] [DEBUG] [LOCAL ] CC: Loaded 52964 existing records from primary storage. [2025-10-29T17:50:46.292617] [INFO ] [MAIN ] CC: Loaded 52964 existing records. [2025-10-29T17:50:46.491720] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:46.492007] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-29T17:50:46.492068] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-29T17:50:46.493508] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-29T17:50:46.493588] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-29T17:50:46.799545] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-29T17:50:46.908440] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:47.144006] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T17:50:47.593572] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-29T17:50:47.634234] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T17:50:48.393538] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-29T17:50:48.587217] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-29T17:50:49.031940] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T17:50:49.037343] [INFO ] [REMOTE ] CBU: Full fetch complete (32583 records). [2025-10-29T17:50:49.037467] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-29T17:50:49.198689] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-29T17:50:49.457495] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-29T17:50:49.457581] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-29T17:50:49.458134] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-29T17:50:49.458197] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-29T17:50:49.459075] [DEBUG] [LOCAL ] CBU: Trimmed 32583 records to 22228 (keeping 200 days of data) [2025-10-29T17:50:49.593532] [DEBUG] [LOCAL ] CBU: Primary data saved (22228 records). [2025-10-29T17:50:49.593687] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-29T17:50:49.593800] [INFO ] [MAIN ] Update Progress: 407/2367 symbols completed. CBU took 25.1s. Estimated remaining: 4h 4m 34s. Rate: 8.0 symbols/min [2025-10-29T17:50:49.775961] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:49.825678] [DEBUG] [LOCAL ] CCI: Loaded 53098 existing records from primary storage. [2025-10-29T17:50:49.826061] [INFO ] [MAIN ] CCI: Loaded 53098 existing records. [2025-10-29T17:50:50.008294] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-29T17:50:50.014315] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:50:50.015765] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-29T17:50:50.015838] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-29T17:50:50.017016] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-29T17:50:50.017078] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-29T17:50:50.391244] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:50.432274] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:50:50.793563] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-29T17:50:51.209908] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T17:50:51.217460] [INFO ] [REMOTE ] CBZ: Full fetch complete (46942 records). [2025-10-29T17:50:51.217587] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-29T17:50:51.614171] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-29T17:50:51.632985] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-29T17:50:51.633130] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-29T17:50:51.633878] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-29T17:50:51.634006] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-29T17:50:51.635162] [DEBUG] [LOCAL ] CBZ: Trimmed 46942 records to 34340 (keeping 200 days of data) [2025-10-29T17:50:51.844367] [DEBUG] [LOCAL ] CBZ: Primary data saved (34340 records). [2025-10-29T17:50:51.856946] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-29T17:50:51.857801] [INFO ] [MAIN ] Update Progress: 408/2367 symbols completed. CBZ took 19.3s. Estimated remaining: 4h 4m 2s. Rate: 8.0 symbols/min [2025-10-29T17:50:51.857676] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T17:50:52.042803] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:50:52.043018] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-29T17:50:52.043073] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-29T17:50:52.043195] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-29T17:50:52.043239] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-29T17:50:52.043280] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-29T17:50:52.043327] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-29T17:50:52.398700] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-29T17:50:52.435504] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:50:53.002434] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T17:50:53.193537] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-29T17:50:53.314635] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-29T17:50:53.993559] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-29T17:50:54.355465] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-29T17:50:54.359169] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T17:50:54.793558] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-29T17:50:55.038458] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-29T17:50:55.593573] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-29T17:50:55.854965] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-29T17:50:56.393563] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-29T17:50:56.681108] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-29T17:50:57.193608] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-29T17:50:57.993569] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-29T17:50:58.277397] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T17:50:58.793598] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-29T17:50:58.836816] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T17:50:59.593553] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-29T17:51:00.009022] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T17:51:00.393558] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-29T17:51:00.520330] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T17:51:01.193549] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-29T17:51:01.528074] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T17:51:01.864502] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T17:51:01.993555] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-29T17:51:02.228608] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-29T17:51:02.793573] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-29T17:51:03.593538] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-29T17:51:03.618499] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T17:51:04.393566] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-29T17:51:05.101881] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T17:51:05.193532] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-29T17:51:05.690411] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T17:51:05.993568] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-29T17:51:06.470630] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T17:51:06.517815] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-29T17:51:06.793574] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-29T17:51:07.593585] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-29T17:51:08.087756] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T17:51:08.393601] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-29T17:51:08.565384] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-29T17:51:08.572378] [INFO ] [REMOTE ] CBT: Full fetch complete (45684 records). [2025-10-29T17:51:08.572536] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-29T17:51:08.969412] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-29T17:51:08.969504] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-29T17:51:08.970160] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-29T17:51:08.970225] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-29T17:51:08.971331] [DEBUG] [LOCAL ] CBT: Trimmed 45684 records to 30424 (keeping 200 days of data) [2025-10-29T17:51:09.160215] [DEBUG] [LOCAL ] CBT: Primary data saved (30424 records). [2025-10-29T17:51:09.160394] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-29T17:51:09.160503] [INFO ] [MAIN ] Update Progress: 409/2367 symbols completed. CBT took 50.9s. Estimated remaining: 4h 4m 41s. Rate: 8.0 symbols/min [2025-10-29T17:51:09.194103] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-29T17:51:09.342062] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:51:09.356905] [DEBUG] [LOCAL ] CCIF: Loaded 15075 existing records from primary storage. [2025-10-29T17:51:09.357206] [INFO ] [MAIN ] CCIF: Loaded 15075 existing records. [2025-10-29T17:51:09.535621] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-29T17:51:09.565867] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:51:09.566157] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-29T17:51:09.566218] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-29T17:51:09.566691] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-29T17:51:09.566804] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-29T17:51:09.955309] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:51:10.001450] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-29T17:51:10.007638] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-29T17:51:10.793611] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-29T17:51:11.089438] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T17:51:11.379285] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T17:51:11.593628] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-29T17:51:12.393585] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-29T17:51:12.806021] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T17:51:13.043690] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-29T17:51:13.193557] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-29T17:51:13.730827] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-29T17:51:13.993589] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-29T17:51:14.633502] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-29T17:51:14.793563] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-29T17:51:15.373217] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T17:51:15.593527] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-29T17:51:16.393701] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-29T17:51:16.973128] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-29T17:51:17.054329] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T17:51:17.193584] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-29T17:51:17.800842] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T17:51:17.993554] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-29T17:51:18.477171] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-29T17:51:18.478186] [INFO ] [REMOTE ] CCIA: Full fetch complete (2181 records). [2025-10-29T17:51:18.478255] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-29T17:51:18.478587] [FATAL] [VALIDATOR ] CCIA: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:51:18.478691] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:51:18.478740] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:51:18.478781] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-29T17:51:18.478833] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-29T17:51:18.478884] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-29T17:51:18.478924] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-29T17:51:18.478974] [INFO ] [MAIN ] Update Progress: 410/2367 symbols completed. CCIA took 26.6s. Estimated remaining: 4h 4m 42s. Rate: 8.0 symbols/min [2025-10-29T17:51:18.650986] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:51:18.699064] [DEBUG] [LOCAL ] CCJ: Loaded 53691 existing records from primary storage. [2025-10-29T17:51:18.699371] [INFO ] [MAIN ] CCJ: Loaded 53691 existing records. [2025-10-29T17:51:18.798696] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-29T17:51:18.933771] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:51:18.933999] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-29T17:51:18.934048] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-29T17:51:18.935063] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-29T17:51:18.935122] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-29T17:51:19.304060] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:51:19.593597] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-29T17:51:20.200474] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T17:51:20.393585] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-29T17:51:20.857035] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T17:51:21.193609] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-29T17:51:21.717952] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T17:51:21.993584] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-29T17:51:22.798681] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-29T17:51:22.818427] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-29T17:51:23.223092] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T17:51:23.582719] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T17:51:23.593528] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-29T17:51:24.242764] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T17:51:24.393681] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-29T17:51:25.193587] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-29T17:51:25.739511] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-29T17:51:25.993577] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-29T17:51:26.506579] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T17:51:26.605028] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-29T17:51:26.793594] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-29T17:51:27.593577] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-29T17:51:28.393549] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-29T17:51:28.468949] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-29T17:51:28.481686] [INFO ] [REMOTE ] CCI: Full fetch complete (77094 records). [2025-10-29T17:51:28.481897] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-29T17:51:28.945136] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-29T17:51:28.945363] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-29T17:51:28.946391] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-29T17:51:28.946535] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-29T17:51:28.948089] [DEBUG] [LOCAL ] CCI: Trimmed 77094 records to 53099 (keeping 200 days of data) [2025-10-29T17:51:29.068064] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-29T17:51:29.082022] [INFO ] [REMOTE ] CC: Full fetch complete (76210 records). [2025-10-29T17:51:29.085680] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-29T17:51:29.199004] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-29T17:51:29.731469] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-29T17:51:29.737862] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-29T17:51:29.738893] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-29T17:51:29.739006] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-29T17:51:29.767851] [DEBUG] [LOCAL ] CCI: Primary data saved (53099 records). [2025-10-29T17:51:29.768238] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-29T17:51:29.768710] [DEBUG] [LOCAL ] CC: Trimmed 76210 records to 52957 (keeping 200 days of data) [2025-10-29T17:51:29.770145] [INFO ] [MAIN ] Update Progress: 411/2367 symbols completed. CCI took 40.2s. Estimated remaining: 4h 4m 53s. Rate: 8.0 symbols/min [2025-10-29T17:51:30.200112] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:51:30.208957] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T17:51:30.214883] [INFO ] [REMOTE ] CCIF: Full fetch complete (21919 records). [2025-10-29T17:51:30.215027] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-29T17:51:30.409928] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-29T17:51:30.561021] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-29T17:51:30.692339] [DEBUG] [LOCAL ] CCK: Loaded 46444 existing records from primary storage. [2025-10-29T17:51:30.706095] [INFO ] [MAIN ] CCK: Loaded 46444 existing records. [2025-10-29T17:51:30.713034] [DEBUG] [LOCAL ] CC: Primary data saved (52957 records). [2025-10-29T17:51:30.713212] [INFO ] [MAIN ] CC: Full history saved. [2025-10-29T17:51:30.740084] [INFO ] [MAIN ] Update Progress: 412/2367 symbols completed. CC took 44.8s. Estimated remaining: 4h 4m 14s. Rate: 8.0 symbols/min [2025-10-29T17:51:30.989128] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-29T17:51:31.017542] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-29T17:51:31.035037] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-29T17:51:31.040299] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-29T17:51:31.093959] [DEBUG] [LOCAL ] CCIF: Trimmed 21919 records to 15065 (keeping 200 days of data) [2025-10-29T17:51:31.157799] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:51:31.179340] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:51:31.219998] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-29T17:51:31.220157] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-29T17:51:31.244011] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-29T17:51:31.245025] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-29T17:51:31.312227] [DEBUG] [LOCAL ] CCIF: Primary data saved (15065 records). [2025-10-29T17:51:31.333132] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-29T17:51:31.343070] [INFO ] [MAIN ] Update Progress: 413/2367 symbols completed. CCIF took 22.2s. Estimated remaining: 4h 3m 34s. Rate: 8.0 symbols/min [2025-10-29T17:51:31.710216] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:51:31.749628] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-29T17:51:31.768369] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-29T17:51:32.084162] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:51:32.080604] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:51:32.085797] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-29T17:51:32.086168] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-29T17:51:32.086382] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-29T17:51:32.106607] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-29T17:51:32.107568] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-29T17:51:32.175781] [DEBUG] [LOCAL ] CCO: Loaded 48719 existing records from primary storage. [2025-10-29T17:51:32.198099] [INFO ] [MAIN ] CCO: Loaded 48719 existing records. [2025-10-29T17:51:32.615412] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:51:32.628554] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-29T17:51:32.679255] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-29T17:51:32.739800] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-29T17:51:32.745328] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-29T17:51:32.745052] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:51:32.746539] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-29T17:51:32.747236] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-29T17:51:32.747310] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-29T17:51:33.358975] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:51:33.359956] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-29T17:51:33.364759] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T17:51:33.993571] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-29T17:51:34.361128] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-29T17:51:34.398511] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T17:51:34.442510] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-29T17:51:34.793842] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-29T17:51:35.087986] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T17:51:35.593549] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-29T17:51:36.393604] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-29T17:51:36.429881] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-29T17:51:36.628519] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-29T17:51:37.193595] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-29T17:51:37.712534] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T17:51:37.993606] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-29T17:51:38.793603] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-29T17:51:39.096677] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-29T17:51:39.273902] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T17:51:39.593587] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-29T17:51:40.328569] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T17:51:40.393526] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-29T17:51:40.748507] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:51:41.193574] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-29T17:51:41.993574] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-29T17:51:42.101201] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-29T17:51:42.793535] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-29T17:51:43.036420] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-29T17:51:43.071678] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T17:51:43.593547] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-29T17:51:44.314549] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-29T17:51:44.393525] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-29T17:51:44.917626] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T17:51:45.193614] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-29T17:51:45.993567] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-29T17:51:46.274274] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-29T17:51:46.526274] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:51:46.793625] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-29T17:51:47.091809] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T17:51:47.593597] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-29T17:51:48.393561] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-29T17:51:48.836907] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T17:51:48.901192] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-29T17:51:48.913975] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-29T17:51:48.914117] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-29T17:51:49.198783] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-29T17:51:49.372845] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-29T17:51:49.372953] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-29T17:51:49.373955] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-29T17:51:49.374020] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-29T17:51:49.375478] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53691 (keeping 200 days of data) [2025-10-29T17:51:49.696251] [DEBUG] [LOCAL ] CCJ: Primary data saved (53691 records). [2025-10-29T17:51:49.696388] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-29T17:51:49.696466] [INFO ] [MAIN ] Update Progress: 414/2367 symbols completed. CCJ took 31.2s. Estimated remaining: 4h 4m 18s. Rate: 8.0 symbols/min [2025-10-29T17:51:49.862497] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:51:49.872410] [DEBUG] [LOCAL ] CCRD: Loaded 9635 existing records from primary storage. [2025-10-29T17:51:49.872616] [INFO ] [MAIN ] CCRD: Loaded 9635 existing records. [2025-10-29T17:51:50.009452] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-29T17:51:50.051611] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:51:50.051984] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-29T17:51:50.052043] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-29T17:51:50.052369] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-29T17:51:50.052437] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-29T17:51:50.482162] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:51:50.510715] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T17:51:50.551896] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-29T17:51:50.793554] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-29T17:51:51.033766] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T17:51:51.409211] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-29T17:51:51.593570] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-29T17:51:51.994043] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-29T17:51:52.393558] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-29T17:51:52.818434] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T17:51:53.193567] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-29T17:51:53.993567] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-29T17:51:54.359273] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T17:51:54.793554] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-29T17:51:55.215868] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T17:51:55.593560] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-29T17:51:55.939240] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-29T17:51:56.069816] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T17:51:56.080001] [INFO ] [REMOTE ] CCK: Full fetch complete (68163 records). [2025-10-29T17:51:56.080220] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-29T17:51:56.407014] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-29T17:51:56.462720] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-29T17:51:56.462804] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-29T17:51:56.463551] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-29T17:51:56.463591] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-29T17:51:56.464856] [DEBUG] [LOCAL ] CCK: Trimmed 68163 records to 46467 (keeping 200 days of data) [2025-10-29T17:51:56.735250] [DEBUG] [LOCAL ] CCK: Primary data saved (46467 records). [2025-10-29T17:51:56.735367] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-29T17:51:56.736084] [INFO ] [MAIN ] Update Progress: 415/2367 symbols completed. CCK took 27.0s. Estimated remaining: 4h 4m 8s. Rate: 8.0 symbols/min [2025-10-29T17:51:56.902164] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:51:56.932121] [DEBUG] [LOCAL ] CCS: Loaded 29790 existing records from primary storage. [2025-10-29T17:51:56.932397] [INFO ] [MAIN ] CCS: Loaded 29790 existing records. [2025-10-29T17:51:57.108835] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:51:57.109038] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-29T17:51:57.109084] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-29T17:51:57.109635] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-29T17:51:57.109724] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-29T17:51:57.199388] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-29T17:51:57.464934] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:51:57.490998] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T17:51:57.993551] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-29T17:51:58.391269] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-29T17:51:58.793554] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-29T17:51:58.875007] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-29T17:51:59.297386] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-29T17:51:59.593579] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-29T17:52:00.393583] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-29T17:52:00.912840] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T17:52:01.193506] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-29T17:52:01.479569] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T17:52:01.993582] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-29T17:52:02.793610] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-29T17:52:03.125700] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-29T17:52:03.482378] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T17:52:03.513037] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T17:52:03.523242] [INFO ] [REMOTE ] CCO: Full fetch complete (67507 records). [2025-10-29T17:52:03.523356] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-29T17:52:03.598688] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-29T17:52:03.903004] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-29T17:52:03.903074] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-29T17:52:03.903874] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-29T17:52:03.903941] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-29T17:52:03.905342] [DEBUG] [LOCAL ] CCO: Trimmed 67507 records to 48735 (keeping 200 days of data) [2025-10-29T17:52:04.171488] [DEBUG] [LOCAL ] CCO: Primary data saved (48735 records). [2025-10-29T17:52:04.171631] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-29T17:52:04.171753] [INFO ] [MAIN ] Update Progress: 416/2367 symbols completed. CCO took 32.8s. Estimated remaining: 4h 4m 1s. Rate: 8.0 symbols/min [2025-10-29T17:52:04.335472] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:52:04.354818] [DEBUG] [LOCAL ] CCU: Loaded 20968 existing records from primary storage. [2025-10-29T17:52:04.355051] [INFO ] [MAIN ] CCU: Loaded 20968 existing records. [2025-10-29T17:52:04.398709] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-29T17:52:04.532205] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:52:04.532437] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-29T17:52:04.532483] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-29T17:52:04.532942] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-29T17:52:04.532999] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-29T17:52:04.879558] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:52:05.193518] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-29T17:52:05.304403] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T17:52:05.439680] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-29T17:52:05.971881] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T17:52:05.993517] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-29T17:52:06.793529] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-29T17:52:06.898554] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T17:52:07.593535] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-29T17:52:07.673255] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T17:52:08.358094] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T17:52:08.393520] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-29T17:52:09.193587] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-29T17:52:09.491139] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T17:52:09.778473] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-29T17:52:09.993534] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-29T17:52:10.793551] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-29T17:52:11.272281] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-29T17:52:11.593606] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-29T17:52:11.806452] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-29T17:52:12.144220] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-29T17:52:12.146593] [INFO ] [REMOTE ] CCRD: Full fetch complete (11724 records). [2025-10-29T17:52:12.146764] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-29T17:52:12.398707] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-29T17:52:12.508851] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-29T17:52:12.508928] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-29T17:52:12.509208] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-29T17:52:12.509246] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-29T17:52:12.509711] [DEBUG] [LOCAL ] CCRD: Trimmed 11724 records to 9641 (keeping 200 days of data) [2025-10-29T17:52:12.563533] [DEBUG] [LOCAL ] CCRD: Primary data saved (9641 records). [2025-10-29T17:52:12.563676] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-29T17:52:12.563770] [INFO ] [MAIN ] Update Progress: 417/2367 symbols completed. CCRD took 22.9s. Estimated remaining: 4h 3m 57s. Rate: 8.0 symbols/min [2025-10-29T17:52:12.729487] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:52:12.729690] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-29T17:52:12.729742] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-29T17:52:12.729849] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-29T17:52:12.729891] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-29T17:52:12.729931] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-29T17:52:12.729963] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-29T17:52:13.075855] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:52:13.193575] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-29T17:52:13.971069] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T17:52:13.993517] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-29T17:52:14.162021] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.17 seconds). [2025-10-29T17:52:14.565214] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-29T17:52:14.579719] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-29T17:52:14.579867] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-29T17:52:14.798807] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-29T17:52:14.984043] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-29T17:52:14.984130] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-29T17:52:14.985216] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-29T17:52:14.985281] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-29T17:52:14.986946] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-29T17:52:15.300686] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-29T17:52:15.300823] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-29T17:52:15.300899] [INFO ] [MAIN ] Update Progress: 418/2367 symbols completed. CCL took 44.6s. Estimated remaining: 4h 3m 28s. Rate: 8.0 symbols/min [2025-10-29T17:52:15.474127] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:52:15.522551] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-29T17:52:15.522928] [INFO ] [MAIN ] CDE: Loaded 53644 existing records. [2025-10-29T17:52:15.598778] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-29T17:52:15.718108] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:52:15.718357] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-29T17:52:15.718412] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-29T17:52:15.719280] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-29T17:52:15.719337] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-29T17:52:15.825150] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-29T17:52:15.983448] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T17:52:16.105082] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:52:16.393607] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-29T17:52:17.193552] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-29T17:52:17.291626] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-29T17:52:17.993553] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-29T17:52:18.117228] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T17:52:18.793569] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-29T17:52:19.113555] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-29T17:52:19.220506] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T17:52:19.593579] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-29T17:52:19.760297] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.17 seconds). [2025-10-29T17:52:20.393587] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-29T17:52:21.193552] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-29T17:52:21.310463] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-29T17:52:21.993538] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-29T17:52:22.168904] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T17:52:22.674634] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T17:52:22.793601] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-29T17:52:23.593545] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-29T17:52:23.644798] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T17:52:24.393614] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-29T17:52:24.699760] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:52:24.700050] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-29T17:52:24.700153] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:52:24.700262] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-29T17:52:24.700348] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:52:24.700441] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-29T17:52:24.700522] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-29T17:52:24.700560] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-29T17:52:24.700599] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-29T17:52:24.700668] [INFO ] [MAIN ] Update Progress: 419/2367 symbols completed. CCZ took 12.1s. Estimated remaining: 4h 3m 29s. Rate: 8.0 symbols/min [2025-10-29T17:52:24.873863] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:52:24.874168] [DEBUG] [LOCAL ] CDLR: No existing data file found in primary storage. [2025-10-29T17:52:24.874222] [WARN ] [MAIN ] CDLR: No existing data found, performing full refresh instead. [2025-10-29T17:52:24.874437] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-29T17:52:24.874511] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-29T17:52:24.874673] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-10-29T17:52:24.874741] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-29T17:52:25.079874] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-29T17:52:25.198889] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-29T17:52:25.282961] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:52:25.993587] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-29T17:52:26.546470] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T17:52:26.793583] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-29T17:52:26.911539] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-29T17:52:27.367835] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T17:52:27.593570] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-29T17:52:28.285840] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T17:52:28.393542] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-29T17:52:28.792513] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-29T17:52:29.193618] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-29T17:52:29.993584] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-29T17:52:30.480635] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T17:52:30.793581] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-29T17:52:31.538393] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T17:52:31.567680] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-29T17:52:31.593525] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-29T17:52:32.393566] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-29T17:52:32.433622] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T17:52:33.116193] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T17:52:33.193613] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-29T17:52:33.873340] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-29T17:52:33.877319] [INFO ] [REMOTE ] CCU: Full fetch complete (32081 records). [2025-10-29T17:52:33.877399] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-29T17:52:33.998680] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-29T17:52:34.265205] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-29T17:52:34.265283] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-29T17:52:34.265954] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-29T17:52:34.266017] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-29T17:52:34.266777] [DEBUG] [LOCAL ] CCU: Trimmed 32081 records to 20856 (keeping 200 days of data) [2025-10-29T17:52:34.384341] [DEBUG] [LOCAL ] CCU: Primary data saved (20856 records). [2025-10-29T17:52:34.384467] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-29T17:52:34.384540] [INFO ] [MAIN ] Update Progress: 420/2367 symbols completed. CCU took 30.2s. Estimated remaining: 4h 3m 32s. Rate: 8.0 symbols/min [2025-10-29T17:52:34.570621] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:52:34.570927] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T17:52:34.611115] [DEBUG] [LOCAL ] CDP: Loaded 42091 existing records from primary storage. [2025-10-29T17:52:34.611408] [INFO ] [MAIN ] CDP: Loaded 42091 existing records. [2025-10-29T17:52:34.796971] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-29T17:52:34.821555] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:52:34.821968] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-29T17:52:34.822057] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-29T17:52:34.823274] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-29T17:52:34.823342] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-29T17:52:35.183505] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:52:35.593579] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-29T17:52:35.807713] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T17:52:35.814203] [INFO ] [REMOTE ] CCS: Full fetch complete (44816 records). [2025-10-29T17:52:35.814393] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-29T17:52:36.231707] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-29T17:52:36.231800] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-29T17:52:36.232395] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-29T17:52:36.232436] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-29T17:52:36.233698] [DEBUG] [LOCAL ] CCS: Trimmed 44816 records to 29789 (keeping 200 days of data) [2025-10-29T17:52:36.402809] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-29T17:52:36.426546] [DEBUG] [LOCAL ] CCS: Primary data saved (29789 records). [2025-10-29T17:52:36.426705] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-29T17:52:36.426810] [INFO ] [MAIN ] Update Progress: 421/2367 symbols completed. CCS took 39.7s. Estimated remaining: 4h 2m 59s. Rate: 8.0 symbols/min [2025-10-29T17:52:36.597522] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:52:36.597775] [DEBUG] [LOCAL ] CDRE: No existing data file found in primary storage. [2025-10-29T17:52:36.597826] [WARN ] [MAIN ] CDRE: No existing data found, performing full refresh instead. [2025-10-29T17:52:36.597981] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-29T17:52:36.598029] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-29T17:52:36.598073] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-10-29T17:52:36.598107] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-29T17:52:36.954603] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:52:36.985941] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T17:52:37.193533] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-29T17:52:37.447725] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T17:52:37.993533] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-29T17:52:38.025007] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-29T17:52:38.550592] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-29T17:52:38.793575] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-29T17:52:39.593569] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-29T17:52:40.125045] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T17:52:40.203917] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-29T17:52:40.393574] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-29T17:52:41.193605] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-29T17:52:41.321168] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-29T17:52:41.993639] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-29T17:52:42.184166] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T17:52:42.793528] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-29T17:52:42.842897] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T17:52:43.255271] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-29T17:52:43.593565] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-29T17:52:44.140075] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T17:52:44.393596] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-29T17:52:45.193562] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-29T17:52:45.555638] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T17:52:45.877631] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-29T17:52:45.993565] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-29T17:52:46.592030] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T17:52:46.595368] [INFO ] [REMOTE ] CDLR: Full fetch complete (14463 records). [2025-10-29T17:52:46.595530] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-29T17:52:46.798742] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-29T17:52:46.958748] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-29T17:52:46.958821] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-29T17:52:46.959138] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-29T17:52:46.959176] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-29T17:52:46.959727] [DEBUG] [LOCAL ] CDLR: Trimmed 14463 records to 10165 (keeping 200 days of data) [2025-10-29T17:52:47.019534] [DEBUG] [LOCAL ] CDLR: Primary data saved (10165 records). [2025-10-29T17:52:47.019667] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-29T17:52:47.019754] [INFO ] [MAIN ] Update Progress: 422/2367 symbols completed. CDLR took 22.3s. Estimated remaining: 4h 3m 6s. Rate: 8.0 symbols/min [2025-10-29T17:52:47.189930] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:52:47.235316] [DEBUG] [LOCAL ] CE: Loaded 51149 existing records from primary storage. [2025-10-29T17:52:47.235633] [INFO ] [MAIN ] CE: Loaded 51149 existing records. [2025-10-29T17:52:47.419841] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:52:47.420041] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-29T17:52:47.420099] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-29T17:52:47.421030] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-29T17:52:47.421090] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-29T17:52:47.600342] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-29T17:52:47.794838] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:52:47.998330] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T17:52:48.393558] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-29T17:52:49.171833] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-29T17:52:49.193561] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-29T17:52:49.394999] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T17:52:49.993597] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-29T17:52:50.704730] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T17:52:50.793520] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-29T17:52:51.035807] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-29T17:52:51.593562] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-29T17:52:52.281552] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T17:52:52.393517] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-29T17:52:52.437519] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T17:52:53.193554] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-29T17:52:53.999045] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-29T17:52:54.021992] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-29T17:52:54.582055] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T17:52:54.793522] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-29T17:52:54.924302] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T17:52:55.593558] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-29T17:52:56.393555] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-29T17:52:56.638031] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T17:52:56.886369] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-29T17:52:56.898697] [INFO ] [REMOTE ] CDE: Full fetch complete (77796 records). [2025-10-29T17:52:56.898860] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-29T17:52:57.203691] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-29T17:52:57.305526] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-29T17:52:57.305606] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-29T17:52:57.306534] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-29T17:52:57.306601] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-29T17:52:57.308107] [DEBUG] [LOCAL ] CDE: Trimmed 77796 records to 53644 (keeping 200 days of data) [2025-10-29T17:52:57.623519] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-29T17:52:57.623797] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-29T17:52:57.623892] [INFO ] [MAIN ] Update Progress: 423/2367 symbols completed. CDE took 42.3s. Estimated remaining: 4h 3m 12s. Rate: 8.0 symbols/min [2025-10-29T17:52:57.775875] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-29T17:52:57.884060] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:52:57.891479] [DEBUG] [LOCAL ] CEE: Loaded 4853 existing records from primary storage. [2025-10-29T17:52:57.891761] [INFO ] [MAIN ] CEE: Loaded 4853 existing records. [2025-10-29T17:52:57.998726] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-29T17:52:58.128447] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:52:58.128710] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-29T17:52:58.128769] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-29T17:52:58.128970] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-29T17:52:58.129027] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-29T17:52:58.425025] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T17:52:58.506951] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:52:58.793551] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-29T17:52:59.274951] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T17:52:59.503049] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-29T17:52:59.508126] [INFO ] [REMOTE ] CDRE: Full fetch complete (34924 records). [2025-10-29T17:52:59.508218] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-29T17:52:59.598714] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-29T17:52:59.882166] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-29T17:52:59.882254] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-29T17:52:59.882742] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-29T17:52:59.882802] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-29T17:52:59.883547] [DEBUG] [LOCAL ] CDRE: Trimmed 34924 records to 24381 (keeping 200 days of data) [2025-10-29T17:53:00.022987] [DEBUG] [LOCAL ] CDRE: Primary data saved (24381 records). [2025-10-29T17:53:00.023104] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-29T17:53:00.023169] [INFO ] [MAIN ] Update Progress: 424/2367 symbols completed. CDRE took 23.6s. Estimated remaining: 4h 2m 41s. Rate: 8.0 symbols/min [2025-10-29T17:53:00.140150] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-29T17:53:00.199003] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:53:00.223386] [DEBUG] [LOCAL ] CEPU: Loaded 27302 existing records from primary storage. [2025-10-29T17:53:00.223626] [INFO ] [MAIN ] CEPU: Loaded 27302 existing records. [2025-10-29T17:53:00.401839] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:53:00.398631] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-29T17:53:00.402124] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-29T17:53:00.402894] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-29T17:53:00.403361] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-29T17:53:00.403419] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-29T17:53:00.778278] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:53:01.070282] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-29T17:53:01.193597] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-29T17:53:01.993574] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-29T17:53:02.593540] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T17:53:02.793605] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-29T17:53:03.236365] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T17:53:03.593603] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-29T17:53:04.048124] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:53:04.393575] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-29T17:53:04.597713] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-29T17:53:05.193637] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-29T17:53:05.876143] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-29T17:53:05.993596] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-29T17:53:06.293244] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T17:53:06.793611] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-29T17:53:07.209571] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T17:53:07.593585] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-29T17:53:07.667723] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T17:53:08.393606] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-29T17:53:09.138673] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T17:53:09.139045] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-29T17:53:09.193539] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-29T17:53:09.993593] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-29T17:53:10.464317] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T17:53:10.780329] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-29T17:53:10.793514] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-29T17:53:11.593519] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-29T17:53:11.738521] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T17:53:12.393557] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-29T17:53:12.933231] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-29T17:53:13.083022] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T17:53:13.093467] [INFO ] [REMOTE ] CE: Full fetch complete (74720 records). [2025-10-29T17:53:13.093605] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-29T17:53:13.198421] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-29T17:53:13.489950] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-29T17:53:13.490038] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-29T17:53:13.490887] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-29T17:53:13.490953] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-29T17:53:13.492340] [DEBUG] [LOCAL ] CE: Trimmed 74720 records to 51118 (keeping 200 days of data) [2025-10-29T17:53:13.705376] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-29T17:53:13.803826] [DEBUG] [LOCAL ] CE: Primary data saved (51118 records). [2025-10-29T17:53:13.803949] [INFO ] [MAIN ] CE: Full history saved. [2025-10-29T17:53:13.804022] [INFO ] [MAIN ] Update Progress: 425/2367 symbols completed. CE took 26.8s. Estimated remaining: 4h 3m 3s. Rate: 8.0 symbols/min [2025-10-29T17:53:13.976976] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:53:14.001188] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-29T17:53:14.023924] [DEBUG] [LOCAL ] CF: Loaded 52048 existing records from primary storage. [2025-10-29T17:53:14.024257] [INFO ] [MAIN ] CF: Loaded 52048 existing records. [2025-10-29T17:53:14.200225] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:53:14.200413] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-29T17:53:14.200478] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-29T17:53:14.201461] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-29T17:53:14.201520] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-29T17:53:14.549119] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:53:14.793531] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-29T17:53:15.143484] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T17:53:15.593607] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-29T17:53:16.238616] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-29T17:53:16.393526] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-29T17:53:16.707387] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T17:53:16.715872] [INFO ] [REMOTE ] CDP: Full fetch complete (61837 records). [2025-10-29T17:53:16.716009] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-29T17:53:16.716595] [FATAL] [VALIDATOR ] CDP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:53:16.716700] [FATAL] [MAIN ] CDP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:53:16.716746] [WARN ] [MAIN ] CDP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:53:16.716782] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-29T17:53:16.716836] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-10-29T17:53:16.716869] [INFO ] [LOCAL ] CDP: Starting deletion of derivative data. [2025-10-29T17:53:16.717016] [DEBUG] [LOCAL ] CDP: Deleted derivative data file. [2025-10-29T17:53:16.717093] [INFO ] [MAIN ] Update Progress: 426/2367 symbols completed. CDP took 42.3s. Estimated remaining: 4h 2m 34s. Rate: 8.0 symbols/min [2025-10-29T17:53:16.883420] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:53:16.930522] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-29T17:53:16.930843] [INFO ] [MAIN ] CFG: Loaded 53622 existing records. [2025-10-29T17:53:17.104204] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:53:17.104363] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-29T17:53:17.104432] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-29T17:53:17.105288] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-29T17:53:17.105347] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-29T17:53:17.201694] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-29T17:53:17.470899] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:53:17.501457] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:53:17.993584] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-29T17:53:18.316137] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T17:53:18.793580] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-29T17:53:19.497268] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-29T17:53:19.523396] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T17:53:19.593575] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-29T17:53:20.008028] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-29T17:53:20.393573] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-29T17:53:21.193577] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-29T17:53:21.725417] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T17:53:21.993637] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-29T17:53:22.332380] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T17:53:22.793602] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-29T17:53:23.252477] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T17:53:23.593547] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-29T17:53:24.064146] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T17:53:24.160953] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T17:53:24.393538] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-29T17:53:24.844137] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-29T17:53:25.193567] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-29T17:53:25.612011] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-29T17:53:25.993706] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-29T17:53:26.755940] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T17:53:26.793512] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-29T17:53:27.593544] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-29T17:53:27.619827] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T17:53:28.393562] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-29T17:53:28.972957] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T17:53:29.193631] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-29T17:53:29.889964] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-29T17:53:29.993606] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-29T17:53:30.523143] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:53:30.793632] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-29T17:53:31.253246] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T17:53:31.593551] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-29T17:53:32.357247] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-29T17:53:32.393566] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-29T17:53:33.063830] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T17:53:33.193600] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-29T17:53:33.807439] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T17:53:33.993559] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-29T17:53:34.487262] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T17:53:34.793558] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-29T17:53:35.370237] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T17:53:35.593584] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-29T17:53:36.125108] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T17:53:36.393567] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-29T17:53:36.622432] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-29T17:53:37.193568] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-29T17:53:37.907936] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T17:53:37.918745] [INFO ] [REMOTE ] CF: Full fetch complete (75545 records). [2025-10-29T17:53:37.918913] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-29T17:53:37.998787] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-29T17:53:38.314188] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-29T17:53:38.314393] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-29T17:53:38.315263] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-29T17:53:38.315383] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-29T17:53:38.334915] [DEBUG] [LOCAL ] CF: Trimmed 75545 records to 52010 (keeping 200 days of data) [2025-10-29T17:53:38.335571] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-29T17:53:38.343898] [INFO ] [REMOTE ] CEPU: Full fetch complete (39556 records). [2025-10-29T17:53:38.344011] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-29T17:53:38.344525] [FATAL] [VALIDATOR ] CEPU: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:53:38.344627] [FATAL] [MAIN ] CEPU: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:53:38.396387] [WARN ] [MAIN ] CEPU: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:53:38.404910] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-29T17:53:38.404993] [DEBUG] [LOCAL ] CEPU: No primary data file found to delete. [2025-10-29T17:53:38.431092] [INFO ] [LOCAL ] CEPU: Starting deletion of derivative data. [2025-10-29T17:53:38.435171] [DEBUG] [LOCAL ] CEPU: Deleted derivative data file. [2025-10-29T17:53:38.435521] [INFO ] [MAIN ] Update Progress: 427/2367 symbols completed. CEPU took 38.4s. Estimated remaining: 4h 3m 31s. Rate: 8.0 symbols/min [2025-10-29T17:53:38.585506] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T17:53:38.677570] [INFO ] [REMOTE ] CEE: Full fetch complete (9872 records). [2025-10-29T17:53:38.789900] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-29T17:53:38.787956] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:53:38.790076] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-29T17:53:38.790172] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-29T17:53:38.795706] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-29T17:53:38.857345] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-29T17:53:38.927520] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-29T17:53:38.945728] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-29T17:53:38.967825] [DEBUG] [LOCAL ] CF: Primary data saved (52010 records). [2025-10-29T17:53:38.967928] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-29T17:53:38.981682] [INFO ] [MAIN ] CF: Full history saved. [2025-10-29T17:53:39.005236] [INFO ] [MAIN ] Update Progress: 428/2367 symbols completed. CF took 25.2s. Estimated remaining: 4h 2m 52s. Rate: 8.0 symbols/min [2025-10-29T17:53:39.642108] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:53:39.772784] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-29T17:53:39.779531] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-29T17:53:39.803962] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-29T17:53:39.803602] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:53:39.804237] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-29T17:53:39.804323] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-29T17:53:39.805847] [DEBUG] [LOCAL ] CEE: Trimmed 9872 records to 4818 (keeping 200 days of data) [2025-10-29T17:53:39.846548] [DEBUG] [LOCAL ] CEE: Primary data saved (4818 records). [2025-10-29T17:53:39.846726] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-29T17:53:39.846833] [INFO ] [MAIN ] Update Progress: 429/2367 symbols completed. CEE took 42.2s. Estimated remaining: 4h 2m 15s. Rate: 8.0 symbols/min [2025-10-29T17:53:39.959698] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:53:39.963319] [DEBUG] [LOCAL ] CFR: Loaded 32148 existing records from primary storage. [2025-10-29T17:53:39.963694] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-29T17:53:39.963870] [INFO ] [MAIN ] CFR: Loaded 32148 existing records. [2025-10-29T17:53:39.985743] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:53:40.052212] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-29T17:53:40.108963] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:53:40.063635] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:53:40.114272] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-29T17:53:40.136756] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-29T17:53:40.140103] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-29T17:53:40.191020] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-29T17:53:40.203062] [INFO ] [MAIN ] Update Progress: 430/2367 symbols completed. CFND took 1.8s. Estimated remaining: 4h 1m 35s. Rate: 8.0 symbols/min [2025-10-29T17:53:40.223578] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:53:40.242718] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-29T17:53:40.249834] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-29T17:53:40.255705] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-29T17:53:40.262515] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-29T17:53:40.617020] [DEBUG] [LOCAL ] CGAU: Loaded 43880 existing records from primary storage. [2025-10-29T17:53:40.661915] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:53:40.692614] [INFO ] [MAIN ] CGAU: Loaded 43880 existing records. [2025-10-29T17:53:40.713396] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-29T17:53:40.835523] [DEBUG] [LOCAL ] CGV: Loaded 1299 existing records from primary storage. [2025-10-29T17:53:40.850565] [INFO ] [MAIN ] CGV: Loaded 1299 existing records. [2025-10-29T17:53:40.908966] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-29T17:53:41.184258] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:53:41.208288] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-29T17:53:41.240180] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:53:41.291472] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-29T17:53:41.298011] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-29T17:53:41.316521] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-29T17:53:41.345706] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-29T17:53:41.345569] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:53:41.378137] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-29T17:53:41.390031] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-29T17:53:41.423541] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-29T17:53:41.440033] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-29T17:53:42.076911] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:53:42.088206] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-29T17:53:42.120964] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:53:42.234880] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-29T17:53:42.693795] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-29T17:53:42.705095] [INFO ] [REMOTE ] CFG: Full fetch complete (77782 records). [2025-10-29T17:53:42.705256] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-29T17:53:42.798681] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-29T17:53:43.107878] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-29T17:53:43.108031] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-29T17:53:43.108952] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-29T17:53:43.109114] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-29T17:53:43.110751] [DEBUG] [LOCAL ] CFG: Trimmed 77782 records to 53622 (keeping 200 days of data) [2025-10-29T17:53:43.224186] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-29T17:53:43.346011] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T17:53:43.464686] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-10-29T17:53:43.464819] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-29T17:53:43.464895] [INFO ] [MAIN ] Update Progress: 431/2367 symbols completed. CFG took 26.7s. Estimated remaining: 4h 1m 8s. Rate: 8.0 symbols/min [2025-10-29T17:53:43.602728] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-29T17:53:43.638264] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:53:43.662452] [DEBUG] [LOCAL ] CHCT: Loaded 23917 existing records from primary storage. [2025-10-29T17:53:43.662752] [INFO ] [MAIN ] CHCT: Loaded 23917 existing records. [2025-10-29T17:53:43.846932] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:53:43.847199] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-29T17:53:43.847250] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-29T17:53:43.847668] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-29T17:53:43.847729] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-29T17:53:43.958769] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T17:53:44.240618] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:53:44.393572] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-29T17:53:44.621178] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-29T17:53:45.193565] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-29T17:53:45.993544] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-29T17:53:46.034144] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T17:53:46.793620] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-29T17:53:47.153705] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T17:53:47.593592] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-29T17:53:47.622832] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T17:53:47.902547] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-29T17:53:48.393575] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-29T17:53:49.193572] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-29T17:53:49.454242] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T17:53:49.478551] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-29T17:53:49.993583] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-29T17:53:50.793574] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-29T17:53:51.075924] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T17:53:51.090695] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-29T17:53:51.593561] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-29T17:53:52.393579] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-29T17:53:52.601417] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T17:53:52.666682] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-29T17:53:53.193551] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-29T17:53:53.914282] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T17:53:53.993560] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-29T17:53:54.701568] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-29T17:53:54.793560] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-29T17:53:55.593976] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-29T17:53:55.593904] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T17:53:56.393574] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-29T17:53:56.719723] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T17:53:56.796770] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-29T17:53:57.193572] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-29T17:53:57.438072] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-29T17:53:57.993607] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-29T17:53:58.798628] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-29T17:53:58.810182] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T17:53:59.593570] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-29T17:53:59.895194] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T17:54:00.258268] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T17:54:00.393572] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-29T17:54:01.193557] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-29T17:54:01.293792] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-29T17:54:01.993531] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-29T17:54:02.053728] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-29T17:54:02.793564] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-29T17:54:02.936581] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-29T17:54:03.157678] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-29T17:54:03.158929] [INFO ] [REMOTE ] CGV: Full fetch complete (2165 records). [2025-10-29T17:54:03.159028] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-29T17:54:03.526357] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-29T17:54:03.526431] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-29T17:54:03.526528] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-29T17:54:03.526565] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-29T17:54:03.526921] [DEBUG] [LOCAL ] CGV: Trimmed 2165 records to 1298 (keeping 200 days of data) [2025-10-29T17:54:03.534923] [DEBUG] [LOCAL ] CGV: Primary data saved (1298 records). [2025-10-29T17:54:03.534997] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-29T17:54:03.535064] [INFO ] [MAIN ] Update Progress: 432/2367 symbols completed. CGV took 23.3s. Estimated remaining: 4h 1m 57s. Rate: 8.0 symbols/min [2025-10-29T17:54:03.598703] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-29T17:54:03.709751] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:03.757609] [DEBUG] [LOCAL ] CHD: Loaded 52297 existing records from primary storage. [2025-10-29T17:54:03.757927] [INFO ] [MAIN ] CHD: Loaded 52297 existing records. [2025-10-29T17:54:03.930668] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:54:03.930888] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-29T17:54:03.930953] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-29T17:54:03.931752] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-29T17:54:03.931808] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-29T17:54:04.277424] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:04.393568] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-29T17:54:04.492905] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-29T17:54:05.193583] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-29T17:54:05.486061] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T17:54:05.977711] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T17:54:05.993521] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-29T17:54:06.730897] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-29T17:54:06.793578] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-29T17:54:07.593571] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-29T17:54:08.326151] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-29T17:54:08.393617] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-29T17:54:08.644846] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T17:54:09.193583] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-29T17:54:09.594878] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T17:54:09.993556] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-29T17:54:10.326585] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T17:54:10.793540] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-29T17:54:11.013450] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T17:54:11.019074] [INFO ] [REMOTE ] CHCT: Full fetch complete (34746 records). [2025-10-29T17:54:11.019175] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-29T17:54:11.388755] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-29T17:54:11.388834] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-29T17:54:11.389363] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-29T17:54:11.389404] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-29T17:54:11.390219] [DEBUG] [LOCAL ] CHCT: Trimmed 34746 records to 23944 (keeping 200 days of data) [2025-10-29T17:54:11.530684] [DEBUG] [LOCAL ] CHCT: Primary data saved (23944 records). [2025-10-29T17:54:11.530819] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-29T17:54:11.530899] [INFO ] [MAIN ] Update Progress: 433/2367 symbols completed. CHCT took 28.1s. Estimated remaining: 4h 1m 52s. Rate: 8.0 symbols/min [2025-10-29T17:54:11.598680] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-29T17:54:11.722418] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:11.739909] [DEBUG] [LOCAL ] CHE: Loaded 15358 existing records from primary storage. [2025-10-29T17:54:11.740152] [INFO ] [MAIN ] CHE: Loaded 15358 existing records. [2025-10-29T17:54:11.898916] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T17:54:11.971277] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:54:11.971494] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-29T17:54:11.971562] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-29T17:54:11.971811] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-29T17:54:11.971869] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-29T17:54:12.322914] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:12.393565] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-29T17:54:12.730367] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T17:54:13.111530] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T17:54:13.193554] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-29T17:54:13.771108] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-29T17:54:13.993613] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-29T17:54:14.793597] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-29T17:54:15.117193] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T17:54:15.124753] [INFO ] [REMOTE ] CFR: Full fetch complete (48748 records). [2025-10-29T17:54:15.124926] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-29T17:54:15.507094] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-29T17:54:15.507172] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-29T17:54:15.507794] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-29T17:54:15.507857] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-29T17:54:15.508914] [DEBUG] [LOCAL ] CFR: Trimmed 48748 records to 32147 (keeping 200 days of data) [2025-10-29T17:54:15.599359] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-29T17:54:15.707537] [DEBUG] [LOCAL ] CFR: Primary data saved (32147 records). [2025-10-29T17:54:15.707690] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-29T17:54:15.707780] [INFO ] [MAIN ] Update Progress: 434/2367 symbols completed. CFR took 36.7s. Estimated remaining: 4h 1m 30s. Rate: 8.0 symbols/min [2025-10-29T17:54:15.872389] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:15.872525] [DEBUG] [LOCAL ] CHGG: No existing data file found in primary storage. [2025-10-29T17:54:15.872561] [WARN ] [MAIN ] CHGG: No existing data found, performing full refresh instead. [2025-10-29T17:54:15.872690] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-29T17:54:15.872745] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-29T17:54:15.872786] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-29T17:54:15.872817] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-29T17:54:16.227435] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:16.258520] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-29T17:54:16.393530] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-29T17:54:16.866976] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T17:54:17.193707] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-29T17:54:17.728838] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T17:54:17.765127] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-29T17:54:17.993578] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-29T17:54:18.793593] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-29T17:54:19.384935] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T17:54:19.593585] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-29T17:54:20.125399] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T17:54:20.393583] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-29T17:54:21.172411] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T17:54:21.189263] [INFO ] [REMOTE ] CGAU: Full fetch complete (62101 records). [2025-10-29T17:54:21.189470] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-29T17:54:21.190443] [FATAL] [VALIDATOR ] CGAU: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:54:21.190576] [FATAL] [MAIN ] CGAU: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:54:21.190637] [WARN ] [MAIN ] CGAU: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:54:21.190747] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-29T17:54:21.190836] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-29T17:54:21.190897] [INFO ] [LOCAL ] CGAU: Starting deletion of derivative data. [2025-10-29T17:54:21.191131] [DEBUG] [LOCAL ] CGAU: Deleted derivative data file. [2025-10-29T17:54:21.191250] [INFO ] [MAIN ] Update Progress: 435/2367 symbols completed. CGAU took 41.3s. Estimated remaining: 4h 1m 13s. Rate: 8.0 symbols/min [2025-10-29T17:54:21.201086] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-29T17:54:21.505723] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:21.553171] [DEBUG] [LOCAL ] CHH: Loaded 32029 existing records from primary storage. [2025-10-29T17:54:21.553696] [INFO ] [MAIN ] CHH: Loaded 32029 existing records. [2025-10-29T17:54:21.792281] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-29T17:54:21.883077] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:54:21.883589] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-29T17:54:21.883766] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-29T17:54:21.884012] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-29T17:54:21.884077] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-29T17:54:21.997711] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-29T17:54:22.086292] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T17:54:22.278390] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:22.793581] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-29T17:54:23.352946] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T17:54:23.593579] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-29T17:54:24.048504] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T17:54:24.315949] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T17:54:24.393570] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-29T17:54:24.984075] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T17:54:25.193578] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-29T17:54:25.993586] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-29T17:54:26.318305] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T17:54:26.793586] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-29T17:54:27.179029] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T17:54:27.593567] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-29T17:54:28.222593] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T17:54:28.393581] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-29T17:54:28.832626] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:54:29.083007] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T17:54:29.193544] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-29T17:54:29.993557] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-29T17:54:30.633383] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T17:54:30.793569] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-29T17:54:31.520799] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T17:54:31.593509] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-29T17:54:31.861552] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-29T17:54:32.393568] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-29T17:54:32.927361] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T17:54:32.947212] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-29T17:54:33.193566] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-29T17:54:33.993609] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-29T17:54:34.692806] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T17:54:34.703697] [INFO ] [REMOTE ] CHD: Full fetch complete (75024 records). [2025-10-29T17:54:34.703844] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-29T17:54:34.795530] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-29T17:54:35.014715] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-29T17:54:35.110461] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-29T17:54:35.110533] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-29T17:54:35.111342] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-29T17:54:35.111404] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-29T17:54:35.112738] [DEBUG] [LOCAL ] CHD: Trimmed 75024 records to 52320 (keeping 200 days of data) [2025-10-29T17:54:35.421060] [DEBUG] [LOCAL ] CHD: Primary data saved (52320 records). [2025-10-29T17:54:35.421226] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-29T17:54:35.422001] [INFO ] [MAIN ] Update Progress: 436/2367 symbols completed. CHD took 31.9s. Estimated remaining: 4h 1m 36s. Rate: 8.0 symbols/min [2025-10-29T17:54:35.589412] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:35.593637] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-29T17:54:35.610713] [DEBUG] [LOCAL ] CHMI: Loaded 20680 existing records from primary storage. [2025-10-29T17:54:35.611015] [INFO ] [MAIN ] CHMI: Loaded 20680 existing records. [2025-10-29T17:54:35.789979] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:54:35.790238] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-29T17:54:35.790393] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-29T17:54:35.790681] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-29T17:54:35.790739] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-29T17:54:35.935836] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T17:54:36.165507] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:36.393597] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-29T17:54:36.447551] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-29T17:54:36.451560] [INFO ] [REMOTE ] CHE: Full fetch complete (20828 records). [2025-10-29T17:54:36.451675] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-29T17:54:36.838249] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-29T17:54:36.838324] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-29T17:54:36.838719] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-29T17:54:36.838779] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-29T17:54:36.839338] [DEBUG] [LOCAL ] CHE: Trimmed 20828 records to 15502 (keeping 200 days of data) [2025-10-29T17:54:36.933673] [DEBUG] [LOCAL ] CHE: Primary data saved (15502 records). [2025-10-29T17:54:36.933811] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-29T17:54:36.933887] [INFO ] [MAIN ] Update Progress: 437/2367 symbols completed. CHE took 25.4s. Estimated remaining: 4h 1m 2s. Rate: 8.0 symbols/min [2025-10-29T17:54:37.195077] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-29T17:54:37.197103] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-29T17:54:37.993550] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-29T17:54:38.439802] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:54:38.800802] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-29T17:54:38.802810] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T17:54:39.593528] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-29T17:54:39.785454] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T17:54:40.393552] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-29T17:54:40.888984] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T17:54:41.193568] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-29T17:54:41.440265] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-29T17:54:41.986299] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-29T17:54:41.993502] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-29T17:54:42.793571] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-29T17:54:42.964914] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-29T17:54:43.593610] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-29T17:54:43.861066] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T17:54:44.283110] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-29T17:54:44.393580] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-29T17:54:45.156019] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-29T17:54:45.193555] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-29T17:54:45.993589] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-29T17:54:46.684893] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T17:54:46.704808] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T17:54:46.710909] [INFO ] [REMOTE ] CHGG: Full fetch complete (69771 records). [2025-10-29T17:54:46.711531] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-29T17:54:46.798701] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-29T17:54:47.116417] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-29T17:54:47.116495] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-29T17:54:47.117307] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-29T17:54:47.117369] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-29T17:54:47.118637] [DEBUG] [LOCAL ] CHGG: Trimmed 69771 records to 47417 (keeping 200 days of data) [2025-10-29T17:54:47.378664] [DEBUG] [LOCAL ] CHGG: Primary data saved (47417 records). [2025-10-29T17:54:47.378785] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-29T17:54:47.378865] [INFO ] [MAIN ] Update Progress: 438/2367 symbols completed. CHGG took 31.7s. Estimated remaining: 4h 1m 7s. Rate: 8.0 symbols/min [2025-10-29T17:54:47.593528] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-29T17:54:47.691310] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T17:54:48.391984] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-29T17:54:48.395942] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-29T17:54:49.193534] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-29T17:54:49.370732] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-29T17:54:49.993588] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-29T17:54:50.851701] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-29T17:54:50.858321] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-29T17:54:50.921204] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-29T17:54:51.593604] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-29T17:54:51.740911] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-29T17:54:52.393543] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-29T17:54:52.497256] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T17:54:52.501715] [INFO ] [REMOTE ] CHMI: Full fetch complete (31146 records). [2025-10-29T17:54:52.501807] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-29T17:54:52.873892] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-29T17:54:52.874189] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-29T17:54:52.874703] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-29T17:54:52.874763] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-29T17:54:52.875549] [DEBUG] [LOCAL ] CHMI: Trimmed 31146 records to 20560 (keeping 200 days of data) [2025-10-29T17:54:52.990453] [DEBUG] [LOCAL ] CHMI: Primary data saved (20560 records). [2025-10-29T17:54:52.990572] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-29T17:54:52.990666] [INFO ] [MAIN ] Update Progress: 439/2367 symbols completed. CHMI took 17.6s. Estimated remaining: 4h 0m 51s. Rate: 8.0 symbols/min [2025-10-29T17:54:53.458749] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-29T17:54:53.466416] [INFO ] [REMOTE ] CHH: Full fetch complete (47686 records). [2025-10-29T17:54:53.466538] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-29T17:54:53.835285] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-29T17:54:53.835373] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-29T17:54:53.836024] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-29T17:54:53.836086] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-29T17:54:53.837160] [DEBUG] [LOCAL ] CHH: Trimmed 47686 records to 32025 (keeping 200 days of data) [2025-10-29T17:54:54.036483] [DEBUG] [LOCAL ] CHH: Primary data saved (32025 records). [2025-10-29T17:54:54.036625] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-29T17:54:54.037245] [INFO ] [MAIN ] Update Progress: 440/2367 symbols completed. CHH took 32.8s. Estimated remaining: 4h 0m 16s. Rate: 8.0 symbols/min [2025-10-29T17:54:54.762600] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:54.786224] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:54.805500] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:54.807854] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:54:54.808196] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-29T17:54:54.810407] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-29T17:54:54.814128] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-29T17:54:54.814696] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-29T17:54:54.814602] [DEBUG] [LOCAL ] CHN: Loaded 4981 existing records from primary storage. [2025-10-29T17:54:54.814880] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-29T17:54:54.815273] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-29T17:54:54.815209] [INFO ] [MAIN ] CHN: Loaded 4981 existing records. [2025-10-29T17:54:55.297028] [DEBUG] [LOCAL ] CHPT: Loaded 46294 existing records from primary storage. [2025-10-29T17:54:55.306298] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:54:55.334697] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-29T17:54:55.348599] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-29T17:54:55.347552] [INFO ] [MAIN ] CHPT: Loaded 46294 existing records. [2025-10-29T17:54:55.370954] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-29T17:54:55.386818] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-29T17:54:55.418959] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-29T17:54:55.511251] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-29T17:54:55.548335] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:55.603103] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-29T17:54:55.919603] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:54:55.955964] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-29T17:54:55.973011] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-29T17:54:56.049422] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-29T17:54:56.071101] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-29T17:54:56.142984] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:54:56.239818] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-29T17:54:56.250175] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:56.269093] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-29T17:54:56.277120] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-29T17:54:56.283723] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-29T17:54:56.292064] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-29T17:54:56.877253] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:56.910522] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-29T17:54:56.910197] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T17:54:56.948501] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-29T17:54:56.997849] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:54:56.999010] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T17:54:57.001317] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-29T17:54:57.193587] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-29T17:54:57.614275] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-29T17:54:57.644639] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-29T17:54:57.993608] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-29T17:54:58.502779] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-29T17:54:58.589942] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-29T17:54:58.793552] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-29T17:54:58.937309] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-29T17:54:59.593572] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-29T17:55:00.297994] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-29T17:55:00.393531] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-29T17:55:00.431343] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-29T17:55:00.814052] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T17:55:01.193556] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-29T17:55:01.993563] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-29T17:55:02.429405] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-29T17:55:02.710742] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-29T17:55:02.793570] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-29T17:55:03.593607] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-29T17:55:04.393539] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-29T17:55:04.548901] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-29T17:55:04.714162] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-29T17:55:05.126449] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T17:55:05.193565] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-29T17:55:05.993559] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-29T17:55:06.675536] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T17:55:06.793574] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-29T17:55:07.593581] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-29T17:55:07.709595] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-29T17:55:08.347498] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T17:55:08.393528] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-29T17:55:08.451071] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-29T17:55:09.193627] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-29T17:55:09.920433] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T17:55:09.993573] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-29T17:55:10.034703] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-29T17:55:10.793610] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-29T17:55:11.593558] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-29T17:55:11.671300] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-29T17:55:12.044593] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T17:55:12.297777] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-29T17:55:12.393558] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-29T17:55:12.761460] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-29T17:55:13.193632] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-29T17:55:13.948899] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T17:55:13.993685] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-29T17:55:14.793695] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-29T17:55:15.481822] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-29T17:55:15.597975] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-29T17:55:15.603903] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-29T17:55:16.355064] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-29T17:55:16.393550] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-29T17:55:17.193582] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-29T17:55:17.242203] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-29T17:55:17.246232] [INFO ] [REMOTE ] CHT: Full fetch complete (27648 records). [2025-10-29T17:55:17.246321] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-29T17:55:17.645679] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-29T17:55:17.646170] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-29T17:55:17.646369] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-29T17:55:17.646917] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-29T17:55:17.649070] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-29T17:55:17.649794] [DEBUG] [LOCAL ] CHT: Trimmed 27648 records to 18904 (keeping 200 days of data) [2025-10-29T17:55:17.772025] [DEBUG] [LOCAL ] CHT: Primary data saved (18904 records). [2025-10-29T17:55:17.772187] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-29T17:55:17.772334] [INFO ] [MAIN ] Update Progress: 441/2367 symbols completed. CHT took 23.7s. Estimated remaining: 4h 1m 19s. Rate: 8.0 symbols/min [2025-10-29T17:55:17.944035] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:55:17.987515] [DEBUG] [LOCAL ] CI: Loaded 49430 existing records from primary storage. [2025-10-29T17:55:17.987859] [INFO ] [MAIN ] CI: Loaded 49430 existing records. [2025-10-29T17:55:17.998717] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-29T17:55:18.179801] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:55:18.180057] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-29T17:55:18.180108] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-29T17:55:18.180744] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-29T17:55:18.180805] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-29T17:55:18.533588] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T17:55:18.557328] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:55:18.793587] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-29T17:55:19.593575] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-29T17:55:20.162309] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-29T17:55:20.393571] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-29T17:55:20.861766] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T17:55:20.942125] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-29T17:55:20.943878] [INFO ] [REMOTE ] CHN: Full fetch complete (7577 records). [2025-10-29T17:55:20.943951] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-29T17:55:20.944376] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:55:20.944457] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:55:20.944497] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:55:20.944534] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-29T17:55:20.944586] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-29T17:55:20.944619] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-10-29T17:55:20.944842] [DEBUG] [LOCAL ] CHN: Deleted derivative data file. [2025-10-29T17:55:20.944931] [INFO ] [MAIN ] Update Progress: 442/2367 symbols completed. CHN took 26.9s. Estimated remaining: 4h 0m 53s. Rate: 8.0 symbols/min [2025-10-29T17:55:21.113728] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:55:21.130125] [DEBUG] [LOCAL ] CIA: Loaded 16202 existing records from primary storage. [2025-10-29T17:55:21.130387] [INFO ] [MAIN ] CIA: Loaded 16202 existing records. [2025-10-29T17:55:21.198717] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-29T17:55:21.326992] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:55:21.327190] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-29T17:55:21.327238] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-29T17:55:21.327386] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-29T17:55:21.327425] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-29T17:55:21.711663] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:55:21.993568] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-29T17:55:22.793563] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-29T17:55:22.917175] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-29T17:55:23.209852] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T17:55:23.302636] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-29T17:55:23.593570] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-29T17:55:24.164948] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T17:55:24.393568] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-29T17:55:25.193605] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-29T17:55:25.993585] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-29T17:55:26.226708] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-29T17:55:26.653399] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-29T17:55:26.793567] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-29T17:55:26.990221] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-29T17:55:27.001408] [INFO ] [REMOTE ] CHWY: Full fetch complete (77778 records). [2025-10-29T17:55:27.001558] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-29T17:55:27.395594] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-29T17:55:27.395945] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-29T17:55:27.396871] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-29T17:55:27.396963] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-29T17:55:27.412594] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-29T17:55:27.417896] [DEBUG] [LOCAL ] CHWY: Trimmed 77778 records to 53653 (keeping 200 days of data) [2025-10-29T17:55:27.612293] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-29T17:55:27.727070] [DEBUG] [LOCAL ] CHWY: Primary data saved (53653 records). [2025-10-29T17:55:27.727210] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-29T17:55:27.727287] [INFO ] [MAIN ] Update Progress: 443/2367 symbols completed. CHWY took 33.7s. Estimated remaining: 4h 0m 42s. Rate: 8.0 symbols/min [2025-10-29T17:55:27.898053] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:55:27.924504] [DEBUG] [LOCAL ] CIB: Loaded 29643 existing records from primary storage. [2025-10-29T17:55:27.924834] [INFO ] [MAIN ] CIB: Loaded 29643 existing records. [2025-10-29T17:55:28.103736] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:55:28.104006] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-29T17:55:28.104063] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-29T17:55:28.104286] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-29T17:55:28.104342] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-29T17:55:28.398732] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-29T17:55:28.467623] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:55:28.849183] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T17:55:29.193561] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-29T17:55:29.725539] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T17:55:29.820169] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T17:55:29.993559] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-29T17:55:30.793709] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-29T17:55:31.059818] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-29T17:55:31.593529] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-29T17:55:31.666402] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T17:55:32.393561] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-29T17:55:32.975715] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:55:32.983526] [INFO ] [REMOTE ] CHPT: Full fetch complete (70228 records). [2025-10-29T17:55:32.983660] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-29T17:55:33.205095] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-29T17:55:33.403422] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-29T17:55:33.403500] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-29T17:55:33.404349] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-29T17:55:33.404414] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-29T17:55:33.405747] [DEBUG] [LOCAL ] CHPT: Trimmed 70228 records to 46126 (keeping 200 days of data) [2025-10-29T17:55:33.683898] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T17:55:33.699300] [DEBUG] [LOCAL ] CHPT: Primary data saved (46126 records). [2025-10-29T17:55:33.699377] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-29T17:55:33.699443] [INFO ] [MAIN ] Update Progress: 444/2367 symbols completed. CHPT took 39.7s. Estimated remaining: 4h 0m 28s. Rate: 8.0 symbols/min [2025-10-29T17:55:33.862755] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:55:33.862924] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-29T17:55:33.862960] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-29T17:55:33.863064] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-29T17:55:33.863104] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-29T17:55:33.863143] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-29T17:55:33.863173] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-29T17:55:34.003190] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-29T17:55:34.198585] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T17:55:34.237889] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:55:34.793580] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-29T17:55:35.513771] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T17:55:35.593521] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-29T17:55:35.692386] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T17:55:36.393598] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-29T17:55:36.834939] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:55:37.000121] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-29T17:55:37.193559] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-29T17:55:37.734853] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T17:55:37.993554] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-29T17:55:38.348666] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-29T17:55:38.793568] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-29T17:55:39.593557] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-29T17:55:39.753489] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-29T17:55:39.865157] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-29T17:55:40.393559] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-29T17:55:41.080952] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-29T17:55:41.084138] [INFO ] [REMOTE ] CIA: Full fetch complete (23189 records). [2025-10-29T17:55:41.084248] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-29T17:55:41.198742] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-29T17:55:41.453381] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-29T17:55:41.453467] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-29T17:55:41.453928] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-29T17:55:41.453989] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-29T17:55:41.454730] [DEBUG] [LOCAL ] CIA: Trimmed 23189 records to 16200 (keeping 200 days of data) [2025-10-29T17:55:41.541590] [DEBUG] [LOCAL ] CIA: Primary data saved (16200 records). [2025-10-29T17:55:41.541767] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-29T17:55:41.541854] [INFO ] [MAIN ] Update Progress: 445/2367 symbols completed. CIA took 20.6s. Estimated remaining: 4h 0m 22s. Rate: 8.0 symbols/min [2025-10-29T17:55:41.710685] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:55:41.760946] [DEBUG] [LOCAL ] CIEN: Loaded 52075 existing records from primary storage. [2025-10-29T17:55:41.761292] [INFO ] [MAIN ] CIEN: Loaded 52075 existing records. [2025-10-29T17:55:41.966182] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:55:41.966418] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-29T17:55:41.966467] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-29T17:55:41.967241] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-29T17:55:41.967299] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-29T17:55:42.001461] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-29T17:55:42.358447] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:55:42.358758] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-29T17:55:42.386726] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T17:55:42.793550] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-29T17:55:43.593564] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-29T17:55:44.124576] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T17:55:44.393587] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-29T17:55:44.684210] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T17:55:45.193587] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-29T17:55:45.582938] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T17:55:45.993598] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-29T17:55:46.579511] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T17:55:46.793677] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-29T17:55:47.121700] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-29T17:55:47.242273] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T17:55:47.593581] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-29T17:55:47.869337] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-29T17:55:48.393574] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-29T17:55:49.193540] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-29T17:55:49.346924] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T17:55:49.993555] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-29T17:55:50.462769] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T17:55:50.793567] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-29T17:55:51.141745] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T17:55:51.215480] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-29T17:55:51.593550] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-29T17:55:51.915527] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-29T17:55:52.393551] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-29T17:55:52.613124] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-29T17:55:53.193549] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-29T17:55:53.993557] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-29T17:55:54.436614] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T17:55:54.793581] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-29T17:55:55.020159] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-29T17:55:55.306957] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T17:55:55.593558] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-29T17:55:56.125515] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T17:55:56.135559] [INFO ] [REMOTE ] CI: Full fetch complete (71991 records). [2025-10-29T17:55:56.135744] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-29T17:55:56.398736] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-29T17:55:56.530077] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-29T17:55:56.530167] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-29T17:55:56.531013] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-29T17:55:56.531079] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-29T17:55:56.532553] [DEBUG] [LOCAL ] CI: Trimmed 71991 records to 49408 (keeping 200 days of data) [2025-10-29T17:55:56.846421] [DEBUG] [LOCAL ] CI: Primary data saved (49408 records). [2025-10-29T17:55:56.846557] [INFO ] [MAIN ] CI: Full history saved. [2025-10-29T17:55:56.847338] [INFO ] [MAIN ] Update Progress: 446/2367 symbols completed. CI took 39.1s. Estimated remaining: 4h 0m 48s. Rate: 8.0 symbols/min [2025-10-29T17:55:57.025042] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:55:57.033082] [DEBUG] [LOCAL ] CIF: Loaded 3832 existing records from primary storage. [2025-10-29T17:55:57.033320] [INFO ] [MAIN ] CIF: Loaded 3832 existing records. [2025-10-29T17:55:57.202063] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-29T17:55:57.233160] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:55:57.233542] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-29T17:55:57.233596] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-29T17:55:57.233780] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-29T17:55:57.233838] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-29T17:55:57.637510] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:55:57.668574] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-29T17:55:58.002919] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-29T17:55:58.007394] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T17:55:58.467352] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-29T17:55:58.793586] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-29T17:55:59.231031] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-29T17:55:59.593568] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-29T17:55:59.939615] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-29T17:55:59.940478] [INFO ] [REMOTE ] CICB: Full fetch complete (1914 records). [2025-10-29T17:55:59.940546] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-29T17:56:00.122009] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-29T17:56:00.122220] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:56:00.122290] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:56:00.122339] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-29T17:56:00.122399] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-29T17:56:00.122434] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-29T17:56:00.122471] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-29T17:56:00.122530] [INFO ] [MAIN ] Update Progress: 447/2367 symbols completed. CICB took 26.4s. Estimated remaining: 4h 0m 22s. Rate: 8.0 symbols/min [2025-10-29T17:56:00.296095] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:00.336787] [DEBUG] [LOCAL ] CIG: Loaded 44535 existing records from primary storage. [2025-10-29T17:56:00.337091] [INFO ] [MAIN ] CIG: Loaded 44535 existing records. [2025-10-29T17:56:00.400710] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-29T17:56:00.530230] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:56:00.530490] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-29T17:56:00.530542] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-29T17:56:00.530902] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-29T17:56:00.530961] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-29T17:56:00.909189] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:00.969358] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-29T17:56:01.193589] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-29T17:56:01.993613] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-29T17:56:02.342482] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T17:56:02.742613] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T17:56:02.793537] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-29T17:56:03.593545] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-29T17:56:03.749787] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T17:56:04.393572] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-29T17:56:05.150961] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-29T17:56:05.193512] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-29T17:56:05.487176] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T17:56:05.993548] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-29T17:56:06.521259] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T17:56:06.793587] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-29T17:56:07.121485] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T17:56:07.593619] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-29T17:56:08.002694] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-29T17:56:08.161439] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T17:56:08.393571] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-29T17:56:09.193600] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-29T17:56:09.659792] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T17:56:09.993528] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-29T17:56:10.065080] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-29T17:56:10.081946] [INFO ] [REMOTE ] CIEN: Full fetch complete (75838 records). [2025-10-29T17:56:10.082120] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-29T17:56:10.391165] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T17:56:10.497118] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-29T17:56:10.497211] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-29T17:56:10.498046] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-29T17:56:10.498108] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-29T17:56:10.499523] [DEBUG] [LOCAL ] CIEN: Trimmed 75838 records to 52064 (keeping 200 days of data) [2025-10-29T17:56:10.795336] [DEBUG] [LOCAL ] CIEN: Primary data saved (52064 records). [2025-10-29T17:56:10.795433] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-29T17:56:10.795766] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-29T17:56:10.796681] [INFO ] [MAIN ] Update Progress: 448/2367 symbols completed. CIEN took 29.3s. Estimated remaining: 4h 0m 28s. Rate: 8.0 symbols/min [2025-10-29T17:56:10.966746] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:10.982321] [DEBUG] [LOCAL ] CII: Loaded 14584 existing records from primary storage. [2025-10-29T17:56:10.982618] [INFO ] [MAIN ] CII: Loaded 14584 existing records. [2025-10-29T17:56:11.154866] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:56:11.155093] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-29T17:56:11.155140] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-29T17:56:11.155418] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-29T17:56:11.155476] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-29T17:56:11.500930] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:11.593531] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-29T17:56:11.734760] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T17:56:12.233068] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-29T17:56:12.393595] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-29T17:56:13.193696] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-29T17:56:13.544534] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:56:13.857594] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-29T17:56:13.993565] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-29T17:56:14.793559] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-29T17:56:15.165496] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:56:15.556751] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T17:56:15.593533] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-29T17:56:15.970504] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-29T17:56:16.393576] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-29T17:56:16.752521] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T17:56:17.193676] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-29T17:56:17.573888] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-29T17:56:17.993582] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-29T17:56:18.793592] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-29T17:56:19.143065] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T17:56:19.388367] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-29T17:56:19.593575] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-29T17:56:20.338545] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-29T17:56:20.339800] [INFO ] [REMOTE ] CIF: Full fetch complete (6529 records). [2025-10-29T17:56:20.339867] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-29T17:56:20.400080] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-29T17:56:20.695778] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-29T17:56:20.695853] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-29T17:56:20.698868] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-29T17:56:20.698930] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-29T17:56:20.699326] [DEBUG] [LOCAL ] CIF: Trimmed 6529 records to 3816 (keeping 200 days of data) [2025-10-29T17:56:20.720919] [DEBUG] [LOCAL ] CIF: Primary data saved (3816 records). [2025-10-29T17:56:20.720981] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-29T17:56:20.721044] [INFO ] [MAIN ] Update Progress: 449/2367 symbols completed. CIF took 23.9s. Estimated remaining: 4h 0m 31s. Rate: 8.0 symbols/min [2025-10-29T17:56:20.891590] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:20.930797] [DEBUG] [LOCAL ] CIM: Loaded 36901 existing records from primary storage. [2025-10-29T17:56:20.931064] [INFO ] [MAIN ] CIM: Loaded 36901 existing records. [2025-10-29T17:56:21.110258] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:56:21.110569] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-29T17:56:21.110635] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-29T17:56:21.118807] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-29T17:56:21.119336] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-29T17:56:21.119667] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T17:56:21.198601] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-29T17:56:21.474661] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:21.783504] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-29T17:56:21.993581] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-29T17:56:22.793563] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-29T17:56:23.157889] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T17:56:23.593591] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-29T17:56:23.787770] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-29T17:56:24.393552] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-29T17:56:24.870837] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T17:56:25.113903] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T17:56:25.193567] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-29T17:56:25.993556] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-29T17:56:26.234192] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T17:56:26.594758] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T17:56:26.793560] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-29T17:56:27.593567] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-29T17:56:27.817715] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T17:56:27.824078] [INFO ] [REMOTE ] CIB: Full fetch complete (45391 records). [2025-10-29T17:56:27.824162] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-29T17:56:28.215368] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-29T17:56:28.215454] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-29T17:56:28.216139] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-29T17:56:28.216203] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-29T17:56:28.217231] [DEBUG] [LOCAL ] CIB: Trimmed 45391 records to 29496 (keeping 200 days of data) [2025-10-29T17:56:28.387613] [DEBUG] [LOCAL ] CIB: Primary data saved (29496 records). [2025-10-29T17:56:28.388391] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-29T17:56:28.388488] [INFO ] [MAIN ] Update Progress: 450/2367 symbols completed. CIB took 1m 1s. Estimated remaining: 4h 0m 24s. Rate: 8.0 symbols/min [2025-10-29T17:56:28.400290] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-29T17:56:28.571778] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:28.576844] [DEBUG] [LOCAL ] CIMN: Loaded 2662 existing records from primary storage. [2025-10-29T17:56:28.576996] [INFO ] [MAIN ] CIMN: Loaded 2662 existing records. [2025-10-29T17:56:28.726138] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T17:56:28.784568] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:56:28.784816] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-29T17:56:28.784863] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-29T17:56:28.785008] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-29T17:56:28.785046] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-29T17:56:29.135274] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T17:56:29.160327] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:29.193523] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-29T17:56:29.596942] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-29T17:56:29.993563] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-29T17:56:30.793567] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-29T17:56:31.336939] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T17:56:31.347859] [INFO ] [REMOTE ] CIG: Full fetch complete (62999 records). [2025-10-29T17:56:31.348016] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-29T17:56:31.594468] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-29T17:56:31.694207] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T17:56:31.747635] [INFO ] [REMOTE ] CII: Full fetch complete (22789 records). [2025-10-29T17:56:31.765854] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-29T17:56:31.785496] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-29T17:56:31.785712] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-29T17:56:31.786590] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-29T17:56:31.786707] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-29T17:56:31.894778] [DEBUG] [LOCAL ] CIG: Trimmed 62999 records to 44650 (keeping 200 days of data) [2025-10-29T17:56:32.292429] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-29T17:56:32.295778] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-29T17:56:32.297475] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-29T17:56:32.297578] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-29T17:56:32.302919] [DEBUG] [LOCAL ] CII: Trimmed 22789 records to 14581 (keeping 200 days of data) [2025-10-29T17:56:32.419942] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-29T17:56:32.485302] [DEBUG] [LOCAL ] CII: Primary data saved (14581 records). [2025-10-29T17:56:32.485983] [INFO ] [MAIN ] CII: Full history saved. [2025-10-29T17:56:32.486372] [INFO ] [MAIN ] Update Progress: 451/2367 symbols completed. CII took 21.7s. Estimated remaining: 4h 0m 2s. Rate: 8.0 symbols/min [2025-10-29T17:56:32.718832] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:32.725129] [DEBUG] [LOCAL ] CIG: Primary data saved (44650 records). [2025-10-29T17:56:32.725598] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-29T17:56:32.725743] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-29T17:56:32.726020] [INFO ] [MAIN ] Update Progress: 452/2367 symbols completed. CIG took 32.6s. Estimated remaining: 3h 59m 24s. Rate: 8.0 symbols/min [2025-10-29T17:56:32.725910] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-29T17:56:32.748225] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-29T17:56:32.788198] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-29T17:56:32.788113] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T17:56:32.829387] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-29T17:56:32.849617] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-29T17:56:33.026273] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:33.059175] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-29T17:56:33.060908] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T17:56:33.060970] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-29T17:56:33.084322] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-29T17:56:33.109840] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-29T17:56:33.115086] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-29T17:56:33.127208] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-29T17:56:33.197189] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-29T17:56:33.594930] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:33.722702] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:33.993562] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-29T17:56:34.129925] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:56:34.130211] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-29T17:56:34.130296] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:56:34.130341] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-29T17:56:34.130373] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:56:34.130410] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-29T17:56:34.130461] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-29T17:56:34.130499] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-29T17:56:34.130541] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-29T17:56:34.130585] [INFO ] [MAIN ] Update Progress: 453/2367 symbols completed. CIMP took 1.4s. Estimated remaining: 3h 58m 50s. Rate: 8.0 symbols/min [2025-10-29T17:56:34.299624] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:34.320012] [DEBUG] [LOCAL ] CINT: Loaded 20423 existing records from primary storage. [2025-10-29T17:56:34.320262] [INFO ] [MAIN ] CINT: Loaded 20423 existing records. [2025-10-29T17:56:34.508706] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:56:34.508951] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-29T17:56:34.509050] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-29T17:56:34.509513] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-29T17:56:34.509714] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-29T17:56:34.754429] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-29T17:56:34.798724] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-29T17:56:34.980032] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:35.121916] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-29T17:56:35.593555] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-29T17:56:35.889672] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-29T17:56:36.393547] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-29T17:56:37.103818] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T17:56:37.193547] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-29T17:56:37.834567] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T17:56:37.993556] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-29T17:56:38.687161] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T17:56:38.793562] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-29T17:56:39.425693] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-29T17:56:39.593594] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-29T17:56:40.013504] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-29T17:56:40.393550] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-29T17:56:41.040038] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-29T17:56:41.193538] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-29T17:56:41.803096] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T17:56:41.993628] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-29T17:56:42.793562] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-29T17:56:43.003106] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T17:56:43.397297] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-29T17:56:43.593562] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-29T17:56:44.244042] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T17:56:44.393543] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-29T17:56:45.169634] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T17:56:45.193535] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-29T17:56:45.993583] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-29T17:56:46.248567] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T17:56:46.460279] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T17:56:46.793557] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-29T17:56:47.102248] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-29T17:56:47.593576] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-29T17:56:47.882289] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-29T17:56:48.393562] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-29T17:56:48.670308] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-29T17:56:49.193560] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-29T17:56:49.993605] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-29T17:56:50.168638] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T17:56:50.174874] [INFO ] [REMOTE ] CINT: Full fetch complete (28859 records). [2025-10-29T17:56:50.174954] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-29T17:56:50.538976] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-29T17:56:50.539049] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-29T17:56:50.539504] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-29T17:56:50.539543] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-29T17:56:50.540206] [DEBUG] [LOCAL ] CINT: Trimmed 28859 records to 20414 (keeping 200 days of data) [2025-10-29T17:56:50.645753] [DEBUG] [LOCAL ] CINT: Primary data saved (20414 records). [2025-10-29T17:56:50.645872] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-29T17:56:50.645982] [INFO ] [MAIN ] Update Progress: 454/2367 symbols completed. CINT took 16.5s. Estimated remaining: 3h 59m 21s. Rate: 8.0 symbols/min [2025-10-29T17:56:50.798454] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-29T17:56:50.818295] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:50.838989] [DEBUG] [LOCAL ] CIO: Loaded 21194 existing records from primary storage. [2025-10-29T17:56:50.839249] [INFO ] [MAIN ] CIO: Loaded 21194 existing records. [2025-10-29T17:56:51.033435] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:56:51.054728] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-29T17:56:51.055387] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-29T17:56:51.056990] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-29T17:56:51.056924] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-29T17:56:51.057184] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-29T17:56:51.331582] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T17:56:51.441081] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:51.593561] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-29T17:56:52.360048] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T17:56:52.393548] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-29T17:56:53.011788] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T17:56:53.193562] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-29T17:56:53.993610] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-29T17:56:54.183971] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T17:56:54.274706] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-29T17:56:54.793542] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-29T17:56:55.090136] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-29T17:56:55.593555] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-29T17:56:56.393546] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-29T17:56:56.949466] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T17:56:56.968898] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T17:56:57.193564] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-29T17:56:57.706198] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-29T17:56:57.707335] [INFO ] [REMOTE ] CIMN: Full fetch complete (3851 records). [2025-10-29T17:56:57.707404] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-29T17:56:57.996316] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-29T17:56:58.076105] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-29T17:56:58.076177] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-29T17:56:58.076302] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-29T17:56:58.076340] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-29T17:56:58.076709] [DEBUG] [LOCAL ] CIMN: Trimmed 3851 records to 2641 (keeping 200 days of data) [2025-10-29T17:56:58.092571] [DEBUG] [LOCAL ] CIMN: Primary data saved (2641 records). [2025-10-29T17:56:58.092676] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-29T17:56:58.092767] [INFO ] [MAIN ] Update Progress: 455/2367 symbols completed. CIMN took 29.7s. Estimated remaining: 3h 59m 13s. Rate: 8.0 symbols/min [2025-10-29T17:56:58.259956] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:56:58.285969] [DEBUG] [LOCAL ] CION: Loaded 27286 existing records from primary storage. [2025-10-29T17:56:58.286214] [INFO ] [MAIN ] CION: Loaded 27286 existing records. [2025-10-29T17:56:58.469058] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:56:58.464842] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-29T17:56:58.471043] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-29T17:56:58.471104] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-29T17:56:58.471342] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-29T17:56:58.471399] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-29T17:56:58.796035] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-29T17:56:58.824079] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:56:59.504609] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T17:56:59.593552] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-29T17:57:00.393538] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-29T17:57:00.544889] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T17:57:01.040380] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-29T17:57:01.193566] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-29T17:57:01.993611] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-29T17:57:02.405933] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T17:57:02.415134] [INFO ] [REMOTE ] CIM: Full fetch complete (54700 records). [2025-10-29T17:57:02.415297] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-29T17:57:02.797703] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-29T17:57:02.847417] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-29T17:57:02.848781] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T17:57:02.848057] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-29T17:57:02.854373] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-29T17:57:02.855567] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-29T17:57:02.857180] [DEBUG] [LOCAL ] CIM: Trimmed 54700 records to 36841 (keeping 200 days of data) [2025-10-29T17:57:03.077385] [DEBUG] [LOCAL ] CIM: Primary data saved (36841 records). [2025-10-29T17:57:03.077517] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-29T17:57:03.077594] [INFO ] [MAIN ] Update Progress: 456/2367 symbols completed. CIM took 42.4s. Estimated remaining: 3h 58m 55s. Rate: 8.0 symbols/min [2025-10-29T17:57:03.245609] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:57:03.294245] [DEBUG] [LOCAL ] CIVI: Loaded 52642 existing records from primary storage. [2025-10-29T17:57:03.294554] [INFO ] [MAIN ] CIVI: Loaded 52642 existing records. [2025-10-29T17:57:03.475878] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:57:03.476129] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-29T17:57:03.476226] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-29T17:57:03.476480] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-29T17:57:03.476546] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-29T17:57:03.614987] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T17:57:03.602099] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-29T17:57:03.848029] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:57:04.271261] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T17:57:04.393706] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-29T17:57:05.193716] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-29T17:57:05.288825] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T17:57:05.995256] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-29T17:57:05.999243] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T17:57:06.793556] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-29T17:57:07.006410] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T17:57:07.469200] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T17:57:07.593578] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-29T17:57:07.846014] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-29T17:57:08.393570] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-29T17:57:09.193533] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-29T17:57:09.282395] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T17:57:09.993547] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-29T17:57:10.474339] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T17:57:10.793556] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-29T17:57:11.045190] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T17:57:11.593591] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-29T17:57:12.057494] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-29T17:57:12.198774] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-29T17:57:12.393561] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-29T17:57:12.679255] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-29T17:57:13.193734] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-29T17:57:13.998692] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-29T17:57:14.010370] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T17:57:14.428954] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-29T17:57:14.793610] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-29T17:57:15.598635] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-29T17:57:15.607495] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-29T17:57:16.393775] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-29T17:57:16.393839] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-29T17:57:17.193560] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-29T17:57:17.303963] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T17:57:17.309922] [INFO ] [REMOTE ] CIO: Full fetch complete (29752 records). [2025-10-29T17:57:17.310013] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-29T17:57:17.310494] [FATAL] [VALIDATOR ] CIO: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:57:17.310579] [FATAL] [MAIN ] CIO: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:57:17.310622] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:57:17.310701] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-29T17:57:17.310786] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-29T17:57:17.310826] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-10-29T17:57:17.311003] [DEBUG] [LOCAL ] CIO: Deleted derivative data file. [2025-10-29T17:57:17.311088] [INFO ] [MAIN ] Update Progress: 457/2367 symbols completed. CIO took 26.7s. Estimated remaining: 3h 59m 16s. Rate: 8.0 symbols/min [2025-10-29T17:57:17.476526] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:57:17.537782] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-29T17:57:17.538118] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-29T17:57:17.713765] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:57:17.713967] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-29T17:57:17.714014] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-29T17:57:17.714337] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-29T17:57:17.714379] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-29T17:57:17.997557] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-29T17:57:18.077722] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:57:18.567706] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T17:57:18.793561] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-29T17:57:18.864132] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T17:57:18.870198] [INFO ] [REMOTE ] CION: Full fetch complete (40186 records). [2025-10-29T17:57:18.870400] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-29T17:57:18.871393] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T17:57:18.871490] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:57:18.871536] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:57:18.871621] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-29T17:57:18.871790] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-29T17:57:18.871846] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-29T17:57:18.872164] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-10-29T17:57:18.872308] [INFO ] [MAIN ] Update Progress: 458/2367 symbols completed. CION took 20.8s. Estimated remaining: 3h 58m 43s. Rate: 8.0 symbols/min [2025-10-29T17:57:19.071412] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:57:19.111456] [DEBUG] [LOCAL ] CLB: Loaded 33443 existing records from primary storage. [2025-10-29T17:57:19.111976] [INFO ] [MAIN ] CLB: Loaded 33443 existing records. [2025-10-29T17:57:19.302935] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:57:19.303208] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-29T17:57:19.303258] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-29T17:57:19.303886] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-29T17:57:19.303949] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-29T17:57:19.598836] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-29T17:57:19.718711] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:57:20.011238] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-29T17:57:20.199581] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-29T17:57:20.393550] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-29T17:57:21.193576] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-29T17:57:21.839975] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T17:57:21.993539] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-29T17:57:22.422085] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T17:57:22.793630] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-29T17:57:23.238711] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T17:57:23.593581] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-29T17:57:24.022728] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T17:57:24.393624] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-29T17:57:24.596698] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-29T17:57:25.193576] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-29T17:57:25.611669] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T17:57:25.993631] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-29T17:57:26.013262] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-29T17:57:26.793609] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-29T17:57:27.217834] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T17:57:27.593578] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-29T17:57:27.703266] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-29T17:57:28.393588] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-29T17:57:28.814923] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T17:57:28.908150] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-29T17:57:28.909712] [INFO ] [REMOTE ] CIMO: Full fetch complete (4537 records). [2025-10-29T17:57:28.909802] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-29T17:57:29.109729] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-29T17:57:29.109953] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-29T17:57:29.110020] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-29T17:57:29.110067] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-29T17:57:29.110119] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-29T17:57:29.110153] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-29T17:57:29.110191] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-29T17:57:29.110243] [INFO ] [MAIN ] Update Progress: 459/2367 symbols completed. CIMO took 56.6s. Estimated remaining: 3h 58m 47s. Rate: 8.0 symbols/min [2025-10-29T17:57:29.198742] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-29T17:57:29.280943] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:57:29.300548] [DEBUG] [LOCAL ] CLCO: Loaded 12886 existing records from primary storage. [2025-10-29T17:57:29.300798] [INFO ] [MAIN ] CLCO: Loaded 12886 existing records. [2025-10-29T17:57:29.499418] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:57:29.499663] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-29T17:57:29.499725] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-29T17:57:29.499906] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-29T17:57:29.499964] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-29T17:57:29.869304] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:57:29.993562] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-29T17:57:30.636063] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T17:57:30.793608] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-29T17:57:31.191382] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T17:57:31.593545] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-29T17:57:31.673782] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T17:57:32.393611] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-29T17:57:32.998905] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T17:57:33.193589] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-29T17:57:33.993587] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-29T17:57:34.072933] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-29T17:57:34.084196] [INFO ] [REMOTE ] CIVI: Full fetch complete (76093 records). [2025-10-29T17:57:34.084335] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-29T17:57:34.484329] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-29T17:57:34.484447] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-29T17:57:34.485416] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-29T17:57:34.485508] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-29T17:57:34.487204] [DEBUG] [LOCAL ] CIVI: Trimmed 76093 records to 52636 (keeping 200 days of data) [2025-10-29T17:57:34.608487] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T17:57:34.764794] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T17:57:34.798856] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-29T17:57:34.883207] [DEBUG] [LOCAL ] CIVI: Primary data saved (52636 records). [2025-10-29T17:57:34.883356] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-29T17:57:34.884402] [INFO ] [MAIN ] Update Progress: 460/2367 symbols completed. CIVI took 31.8s. Estimated remaining: 3h 58m 33s. Rate: 8.0 symbols/min [2025-10-29T17:57:35.078958] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:57:35.103959] [DEBUG] [LOCAL ] CLDT: Loaded 24678 existing records from primary storage. [2025-10-29T17:57:35.104212] [INFO ] [MAIN ] CLDT: Loaded 24678 existing records. [2025-10-29T17:57:35.307012] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:57:35.307218] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-29T17:57:35.307291] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-29T17:57:35.307722] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-29T17:57:35.307782] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-29T17:57:35.598757] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-29T17:57:35.656539] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:57:36.045987] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T17:57:36.393527] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-29T17:57:36.434794] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-29T17:57:37.059274] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T17:57:37.193544] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-29T17:57:37.993549] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-29T17:57:38.012064] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-29T17:57:38.793559] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-29T17:57:39.220574] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:57:39.372850] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T17:57:39.593544] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-29T17:57:40.393551] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-29T17:57:40.435348] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-29T17:57:40.814310] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-29T17:57:41.193574] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-29T17:57:41.993582] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-29T17:57:42.705711] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-29T17:57:42.793527] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-29T17:57:42.980882] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T17:57:43.593630] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-29T17:57:44.168566] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T17:57:44.263946] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T17:57:44.393574] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-29T17:57:44.866289] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T17:57:45.193622] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-29T17:57:45.683899] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-29T17:57:45.993612] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-29T17:57:46.793564] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-29T17:57:47.574064] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T17:57:47.589546] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-29T17:57:47.590069] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-29T17:57:47.604365] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-29T17:57:47.804002] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T17:57:48.082718] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-29T17:57:48.082844] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-29T17:57:48.084056] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-29T17:57:48.084127] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-29T17:57:48.086147] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 53649 (keeping 200 days of data) [2025-10-29T17:57:48.326758] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-29T17:57:48.409596] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-29T17:57:48.465175] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-29T17:57:48.465804] [INFO ] [MAIN ] CL: Full history saved. [2025-10-29T17:57:48.466095] [INFO ] [MAIN ] Update Progress: 461/2367 symbols completed. CL took 31.2s. Estimated remaining: 3h 58m 50s. Rate: 8.0 symbols/min [2025-10-29T17:57:48.642007] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:57:48.698808] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-29T17:57:48.699253] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-29T17:57:48.942715] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:57:48.943004] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-29T17:57:48.943119] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-29T17:57:48.943778] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-29T17:57:48.943861] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-29T17:57:49.202903] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-29T17:57:49.345245] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:57:49.359035] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T17:57:49.363941] [INFO ] [REMOTE ] CLCO: Full fetch complete (22576 records). [2025-10-29T17:57:49.364040] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-29T17:57:49.734176] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-29T17:57:49.734257] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-29T17:57:49.734696] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-29T17:57:49.734757] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-29T17:57:49.735349] [DEBUG] [LOCAL ] CLCO: Trimmed 22576 records to 12830 (keeping 200 days of data) [2025-10-29T17:57:49.804056] [DEBUG] [LOCAL ] CLCO: Primary data saved (12830 records). [2025-10-29T17:57:49.804182] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-29T17:57:49.804255] [INFO ] [MAIN ] Update Progress: 462/2367 symbols completed. CLCO took 20.7s. Estimated remaining: 3h 58m 17s. Rate: 8.0 symbols/min [2025-10-29T17:57:49.977230] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:57:49.993517] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-29T17:57:50.005987] [DEBUG] [LOCAL ] CLH: Loaded 27313 existing records from primary storage. [2025-10-29T17:57:50.006330] [INFO ] [MAIN ] CLH: Loaded 27313 existing records. [2025-10-29T17:57:50.100930] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-29T17:57:50.201156] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:57:50.201358] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-29T17:57:50.201404] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-29T17:57:50.201750] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-29T17:57:50.201807] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-29T17:57:50.544022] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:57:50.793521] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-29T17:57:50.869367] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T17:57:51.593673] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-29T17:57:51.838421] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T17:57:52.393688] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-29T17:57:52.397444] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-29T17:57:53.193570] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-29T17:57:53.943666] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T17:57:53.998243] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-29T17:57:54.004462] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T17:57:54.793576] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-29T17:57:55.493933] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-29T17:57:55.539739] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-29T17:57:55.593574] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-29T17:57:56.393740] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-29T17:57:57.191320] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-29T17:57:57.201856] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-29T17:57:57.351352] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T17:57:57.993592] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-29T17:57:58.163692] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-29T17:57:58.793572] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-29T17:57:59.582191] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-29T17:57:59.593740] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-29T17:57:59.639987] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T17:58:00.393524] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-29T17:58:00.533008] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T17:58:01.193703] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-29T17:58:01.993554] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-29T17:58:02.156469] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-29T17:58:02.421366] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T17:58:02.760693] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T17:58:02.793568] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-29T17:58:03.593639] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-29T17:58:04.019901] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-29T17:58:04.027883] [INFO ] [REMOTE ] CLB: Full fetch complete (47983 records). [2025-10-29T17:58:04.028028] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-29T17:58:04.398735] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-29T17:58:04.415991] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-29T17:58:04.416073] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-29T17:58:04.416793] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-29T17:58:04.416981] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-29T17:58:04.417995] [DEBUG] [LOCAL ] CLB: Trimmed 47983 records to 33447 (keeping 200 days of data) [2025-10-29T17:58:04.617534] [DEBUG] [LOCAL ] CLB: Primary data saved (33447 records). [2025-10-29T17:58:04.617694] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-29T17:58:04.617785] [INFO ] [MAIN ] Update Progress: 463/2367 symbols completed. CLB took 45.7s. Estimated remaining: 3h 58m 40s. Rate: 8.0 symbols/min [2025-10-29T17:58:04.794336] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:58:04.812757] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T17:58:04.821679] [INFO ] [REMOTE ] CLDT: Full fetch complete (37750 records). [2025-10-29T17:58:04.821858] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-29T17:58:04.870773] [DEBUG] [LOCAL ] CLPR: Loaded 9592 existing records from primary storage. [2025-10-29T17:58:04.897319] [INFO ] [MAIN ] CLPR: Loaded 9592 existing records. [2025-10-29T17:58:05.198730] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-29T17:58:05.272244] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:58:05.311065] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-29T17:58:05.324781] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-29T17:58:05.350955] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-29T17:58:05.376690] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-29T17:58:05.489893] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-29T17:58:05.506888] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-29T17:58:05.523701] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-29T17:58:05.524348] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-29T17:58:05.683860] [DEBUG] [LOCAL ] CLDT: Trimmed 37750 records to 24605 (keeping 200 days of data) [2025-10-29T17:58:05.874934] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:58:05.941845] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T17:58:05.954830] [DEBUG] [LOCAL ] CLDT: Primary data saved (24605 records). [2025-10-29T17:58:05.954911] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-29T17:58:05.954978] [INFO ] [MAIN ] Update Progress: 464/2367 symbols completed. CLDT took 31.1s. Estimated remaining: 3h 58m 7s. Rate: 8.0 symbols/min [2025-10-29T17:58:05.998634] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-29T17:58:06.122813] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:58:06.176720] [DEBUG] [LOCAL ] CLS: Loaded 53546 existing records from primary storage. [2025-10-29T17:58:06.177011] [INFO ] [MAIN ] CLS: Loaded 53546 existing records. [2025-10-29T17:58:06.350077] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:58:06.350312] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-29T17:58:06.350367] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-29T17:58:06.351068] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-29T17:58:06.351126] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-29T17:58:06.700232] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:58:06.790453] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-29T17:58:06.794458] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-29T17:58:06.826307] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-29T17:58:07.478387] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-29T17:58:07.593617] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-29T17:58:08.393579] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-29T17:58:09.192024] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-29T17:58:09.201761] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-29T17:58:09.704615] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T17:58:09.813582] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-29T17:58:09.993609] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-29T17:58:10.532798] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T17:58:10.793571] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-29T17:58:11.593565] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-29T17:58:12.091480] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-29T17:58:12.178567] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T17:58:12.393588] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-29T17:58:13.193622] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-29T17:58:13.993561] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-29T17:58:14.038238] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-29T17:58:14.141408] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-29T17:58:14.563758] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T17:58:14.793578] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-29T17:58:15.593578] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-29T17:58:16.082937] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-29T17:58:16.393536] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-29T17:58:16.765009] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-29T17:58:16.958514] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-29T17:58:17.193684] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-29T17:58:17.993542] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-29T17:58:18.008275] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-29T17:58:18.793598] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-29T17:58:18.948868] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T17:58:19.593565] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-29T17:58:20.011895] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-29T17:58:20.393556] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-29T17:58:20.631887] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-29T17:58:21.189944] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-29T17:58:21.195322] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-29T17:58:21.993526] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-29T17:58:22.019968] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-29T17:58:22.022052] [INFO ] [REMOTE ] CLPR: Full fetch complete (15587 records). [2025-10-29T17:58:22.022123] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-29T17:58:22.385768] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-29T17:58:22.385846] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-29T17:58:22.386229] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-29T17:58:22.386290] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-29T17:58:22.386806] [DEBUG] [LOCAL ] CLPR: Trimmed 15587 records to 9543 (keeping 200 days of data) [2025-10-29T17:58:22.443787] [DEBUG] [LOCAL ] CLPR: Primary data saved (9543 records). [2025-10-29T17:58:22.443889] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-29T17:58:22.443968] [INFO ] [MAIN ] Update Progress: 465/2367 symbols completed. CLPR took 17.8s. Estimated remaining: 3h 58m 36s. Rate: 8.0 symbols/min [2025-10-29T17:58:22.611573] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:58:22.656766] [DEBUG] [LOCAL ] CLVT: Loaded 51857 existing records from primary storage. [2025-10-29T17:58:22.657079] [INFO ] [MAIN ] CLVT: Loaded 51857 existing records. [2025-10-29T17:58:22.803428] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-29T17:58:22.833155] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:58:22.833374] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-29T17:58:22.833782] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-29T17:58:22.834364] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-29T17:58:22.834421] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-29T17:58:23.185762] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:58:23.593604] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-29T17:58:23.874599] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-29T17:58:24.393577] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-29T17:58:24.676843] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-29T17:58:24.689471] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-29T17:58:24.689700] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-29T17:58:25.135003] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-29T17:58:25.191774] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-29T17:58:25.191845] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-29T17:58:25.192671] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-29T17:58:25.192731] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-29T17:58:25.193567] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-29T17:58:25.195031] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-29T17:58:25.500602] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-29T17:58:25.500751] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-29T17:58:25.500830] [INFO ] [MAIN ] Update Progress: 466/2367 symbols completed. CLF took 37.0s. Estimated remaining: 3h 58m 10s. Rate: 8.0 symbols/min [2025-10-29T17:58:25.673158] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:58:25.698098] [DEBUG] [LOCAL ] CLW: Loaded 20961 existing records from primary storage. [2025-10-29T17:58:25.698426] [INFO ] [MAIN ] CLW: Loaded 20961 existing records. [2025-10-29T17:58:25.873541] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:58:25.873785] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-29T17:58:25.873867] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-29T17:58:25.874194] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-29T17:58:25.874265] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-29T17:58:25.998727] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-29T17:58:26.265232] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:58:26.303008] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-29T17:58:26.373503] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-29T17:58:26.793557] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-29T17:58:26.976045] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-29T17:58:27.593567] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-29T17:58:27.770818] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-29T17:58:28.393552] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-29T17:58:29.193623] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-29T17:58:29.341795] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-29T17:58:29.587433] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T17:58:29.837492] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T17:58:29.993613] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-29T17:58:30.793618] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-29T17:58:31.117823] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T17:58:31.466127] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T17:58:31.593545] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-29T17:58:32.319966] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-29T17:58:32.393559] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-29T17:58:33.121205] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-29T17:58:33.193537] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-29T17:58:33.993533] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-29T17:58:34.048858] [DEBUG] [REMOTE ] CLW: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-29T17:58:34.049143] [WARN ] [REMOTE ] CLW: No data returned for month 2025-06 [2025-10-29T17:58:34.049230] [FATAL] [REMOTE ] CLW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:58:34.049302] [FATAL] [MAIN ] CLW: Failed to fetch primary data. [2025-10-29T17:58:34.049364] [WARN ] [MAIN ] CLW: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:58:34.049434] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-29T17:58:34.049495] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-10-29T17:58:34.049529] [INFO ] [LOCAL ] CLW: Starting deletion of derivative data. [2025-10-29T17:58:34.049719] [DEBUG] [LOCAL ] CLW: Deleted derivative data file. [2025-10-29T17:58:34.049800] [INFO ] [MAIN ] Update Progress: 467/2367 symbols completed. CLW took 8.5s. Estimated remaining: 3h 58m 7s. Rate: 8.0 symbols/min [2025-10-29T17:58:34.220071] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:58:34.271506] [DEBUG] [LOCAL ] CLX: Loaded 51838 existing records from primary storage. [2025-10-29T17:58:34.271860] [INFO ] [MAIN ] CLX: Loaded 51838 existing records. [2025-10-29T17:58:34.453925] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:58:34.454366] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-29T17:58:34.454618] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-29T17:58:34.463926] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-29T17:58:34.473607] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-29T17:58:34.557858] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T17:58:34.596940] [INFO ] [REMOTE ] CLH: Full fetch complete (42408 records). [2025-10-29T17:58:34.612683] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-29T17:58:34.798687] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-29T17:58:35.170079] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:58:35.234016] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-29T17:58:35.234081] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-29T17:58:35.234634] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-29T17:58:35.234712] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-29T17:58:35.235626] [DEBUG] [LOCAL ] CLH: Trimmed 42408 records to 27380 (keeping 200 days of data) [2025-10-29T17:58:35.409018] [DEBUG] [LOCAL ] CLH: Primary data saved (27380 records). [2025-10-29T17:58:35.409152] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-29T17:58:35.409228] [INFO ] [MAIN ] Update Progress: 468/2367 symbols completed. CLH took 45.6s. Estimated remaining: 3h 57m 35s. Rate: 8.0 symbols/min [2025-10-29T17:58:35.573493] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:58:35.596779] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-29T17:58:35.616007] [DEBUG] [LOCAL ] CM: Loaded 48051 existing records from primary storage. [2025-10-29T17:58:35.616325] [INFO ] [MAIN ] CM: Loaded 48051 existing records. [2025-10-29T17:58:35.795076] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:58:35.796282] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-29T17:58:35.796346] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-29T17:58:35.797124] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-29T17:58:35.797181] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-29T17:58:36.163675] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:58:36.393579] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-29T17:58:36.738604] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-29T17:58:36.923915] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T17:58:37.193545] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-29T17:58:37.539127] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T17:58:37.993573] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-29T17:58:38.526308] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T17:58:38.793601] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-29T17:58:39.374681] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-29T17:58:39.593687] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-29T17:58:40.393581] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-29T17:58:40.724798] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-29T17:58:40.887569] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T17:58:41.193570] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-29T17:58:41.717217] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T17:58:41.993557] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-29T17:58:42.329624] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T17:58:42.793584] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-29T17:58:43.253331] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T17:58:43.593575] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-29T17:58:44.393555] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-29T17:58:44.491227] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-29T17:58:44.764232] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T17:58:45.193573] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-29T17:58:45.555794] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T17:58:45.993622] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-29T17:58:46.344550] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T17:58:46.793617] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-29T17:58:47.229087] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T17:58:47.593636] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-29T17:58:48.182073] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T17:58:48.393570] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-29T17:58:49.193535] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-29T17:58:49.839673] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-29T17:58:49.855064] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T17:58:49.854042] [INFO ] [REMOTE ] CLS: Full fetch complete (77707 records). [2025-10-29T17:58:49.855236] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-29T17:58:50.006728] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-29T17:58:50.261770] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-29T17:58:50.261870] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-29T17:58:50.262890] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-29T17:58:50.262971] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-29T17:58:50.264721] [DEBUG] [LOCAL ] CLS: Trimmed 77707 records to 53546 (keeping 200 days of data) [2025-10-29T17:58:50.392254] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T17:58:50.621984] [DEBUG] [LOCAL ] CLS: Primary data saved (53546 records). [2025-10-29T17:58:50.622108] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-29T17:58:50.623039] [INFO ] [MAIN ] Update Progress: 469/2367 symbols completed. CLS took 44.7s. Estimated remaining: 3h 57m 58s. Rate: 8.0 symbols/min [2025-10-29T17:58:50.790410] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:58:50.793583] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-29T17:58:50.851944] [DEBUG] [LOCAL ] CMA: Loaded 50115 existing records from primary storage. [2025-10-29T17:58:50.852469] [INFO ] [MAIN ] CMA: Loaded 50115 existing records. [2025-10-29T17:58:51.038672] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:58:51.038890] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-29T17:58:51.038938] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-29T17:58:51.039251] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-29T17:58:51.039308] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-29T17:58:51.403682] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:58:51.483191] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-29T17:58:51.593577] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-29T17:58:52.105999] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T17:58:52.393564] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-29T17:58:52.911388] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T17:58:53.193562] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-29T17:58:53.500012] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T17:58:53.641036] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-29T17:58:53.651873] [INFO ] [REMOTE ] CLX: Full fetch complete (74008 records). [2025-10-29T17:58:53.652000] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-29T17:58:53.999260] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-29T17:58:54.061106] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-29T17:58:54.061185] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-29T17:58:54.061998] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-29T17:58:54.062061] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-29T17:58:54.063400] [DEBUG] [LOCAL ] CLX: Trimmed 74008 records to 51856 (keeping 200 days of data) [2025-10-29T17:58:54.390079] [DEBUG] [LOCAL ] CLX: Primary data saved (51856 records). [2025-10-29T17:58:54.390238] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-29T17:58:54.390345] [INFO ] [MAIN ] Update Progress: 470/2367 symbols completed. CLX took 20.3s. Estimated remaining: 3h 57m 36s. Rate: 8.0 symbols/min [2025-10-29T17:58:54.555072] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:58:54.582075] [DEBUG] [LOCAL ] CMBT: Loaded 28622 existing records from primary storage. [2025-10-29T17:58:54.582351] [INFO ] [MAIN ] CMBT: Loaded 28622 existing records. [2025-10-29T17:58:54.754025] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:58:54.754213] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-29T17:58:54.754259] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-29T17:58:54.754623] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-29T17:58:54.754718] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-29T17:58:54.798775] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-29T17:58:55.105518] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:58:55.250861] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T17:58:55.593584] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-29T17:58:55.984548] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T17:58:56.393611] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-29T17:58:56.667462] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T17:58:57.193621] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-29T17:58:57.675963] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T17:58:57.993567] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-29T17:58:58.426580] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T17:58:58.793600] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-29T17:58:59.389666] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T17:58:59.400921] [INFO ] [REMOTE ] CLVT: Full fetch complete (75388 records). [2025-10-29T17:58:59.401132] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-29T17:58:59.607247] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-29T17:58:59.823936] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-29T17:58:59.824158] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-29T17:58:59.825211] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-29T17:58:59.825334] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-29T17:58:59.828034] [DEBUG] [LOCAL ] CLVT: Trimmed 75388 records to 51848 (keeping 200 days of data) [2025-10-29T17:59:00.067947] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T17:59:00.159080] [DEBUG] [LOCAL ] CLVT: Primary data saved (51848 records). [2025-10-29T17:59:00.159213] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-29T17:59:00.159288] [INFO ] [MAIN ] Update Progress: 471/2367 symbols completed. CLVT took 37.7s. Estimated remaining: 3h 57m 21s. Rate: 8.0 symbols/min [2025-10-29T17:59:00.327421] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:00.327607] [DEBUG] [LOCAL ] CMC: No existing data file found in primary storage. [2025-10-29T17:59:00.327670] [WARN ] [MAIN ] CMC: No existing data found, performing full refresh instead. [2025-10-29T17:59:00.327788] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-29T17:59:00.327828] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-29T17:59:00.327867] [DEBUG] [LOCAL ] CMC: No primary data file found to delete. [2025-10-29T17:59:00.327897] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-29T17:59:00.398786] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-29T17:59:00.689506] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:59:00.928363] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T17:59:01.193552] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-29T17:59:01.258344] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T17:59:01.993623] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-29T17:59:02.352867] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T17:59:02.793573] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-29T17:59:03.274391] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T17:59:03.593618] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-29T17:59:03.958809] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T17:59:04.393541] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-29T17:59:04.835558] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T17:59:05.078789] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T17:59:05.193580] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-29T17:59:05.993567] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-29T17:59:06.593691] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-29T17:59:06.793602] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-29T17:59:07.345794] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T17:59:07.355528] [INFO ] [REMOTE ] CM: Full fetch complete (69642 records). [2025-10-29T17:59:07.355669] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-29T17:59:07.598819] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-29T17:59:07.751191] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-29T17:59:07.751269] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-29T17:59:07.752055] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-29T17:59:07.752116] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-29T17:59:07.753397] [DEBUG] [LOCAL ] CM: Trimmed 69642 records to 48010 (keeping 200 days of data) [2025-10-29T17:59:08.080617] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T17:59:08.082384] [DEBUG] [LOCAL ] CM: Primary data saved (48010 records). [2025-10-29T17:59:08.092837] [INFO ] [MAIN ] CM: Full history saved. [2025-10-29T17:59:08.092966] [INFO ] [MAIN ] Update Progress: 472/2367 symbols completed. CM took 32.7s. Estimated remaining: 3h 57m 15s. Rate: 8.0 symbols/min [2025-10-29T17:59:08.268454] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:08.279183] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-29T17:59:08.287949] [DEBUG] [LOCAL ] CMCM: Loaded 4794 existing records from primary storage. [2025-10-29T17:59:08.288162] [INFO ] [MAIN ] CMCM: Loaded 4794 existing records. [2025-10-29T17:59:08.398734] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-29T17:59:08.474970] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:59:08.475184] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-29T17:59:08.475233] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-29T17:59:08.475380] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-29T17:59:08.475420] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-29T17:59:08.835839] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:59:09.193560] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-29T17:59:09.234677] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-29T17:59:09.993584] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-29T17:59:10.373636] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T17:59:10.430194] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T17:59:10.793589] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-29T17:59:11.593584] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-29T17:59:12.164415] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T17:59:12.207010] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-29T17:59:12.219298] [INFO ] [REMOTE ] CMA: Full fetch complete (73477 records). [2025-10-29T17:59:12.219601] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-29T17:59:12.403311] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-29T17:59:12.636504] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-29T17:59:12.636588] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-29T17:59:12.637410] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-29T17:59:12.637475] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-29T17:59:12.638894] [DEBUG] [LOCAL ] CMA: Trimmed 73477 records to 50103 (keeping 200 days of data) [2025-10-29T17:59:12.940612] [DEBUG] [LOCAL ] CMA: Primary data saved (50103 records). [2025-10-29T17:59:12.940786] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-29T17:59:12.941719] [INFO ] [MAIN ] Update Progress: 473/2367 symbols completed. CMA took 22.3s. Estimated remaining: 3h 56m 57s. Rate: 8.0 symbols/min [2025-10-29T17:59:13.112425] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:13.112626] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-29T17:59:13.112712] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-29T17:59:13.112827] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-29T17:59:13.112870] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-29T17:59:13.112911] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-29T17:59:13.112944] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-29T17:59:13.198749] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-29T17:59:13.498016] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T17:59:13.503701] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:59:13.626741] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-29T17:59:13.993570] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-29T17:59:14.611973] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T17:59:14.793564] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-29T17:59:15.451971] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-29T17:59:15.593562] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-29T17:59:15.817409] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T17:59:15.817741] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-29T17:59:15.817828] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T17:59:15.817873] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-29T17:59:15.817908] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T17:59:15.817945] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-29T17:59:15.817997] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-29T17:59:15.818031] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-29T17:59:15.818068] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-29T17:59:15.818113] [INFO ] [MAIN ] Update Progress: 474/2367 symbols completed. CMDB took 2.9s. Estimated remaining: 3h 56m 31s. Rate: 8.0 symbols/min [2025-10-29T17:59:15.999906] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:16.000068] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-10-29T17:59:16.000103] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-10-29T17:59:16.000208] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-29T17:59:16.000248] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-29T17:59:16.000288] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-29T17:59:16.000319] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-29T17:59:16.355175] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:59:16.393558] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-29T17:59:17.193566] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-29T17:59:17.973753] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-29T17:59:17.993519] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-29T17:59:18.173213] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T17:59:18.793592] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-29T17:59:19.593562] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-29T17:59:19.718819] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-29T17:59:19.881551] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-29T17:59:20.016846] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T17:59:20.393548] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-29T17:59:21.193716] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-29T17:59:21.986172] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-29T17:59:21.996573] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-29T17:59:22.377875] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-29T17:59:22.547493] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T17:59:22.793599] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-29T17:59:23.593551] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-29T17:59:23.947830] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T17:59:24.393616] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-29T17:59:25.193591] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-29T17:59:25.272607] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-29T17:59:25.777887] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T17:59:25.789469] [INFO ] [REMOTE ] CMBT: Full fetch complete (35283 records). [2025-10-29T17:59:25.789620] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-29T17:59:26.002323] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-29T17:59:26.207513] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-29T17:59:26.207670] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-29T17:59:26.208721] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-29T17:59:26.208811] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-29T17:59:26.210370] [DEBUG] [LOCAL ] CMBT: Trimmed 35283 records to 28920 (keeping 200 days of data) [2025-10-29T17:59:26.426138] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T17:59:26.429838] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-29T17:59:26.449378] [DEBUG] [LOCAL ] CMBT: Primary data saved (28920 records). [2025-10-29T17:59:26.450574] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-29T17:59:26.451064] [INFO ] [MAIN ] Update Progress: 475/2367 symbols completed. CMBT took 32.1s. Estimated remaining: 3h 56m 36s. Rate: 8.0 symbols/min [2025-10-29T17:59:26.633102] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:26.669545] [DEBUG] [LOCAL ] CMI: Loaded 41254 existing records from primary storage. [2025-10-29T17:59:26.669853] [INFO ] [MAIN ] CMI: Loaded 41254 existing records. [2025-10-29T17:59:26.808852] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-29T17:59:26.848960] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:59:26.849171] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-29T17:59:26.849219] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-29T17:59:26.849515] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-29T17:59:26.849574] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-29T17:59:27.227773] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:59:27.303574] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-29T17:59:27.593554] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-29T17:59:28.393620] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-29T17:59:29.045594] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-29T17:59:29.193568] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-29T17:59:29.553636] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T17:59:29.993557] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-29T17:59:30.709193] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-29T17:59:30.793540] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-29T17:59:31.156308] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T17:59:31.593591] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-29T17:59:32.393571] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-29T17:59:32.445636] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-29T17:59:32.720306] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T17:59:32.932404] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-29T17:59:33.193547] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-29T17:59:33.993562] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-29T17:59:34.350838] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T17:59:34.793553] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-29T17:59:34.971408] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T17:59:35.593562] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-29T17:59:35.990731] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T17:59:36.393584] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-29T17:59:37.134611] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-29T17:59:37.193521] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-29T17:59:37.560566] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T17:59:37.993546] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-29T17:59:38.172820] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T17:59:38.793550] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-29T17:59:39.015829] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-29T17:59:39.593565] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-29T17:59:39.945273] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T17:59:40.393551] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-29T17:59:40.758561] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-29T17:59:40.924767] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T17:59:41.193565] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-29T17:59:41.703783] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-29T17:59:41.705632] [INFO ] [REMOTE ] CMCM: Full fetch complete (7046 records). [2025-10-29T17:59:41.705738] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-29T17:59:41.998737] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-29T17:59:42.075054] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-29T17:59:42.075139] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-29T17:59:42.075349] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-29T17:59:42.075389] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-29T17:59:42.075991] [DEBUG] [LOCAL ] CMCM: Trimmed 7046 records to 4789 (keeping 200 days of data) [2025-10-29T17:59:42.106722] [DEBUG] [LOCAL ] CMCM: Primary data saved (4789 records). [2025-10-29T17:59:42.106898] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-29T17:59:42.107014] [INFO ] [MAIN ] Update Progress: 476/2367 symbols completed. CMCM took 34.0s. Estimated remaining: 3h 57m 1s. Rate: 8.0 symbols/min [2025-10-29T17:59:42.285070] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:42.321528] [DEBUG] [LOCAL ] CMP: Loaded 35190 existing records from primary storage. [2025-10-29T17:59:42.321970] [INFO ] [MAIN ] CMP: Loaded 35190 existing records. [2025-10-29T17:59:42.503615] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:59:42.503865] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-29T17:59:42.503911] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-29T17:59:42.504244] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-29T17:59:42.504300] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-29T17:59:42.798845] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-29T17:59:42.867558] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:59:43.601359] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-29T17:59:43.608714] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-29T17:59:43.622378] [INFO ] [REMOTE ] CMC: Full fetch complete (67211 records). [2025-10-29T17:59:43.622521] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-29T17:59:44.160086] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-29T17:59:44.160257] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-29T17:59:44.161198] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-29T17:59:44.161309] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-29T17:59:44.163077] [DEBUG] [LOCAL ] CMC: Trimmed 67211 records to 45470 (keeping 200 days of data) [2025-10-29T17:59:44.297297] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T17:59:44.415850] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-29T17:59:44.485082] [DEBUG] [LOCAL ] CMC: Primary data saved (45470 records). [2025-10-29T17:59:44.485215] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-29T17:59:44.485286] [INFO ] [MAIN ] Update Progress: 477/2367 symbols completed. CMC took 44.3s. Estimated remaining: 3h 56m 33s. Rate: 8.0 symbols/min [2025-10-29T17:59:45.193593] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-29T17:59:45.506745] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-29T17:59:45.545190] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T17:59:45.993573] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-29T17:59:46.267514] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-29T17:59:46.524957] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T17:59:46.536583] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-29T17:59:46.536794] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-29T17:59:46.798725] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-29T17:59:46.983839] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-29T17:59:46.983925] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-29T17:59:46.984786] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-29T17:59:46.984854] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-29T17:59:46.986563] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 53723 (keeping 200 days of data) [2025-10-29T17:59:47.300855] [DEBUG] [LOCAL ] CMG: Primary data saved (53723 records). [2025-10-29T17:59:47.300991] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-29T17:59:47.301069] [INFO ] [MAIN ] Update Progress: 478/2367 symbols completed. CMG took 31.5s. Estimated remaining: 3h 56m 7s. Rate: 8.0 symbols/min [2025-10-29T17:59:47.593596] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-29T17:59:47.913475] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T17:59:48.393624] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-29T17:59:48.759463] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T17:59:49.193610] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-29T17:59:49.322005] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-29T17:59:49.993742] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-29T17:59:50.529015] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T17:59:50.538155] [INFO ] [REMOTE ] CMI: Full fetch complete (61227 records). [2025-10-29T17:59:50.538308] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-29T17:59:50.918716] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-29T17:59:50.918853] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-29T17:59:50.919676] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-29T17:59:50.919749] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-29T17:59:50.921244] [DEBUG] [LOCAL ] CMI: Trimmed 61227 records to 41335 (keeping 200 days of data) [2025-10-29T17:59:51.048407] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-29T17:59:51.070187] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-29T17:59:51.206336] [DEBUG] [LOCAL ] CMI: Primary data saved (41335 records). [2025-10-29T17:59:51.206460] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-29T17:59:51.206532] [INFO ] [MAIN ] Update Progress: 479/2367 symbols completed. CMI took 24.8s. Estimated remaining: 3h 55m 45s. Rate: 8.0 symbols/min [2025-10-29T17:59:52.249501] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T17:59:52.258817] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-29T17:59:53.313632] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T17:59:53.325330] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-29T17:59:54.195986] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T17:59:54.207034] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-29T17:59:55.138524] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T17:59:55.146438] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-29T17:59:55.909440] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-29T17:59:55.915718] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-29T17:59:56.928186] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T17:59:56.934619] [INFO ] [REMOTE ] CMP: Full fetch complete (51320 records). [2025-10-29T17:59:56.934760] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-29T17:59:57.336041] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-29T17:59:57.336140] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-29T17:59:57.336803] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-29T17:59:57.336868] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-29T17:59:57.337969] [DEBUG] [LOCAL ] CMP: Trimmed 51320 records to 35109 (keeping 200 days of data) [2025-10-29T17:59:57.538899] [DEBUG] [LOCAL ] CMP: Primary data saved (35109 records). [2025-10-29T17:59:57.539038] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-29T17:59:57.539119] [INFO ] [MAIN ] Update Progress: 480/2367 symbols completed. CMP took 15.4s. Estimated remaining: 3h 55m 33s. Rate: 8.0 symbols/min [2025-10-29T17:59:58.119335] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:58.166882] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-10-29T17:59:58.211491] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-10-29T17:59:58.255928] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:58.270905] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:58.271220] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-29T17:59:58.294042] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T17:59:58.294738] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-29T17:59:58.295529] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-29T17:59:58.298730] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-29T17:59:58.302323] [DEBUG] [LOCAL ] CMSA: Loaded 3430 existing records from primary storage. [2025-10-29T17:59:58.308216] [INFO ] [MAIN ] CMSA: Loaded 3430 existing records. [2025-10-29T17:59:58.764287] [DEBUG] [LOCAL ] CMRE: Loaded 35169 existing records from primary storage. [2025-10-29T17:59:58.810055] [DEBUG] [LOCAL ] CMPO: Loaded 37862 existing records from primary storage. [2025-10-29T17:59:58.817237] [INFO ] [MAIN ] CMPO: Loaded 37862 existing records. [2025-10-29T17:59:58.848974] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:59:58.856718] [INFO ] [MAIN ] CMRE: Loaded 35169 existing records. [2025-10-29T17:59:58.856599] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-29T17:59:58.856914] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-29T17:59:58.992336] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-29T17:59:59.121900] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-29T17:59:59.164569] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T17:59:59.223700] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-29T17:59:59.389125] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:59:59.420049] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-29T17:59:59.438685] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-29T17:59:59.457612] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T17:59:59.502069] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-29T17:59:59.495790] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-29T17:59:59.502343] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-29T17:59:59.502451] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-29T17:59:59.513502] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-29T17:59:59.513725] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-29T18:00:00.316836] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:00.322496] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-29T18:00:00.549447] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:00.554359] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:00.555257] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-29T18:00:00.554967] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-29T18:00:00.896157] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-29T18:00:00.907555] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-29T18:00:00.982672] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-29T18:00:00.984095] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-29T18:00:01.310807] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-29T18:00:01.312370] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-29T18:00:01.679511] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-29T18:00:01.681541] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T18:00:01.684045] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-29T18:00:01.993613] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-29T18:00:02.041404] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-29T18:00:02.065004] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-29T18:00:02.232904] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T18:00:02.793568] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-29T18:00:02.927127] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-29T18:00:03.593565] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-29T18:00:04.360690] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-29T18:00:04.393575] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-29T18:00:04.588045] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T18:00:05.193565] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-29T18:00:05.783070] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T18:00:05.993575] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-29T18:00:06.247291] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-29T18:00:06.793573] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-29T18:00:07.165764] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-29T18:00:07.190386] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T18:00:07.593611] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-29T18:00:08.393588] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-29T18:00:08.961779] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T18:00:09.193606] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-29T18:00:09.726366] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T18:00:09.993563] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-29T18:00:10.152053] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-29T18:00:10.337323] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-29T18:00:10.793584] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-29T18:00:11.228618] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-29T18:00:11.593558] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-29T18:00:12.393615] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-29T18:00:13.189752] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-29T18:00:13.199285] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-29T18:00:13.516248] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T18:00:13.993556] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-29T18:00:14.318990] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T18:00:14.793557] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-29T18:00:15.308522] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T18:00:15.593555] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-29T18:00:15.767883] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-29T18:00:16.393587] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-29T18:00:17.193601] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-29T18:00:17.327634] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-29T18:00:17.815164] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-29T18:00:17.993570] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-29T18:00:18.378379] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T18:00:18.793556] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-29T18:00:19.033354] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T18:00:19.593566] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-29T18:00:20.003474] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T18:00:20.393584] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-29T18:00:20.599396] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T18:00:20.695405] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T18:00:21.193602] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-29T18:00:21.993562] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-29T18:00:22.615672] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T18:00:22.617589] [INFO ] [REMOTE ] CMSA: Full fetch complete (4738 records). [2025-10-29T18:00:22.618009] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-29T18:00:22.618619] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:00:22.618884] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:00:22.619019] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:00:22.619112] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-29T18:00:22.619195] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-29T18:00:22.619251] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-10-29T18:00:22.619421] [DEBUG] [LOCAL ] CMSA: Deleted derivative data file. [2025-10-29T18:00:22.619513] [INFO ] [MAIN ] Update Progress: 481/2367 symbols completed. CMSA took 25.0s. Estimated remaining: 3h 56m 35s. Rate: 8.0 symbols/min [2025-10-29T18:00:22.806808] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:00:22.801010] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-29T18:00:22.808172] [DEBUG] [LOCAL ] CMSC: No existing data file found in primary storage. [2025-10-29T18:00:22.808358] [WARN ] [MAIN ] CMSC: No existing data found, performing full refresh instead. [2025-10-29T18:00:22.808546] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-29T18:00:22.808625] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-29T18:00:22.808736] [DEBUG] [LOCAL ] CMSC: No primary data file found to delete. [2025-10-29T18:00:22.808922] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-29T18:00:22.939835] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-29T18:00:22.982388] [INFO ] [REMOTE ] CMS: Full fetch complete (75883 records). [2025-10-29T18:00:22.997929] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-29T18:00:23.032454] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:00:23.058321] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:00:23.097065] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:00:23.123759] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-29T18:00:23.157983] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-29T18:00:23.158179] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-29T18:00:23.158254] [DEBUG] [LOCAL ] CMS: No derivative data file found to delete. [2025-10-29T18:00:23.158390] [INFO ] [MAIN ] Update Progress: 482/2367 symbols completed. CMS took 25.6s. Estimated remaining: 3h 55m 60s. Rate: 8.0 symbols/min [2025-10-29T18:00:23.347908] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:23.417717] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:00:23.427755] [DEBUG] [LOCAL ] CMSD: Loaded 7410 existing records from primary storage. [2025-10-29T18:00:23.427988] [INFO ] [MAIN ] CMSD: Loaded 7410 existing records. [2025-10-29T18:00:23.600507] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-29T18:00:23.606095] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:00:23.606332] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-29T18:00:23.606403] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-29T18:00:23.607237] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-29T18:00:23.607299] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-29T18:00:23.977270] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:24.012583] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T18:00:24.393588] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-29T18:00:24.865305] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T18:00:25.193627] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-29T18:00:25.488214] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T18:00:25.682081] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-29T18:00:25.993550] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-29T18:00:26.793590] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-29T18:00:27.146283] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T18:00:27.154036] [INFO ] [REMOTE ] CMRE: Full fetch complete (50939 records). [2025-10-29T18:00:27.154202] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-29T18:00:27.154846] [FATAL] [VALIDATOR ] CMRE: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:00:27.154928] [FATAL] [MAIN ] CMRE: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:00:27.154970] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:00:27.155021] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-29T18:00:27.155122] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-29T18:00:27.155187] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-10-29T18:00:27.155432] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-10-29T18:00:27.155538] [INFO ] [MAIN ] Update Progress: 483/2367 symbols completed. CMRE took 29.6s. Estimated remaining: 3h 55m 39s. Rate: 8.0 symbols/min [2025-10-29T18:00:27.322386] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:00:27.322544] [DEBUG] [LOCAL ] CMTG: No existing data file found in primary storage. [2025-10-29T18:00:27.322580] [WARN ] [MAIN ] CMTG: No existing data found, performing full refresh instead. [2025-10-29T18:00:27.322713] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-29T18:00:27.322761] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-29T18:00:27.322801] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-29T18:00:27.322833] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-29T18:00:27.598812] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-29T18:00:27.699964] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:27.727136] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T18:00:27.938758] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-29T18:00:28.393611] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-29T18:00:29.193548] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-29T18:00:29.415480] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-29T18:00:29.560433] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T18:00:29.993560] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-29T18:00:30.793558] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-29T18:00:30.964220] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T18:00:31.593560] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-29T18:00:31.952229] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T18:00:31.959031] [INFO ] [REMOTE ] CMPO: Full fetch complete (57493 records). [2025-10-29T18:00:31.959152] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-29T18:00:31.959927] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:00:31.960037] [FATAL] [MAIN ] CMPO: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:00:31.960104] [WARN ] [MAIN ] CMPO: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:00:31.960175] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-29T18:00:31.960234] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-10-29T18:00:31.960270] [INFO ] [LOCAL ] CMPO: Starting deletion of derivative data. [2025-10-29T18:00:31.960403] [DEBUG] [LOCAL ] CMPO: Deleted derivative data file. [2025-10-29T18:00:31.960488] [INFO ] [MAIN ] Update Progress: 484/2367 symbols completed. CMPO took 34.4s. Estimated remaining: 3h 55m 21s. Rate: 8.0 symbols/min [2025-10-29T18:00:32.136895] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T18:00:32.139786] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:00:32.139969] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-29T18:00:32.142126] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-29T18:00:32.142884] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-29T18:00:32.142930] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-29T18:00:32.142973] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-29T18:00:32.143006] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-29T18:00:32.398866] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-29T18:00:32.509721] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:32.932509] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T18:00:33.193551] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-29T18:00:33.993594] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-29T18:00:34.203529] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T18:00:34.313694] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-29T18:00:34.793574] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-29T18:00:35.271055] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-29T18:00:35.593576] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-29T18:00:36.393529] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-29T18:00:36.539599] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T18:00:36.940940] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-29T18:00:37.193563] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-29T18:00:37.740059] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-29T18:00:37.993570] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-29T18:00:38.442561] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-29T18:00:38.793563] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-29T18:00:39.174143] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T18:00:39.593554] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-29T18:00:40.120780] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-29T18:00:40.393555] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-29T18:00:40.809674] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-29T18:00:41.193570] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-29T18:00:41.662983] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T18:00:41.993590] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-29T18:00:42.793502] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-29T18:00:42.996761] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-29T18:00:43.204631] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T18:00:43.593593] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-29T18:00:44.393599] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-29T18:00:44.608553] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T18:00:45.069972] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-29T18:00:45.193589] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-29T18:00:45.993566] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-29T18:00:46.266700] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T18:00:46.417616] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-29T18:00:46.793554] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-29T18:00:47.219918] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T18:00:47.222164] [INFO ] [REMOTE ] CMSD: Full fetch complete (11283 records). [2025-10-29T18:00:47.222247] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-29T18:00:47.593211] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-29T18:00:47.593279] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-29T18:00:47.593562] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-29T18:00:47.593616] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-29T18:00:47.593855] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-29T18:00:47.595064] [DEBUG] [LOCAL ] CMSD: Trimmed 11283 records to 7330 (keeping 200 days of data) [2025-10-29T18:00:47.640861] [DEBUG] [LOCAL ] CMSD: Primary data saved (7330 records). [2025-10-29T18:00:47.640974] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-29T18:00:47.641047] [INFO ] [MAIN ] Update Progress: 485/2367 symbols completed. CMSD took 24.5s. Estimated remaining: 3h 55m 45s. Rate: 8.0 symbols/min [2025-10-29T18:00:47.816252] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:00:47.816447] [DEBUG] [LOCAL ] CNA: No existing data file found in primary storage. [2025-10-29T18:00:47.816493] [WARN ] [MAIN ] CNA: No existing data found, performing full refresh instead. [2025-10-29T18:00:47.816605] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-29T18:00:47.816669] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-29T18:00:47.816737] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-29T18:00:47.816776] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-29T18:00:48.113368] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T18:00:48.194487] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:48.393582] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-29T18:00:49.193523] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-29T18:00:49.366342] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-29T18:00:49.590351] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-29T18:00:49.993613] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-29T18:00:50.362424] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-29T18:00:50.793602] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-29T18:00:51.593538] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-29T18:00:51.641616] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-29T18:00:52.228128] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T18:00:52.229470] [INFO ] [REMOTE ] CMSC: Full fetch complete (6835 records). [2025-10-29T18:00:52.229541] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-29T18:00:52.403008] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-29T18:00:52.636776] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-29T18:00:52.636862] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-29T18:00:52.637086] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-29T18:00:52.637126] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-29T18:00:52.637616] [DEBUG] [LOCAL ] CMSC: Trimmed 6835 records to 4555 (keeping 200 days of data) [2025-10-29T18:00:52.666595] [DEBUG] [LOCAL ] CMSC: Primary data saved (4555 records). [2025-10-29T18:00:52.666765] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-29T18:00:52.666860] [INFO ] [MAIN ] Update Progress: 486/2367 symbols completed. CMSC took 30.0s. Estimated remaining: 3h 55m 28s. Rate: 8.0 symbols/min [2025-10-29T18:00:52.840710] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:00:52.860613] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-29T18:00:52.899135] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-29T18:00:52.899471] [INFO ] [MAIN ] CNC: Loaded 53779 existing records. [2025-10-29T18:00:53.076928] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:00:53.077203] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-29T18:00:53.077259] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-29T18:00:53.077839] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-29T18:00:53.077900] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-29T18:00:53.196549] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-29T18:00:53.452186] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:00:53.600171] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T18:00:53.993583] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-29T18:00:54.805075] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-29T18:00:54.807897] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T18:00:55.576529] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T18:00:55.593517] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-29T18:00:55.996564] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-29T18:00:56.393572] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-29T18:00:56.780333] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T18:00:57.193553] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-29T18:00:57.993559] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-29T18:00:58.108861] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T18:00:58.793585] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-29T18:00:59.020793] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T18:00:59.593572] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-29T18:01:00.263021] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T18:01:00.392743] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T18:01:00.399522] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-29T18:01:01.193579] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-29T18:01:01.995315] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-29T18:01:01.996410] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T18:01:02.000378] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-29T18:01:02.012532] [INFO ] [REMOTE ] CMU: Full fetch complete (9445 records). [2025-10-29T18:01:02.014063] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-29T18:01:02.437355] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-29T18:01:02.437435] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-29T18:01:02.437724] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-29T18:01:02.437787] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-29T18:01:02.438224] [DEBUG] [LOCAL ] CMU: Trimmed 9445 records to 5801 (keeping 200 days of data) [2025-10-29T18:01:02.471887] [DEBUG] [LOCAL ] CMU: Primary data saved (5801 records). [2025-10-29T18:01:02.472017] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-29T18:01:02.472087] [INFO ] [MAIN ] Update Progress: 487/2367 symbols completed. CMU took 30.5s. Estimated remaining: 3h 55m 29s. Rate: 8.0 symbols/min [2025-10-29T18:01:02.651789] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:02.669872] [DEBUG] [LOCAL ] CNF: Loaded 10607 existing records from primary storage. [2025-10-29T18:01:02.670208] [INFO ] [MAIN ] CNF: Loaded 10607 existing records. [2025-10-29T18:01:02.798820] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-29T18:01:02.881715] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:01:02.882022] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-29T18:01:02.882075] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-29T18:01:02.882318] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-29T18:01:02.882381] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-29T18:01:03.260120] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T18:01:03.309638] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:01:03.593540] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-29T18:01:03.710058] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-29T18:01:04.393636] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-29T18:01:04.535222] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-29T18:01:04.939819] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-29T18:01:05.193572] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-29T18:01:05.993556] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-29T18:01:06.154095] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-29T18:01:06.284579] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-29T18:01:06.793724] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-29T18:01:07.290360] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-29T18:01:07.593564] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-29T18:01:07.965194] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-29T18:01:08.393580] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-29T18:01:09.193599] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-29T18:01:09.345400] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T18:01:09.353146] [INFO ] [REMOTE ] CMTG: Full fetch complete (52427 records). [2025-10-29T18:01:09.353332] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-29T18:01:09.805007] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-29T18:01:09.848493] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-29T18:01:09.848580] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-29T18:01:09.849279] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-29T18:01:09.849344] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-29T18:01:09.850553] [DEBUG] [LOCAL ] CMTG: Trimmed 52427 records to 34264 (keeping 200 days of data) [2025-10-29T18:01:09.995563] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-29T18:01:10.038137] [DEBUG] [LOCAL ] CMTG: Primary data saved (34264 records). [2025-10-29T18:01:10.038275] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-29T18:01:10.038344] [INFO ] [MAIN ] Update Progress: 488/2367 symbols completed. CMTG took 42.9s. Estimated remaining: 3h 55m 22s. Rate: 8.0 symbols/min [2025-10-29T18:01:10.210109] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:10.261194] [DEBUG] [LOCAL ] CNH: Loaded 53539 existing records from primary storage. [2025-10-29T18:01:10.261510] [INFO ] [MAIN ] CNH: Loaded 53539 existing records. [2025-10-29T18:01:10.436263] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:01:10.436502] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-29T18:01:10.436548] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-29T18:01:10.437035] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-29T18:01:10.437096] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-29T18:01:10.793105] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:01:10.793517] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-29T18:01:11.173226] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T18:01:11.593635] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-29T18:01:12.169275] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T18:01:12.393618] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-29T18:01:13.070491] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T18:01:13.193599] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-29T18:01:13.473318] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T18:01:13.993577] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-29T18:01:14.358418] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T18:01:14.793561] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-29T18:01:15.017130] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-29T18:01:15.593591] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-29T18:01:16.098261] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T18:01:16.393587] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-29T18:01:17.032481] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T18:01:17.193596] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-29T18:01:17.561331] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-29T18:01:17.568319] [INFO ] [REMOTE ] CNA: Full fetch complete (46323 records). [2025-10-29T18:01:17.568477] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-29T18:01:17.964754] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-29T18:01:17.964872] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-29T18:01:17.965913] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-29T18:01:17.965985] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-29T18:01:17.967297] [DEBUG] [LOCAL ] CNA: Trimmed 46323 records to 32306 (keeping 200 days of data) [2025-10-29T18:01:18.022739] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-29T18:01:18.183087] [DEBUG] [LOCAL ] CNA: Primary data saved (32306 records). [2025-10-29T18:01:18.183287] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-29T18:01:18.183380] [INFO ] [MAIN ] Update Progress: 489/2367 symbols completed. CNA took 30.5s. Estimated remaining: 3h 55m 17s. Rate: 8.0 symbols/min [2025-10-29T18:01:18.372679] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:18.427069] [DEBUG] [LOCAL ] CNI: Loaded 51538 existing records from primary storage. [2025-10-29T18:01:18.427585] [INFO ] [MAIN ] CNI: Loaded 51538 existing records. [2025-10-29T18:01:18.638103] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:01:18.638547] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-29T18:01:18.638638] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-29T18:01:18.639491] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-29T18:01:18.639630] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-29T18:01:18.810765] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-29T18:01:18.986875] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-29T18:01:19.135960] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:01:19.478277] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T18:01:19.593561] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-29T18:01:19.720014] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-29T18:01:20.393563] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-29T18:01:20.956354] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-29T18:01:21.038915] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-29T18:01:21.193573] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-29T18:01:21.993621] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-29T18:01:22.799208] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-29T18:01:22.805133] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-29T18:01:23.150366] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T18:01:23.593589] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-29T18:01:24.183632] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T18:01:24.239174] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T18:01:24.393588] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-29T18:01:25.193569] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-29T18:01:25.920792] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T18:01:25.993560] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-29T18:01:26.387689] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-29T18:01:26.408254] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-29T18:01:26.410587] [INFO ] [REMOTE ] CNF: Full fetch complete (12887 records). [2025-10-29T18:01:26.410775] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-29T18:01:26.411308] [FATAL] [VALIDATOR ] CNF: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:01:26.411399] [FATAL] [MAIN ] CNF: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:01:26.411685] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:01:26.411761] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-29T18:01:26.411824] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-29T18:01:26.411861] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-29T18:01:26.412010] [DEBUG] [LOCAL ] CNF: Deleted derivative data file. [2025-10-29T18:01:26.412084] [INFO ] [MAIN ] Update Progress: 490/2367 symbols completed. CNF took 23.9s. Estimated remaining: 3h 55m 12s. Rate: 8.0 symbols/min [2025-10-29T18:01:26.581449] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:26.581677] [DEBUG] [LOCAL ] CNK: No existing data file found in primary storage. [2025-10-29T18:01:26.581730] [WARN ] [MAIN ] CNK: No existing data found, performing full refresh instead. [2025-10-29T18:01:26.581844] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-29T18:01:26.581885] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-29T18:01:26.581924] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-29T18:01:26.581953] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-29T18:01:26.798793] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-29T18:01:26.934557] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:01:27.593608] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-29T18:01:28.393532] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-29T18:01:28.745122] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-29T18:01:29.037576] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T18:01:29.193635] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-29T18:01:29.683821] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T18:01:29.993565] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-29T18:01:30.793541] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-29T18:01:30.930388] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T18:01:31.291722] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T18:01:31.593621] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-29T18:01:32.063097] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T18:01:32.393611] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-29T18:01:32.897996] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T18:01:33.098582] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-29T18:01:33.109956] [INFO ] [REMOTE ] CNC: Full fetch complete (77866 records). [2025-10-29T18:01:33.110076] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-29T18:01:33.198860] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-29T18:01:33.512574] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-29T18:01:33.512697] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-29T18:01:33.513601] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-29T18:01:33.513672] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-29T18:01:33.515739] [DEBUG] [LOCAL ] CNC: Trimmed 77866 records to 53780 (keeping 200 days of data) [2025-10-29T18:01:33.895026] [DEBUG] [LOCAL ] CNC: Primary data saved (53780 records). [2025-10-29T18:01:33.895204] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-29T18:01:33.895307] [INFO ] [MAIN ] Update Progress: 491/2367 symbols completed. CNC took 41.2s. Estimated remaining: 3h 55m 4s. Rate: 8.0 symbols/min [2025-10-29T18:01:34.003580] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-29T18:01:34.181429] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:34.181681] [DEBUG] [LOCAL ] CNM: No existing data file found in primary storage. [2025-10-29T18:01:34.181757] [WARN ] [MAIN ] CNM: No existing data found, performing full refresh instead. [2025-10-29T18:01:34.181884] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-29T18:01:34.181935] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-29T18:01:34.181983] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-29T18:01:34.182019] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-29T18:01:34.658743] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:01:34.785404] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-29T18:01:34.796296] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-29T18:01:35.439921] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:01:35.593594] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-29T18:01:35.689070] [DEBUG] [REMOTE ] CNI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-29T18:01:35.689415] [WARN ] [REMOTE ] CNI: No data returned for month 2025-05 [2025-10-29T18:01:35.689523] [FATAL] [REMOTE ] CNI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:01:35.689615] [FATAL] [MAIN ] CNI: Failed to fetch primary data. [2025-10-29T18:01:35.689711] [WARN ] [MAIN ] CNI: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:01:35.689794] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-29T18:01:35.689888] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-29T18:01:35.689980] [INFO ] [LOCAL ] CNI: Starting deletion of derivative data. [2025-10-29T18:01:35.690177] [DEBUG] [LOCAL ] CNI: Deleted derivative data file. [2025-10-29T18:01:35.690274] [INFO ] [MAIN ] Update Progress: 492/2367 symbols completed. CNI took 17.5s. Estimated remaining: 3h 54m 35s. Rate: 8.0 symbols/min [2025-10-29T18:01:35.888914] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:35.889114] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-29T18:01:35.889152] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-29T18:01:35.889267] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-29T18:01:35.889328] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-29T18:01:35.889401] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-29T18:01:35.889445] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-29T18:01:36.252710] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:01:36.393597] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-29T18:01:36.481888] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-29T18:01:37.193579] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-29T18:01:37.570552] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T18:01:37.993631] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-29T18:01:38.427582] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T18:01:38.793552] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-29T18:01:38.977283] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T18:01:39.593553] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-29T18:01:40.393541] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-29T18:01:40.511413] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-29T18:01:40.867454] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T18:01:41.193550] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-29T18:01:41.587486] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:01:41.993579] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-29T18:01:42.458274] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T18:01:42.793671] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-29T18:01:43.221481] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:01:43.593593] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-29T18:01:43.850985] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T18:01:44.393600] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-29T18:01:44.994818] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T18:01:45.007116] [INFO ] [REMOTE ] CNH: Full fetch complete (77313 records). [2025-10-29T18:01:45.007365] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-29T18:01:45.008830] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:01:45.008955] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:01:45.009026] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:01:45.009106] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-29T18:01:45.009188] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-29T18:01:45.009261] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-29T18:01:45.009489] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-29T18:01:45.010773] [INFO ] [MAIN ] Update Progress: 493/2367 symbols completed. CNH took 35.0s. Estimated remaining: 3h 54m 34s. Rate: 8.0 symbols/min [2025-10-29T18:01:45.203838] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-29T18:01:45.209116] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:45.210608] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-29T18:01:45.210690] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-29T18:01:45.210829] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-29T18:01:45.210875] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-29T18:01:45.210918] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-29T18:01:45.210953] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-29T18:01:45.683413] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:01:45.708713] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:01:45.993716] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-29T18:01:46.619110] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T18:01:46.719305] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-29T18:01:46.793573] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-29T18:01:47.593535] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-29T18:01:47.715943] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-29T18:01:48.393621] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-29T18:01:48.744913] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T18:01:49.193538] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-29T18:01:49.482522] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T18:01:49.993539] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-29T18:01:50.112553] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-29T18:01:50.793586] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-29T18:01:51.362522] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T18:01:51.499227] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T18:01:51.593576] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-29T18:01:52.393585] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-29T18:01:52.585374] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T18:01:53.193719] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-29T18:01:53.549740] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T18:01:53.993588] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-29T18:01:54.492458] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T18:01:54.793615] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-29T18:01:54.915516] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-29T18:01:55.593605] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-29T18:01:56.004684] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T18:01:56.394170] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-29T18:01:56.636858] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T18:01:56.645775] [INFO ] [REMOTE ] CNMD: Full fetch complete (47388 records). [2025-10-29T18:01:56.645931] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-29T18:01:57.036887] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-29T18:01:57.036966] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-29T18:01:57.037616] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-29T18:01:57.037690] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-29T18:01:57.038816] [DEBUG] [LOCAL ] CNMD: Trimmed 47388 records to 31495 (keeping 200 days of data) [2025-10-29T18:01:57.198619] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-29T18:01:57.234067] [DEBUG] [LOCAL ] CNMD: Primary data saved (31495 records). [2025-10-29T18:01:57.234174] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-29T18:01:57.234241] [INFO ] [MAIN ] Update Progress: 494/2367 symbols completed. CNMD took 21.5s. Estimated remaining: 3h 54m 45s. Rate: 8.0 symbols/min [2025-10-29T18:01:57.410273] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:57.446172] [DEBUG] [LOCAL ] CNO: Loaded 39874 existing records from primary storage. [2025-10-29T18:01:57.446444] [INFO ] [MAIN ] CNO: Loaded 39874 existing records. [2025-10-29T18:01:57.656124] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T18:01:57.660427] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:01:57.673888] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-29T18:01:57.673964] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-29T18:01:57.675231] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-29T18:01:57.675297] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-29T18:01:58.019063] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-29T18:01:58.023585] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:01:58.731092] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T18:01:58.743788] [INFO ] [REMOTE ] CNK: Full fetch complete (76369 records). [2025-10-29T18:01:58.744040] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-29T18:01:58.806535] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-29T18:01:59.144888] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-29T18:01:59.145004] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-29T18:01:59.146003] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-29T18:01:59.146084] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-29T18:01:59.147685] [DEBUG] [LOCAL ] CNK: Trimmed 76369 records to 52869 (keeping 200 days of data) [2025-10-29T18:01:59.282201] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T18:01:59.512316] [DEBUG] [LOCAL ] CNK: Primary data saved (52869 records). [2025-10-29T18:01:59.512451] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-29T18:01:59.512522] [INFO ] [MAIN ] Update Progress: 495/2367 symbols completed. CNK took 33.1s. Estimated remaining: 3h 54m 17s. Rate: 8.0 symbols/min [2025-10-29T18:01:59.598699] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-29T18:01:59.694202] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:01:59.745456] [DEBUG] [LOCAL ] CNP: Loaded 53474 existing records from primary storage. [2025-10-29T18:01:59.745818] [INFO ] [MAIN ] CNP: Loaded 53474 existing records. [2025-10-29T18:01:59.958184] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:01:59.958451] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-29T18:01:59.958497] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-29T18:01:59.959010] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-29T18:01:59.959066] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-29T18:02:00.335080] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:02:00.358782] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T18:02:00.393549] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-29T18:02:01.169727] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-29T18:02:01.193532] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-29T18:02:01.652126] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-29T18:02:01.993567] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-29T18:02:02.793521] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-29T18:02:02.943594] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-29T18:02:03.086661] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T18:02:03.593614] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-29T18:02:04.037242] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T18:02:04.393570] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-29T18:02:04.491223] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-29T18:02:05.193602] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-29T18:02:05.613516] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T18:02:05.993571] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-29T18:02:06.032784] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T18:02:06.793553] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-29T18:02:07.031595] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T18:02:07.593619] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-29T18:02:07.879224] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-29T18:02:08.393566] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-29T18:02:08.728962] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T18:02:09.193530] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-29T18:02:09.377316] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T18:02:09.993552] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-29T18:02:10.554816] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T18:02:10.793579] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-29T18:02:11.349761] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T18:02:11.593558] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-29T18:02:11.948047] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T18:02:12.393562] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-29T18:02:13.141234] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-29T18:02:13.152113] [INFO ] [REMOTE ] CNM: Full fetch complete (73695 records). [2025-10-29T18:02:13.152237] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-29T18:02:13.198844] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-29T18:02:13.542483] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-29T18:02:13.542571] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-29T18:02:13.543396] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-29T18:02:13.543458] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-29T18:02:13.544930] [DEBUG] [LOCAL ] CNM: Trimmed 73695 records to 50886 (keeping 200 days of data) [2025-10-29T18:02:13.853904] [DEBUG] [LOCAL ] CNM: Primary data saved (50886 records). [2025-10-29T18:02:13.854026] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-29T18:02:13.854094] [INFO ] [MAIN ] Update Progress: 496/2367 symbols completed. CNM took 40.0s. Estimated remaining: 3h 54m 36s. Rate: 8.0 symbols/min [2025-10-29T18:02:13.997635] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-29T18:02:14.029263] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:02:14.062244] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-29T18:02:14.119811] [DEBUG] [LOCAL ] CNQ: Loaded 53578 existing records from primary storage. [2025-10-29T18:02:14.120118] [INFO ] [MAIN ] CNQ: Loaded 53578 existing records. [2025-10-29T18:02:14.315334] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:02:14.316025] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-29T18:02:14.316134] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-29T18:02:14.316591] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-29T18:02:14.316699] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-29T18:02:14.456313] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T18:02:14.729205] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:02:14.793553] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-29T18:02:15.216200] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T18:02:15.593574] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-29T18:02:16.203975] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T18:02:16.393587] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-29T18:02:16.647362] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T18:02:17.193538] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-29T18:02:17.375425] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T18:02:17.993561] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-29T18:02:18.694860] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T18:02:18.793577] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-29T18:02:19.236420] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T18:02:19.593561] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-29T18:02:20.180995] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T18:02:20.393562] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-29T18:02:20.831477] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:02:21.193625] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-29T18:02:21.284118] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T18:02:21.993621] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-29T18:02:22.601589] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T18:02:22.793574] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-29T18:02:23.035857] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T18:02:23.044181] [INFO ] [REMOTE ] CNO: Full fetch complete (60595 records). [2025-10-29T18:02:23.044324] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-29T18:02:23.451665] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-29T18:02:23.451773] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-29T18:02:23.452520] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-29T18:02:23.452562] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-29T18:02:23.453874] [DEBUG] [LOCAL ] CNO: Trimmed 60595 records to 39787 (keeping 200 days of data) [2025-10-29T18:02:23.628494] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-29T18:02:23.701992] [DEBUG] [LOCAL ] CNO: Primary data saved (39787 records). [2025-10-29T18:02:23.702138] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-29T18:02:23.702214] [INFO ] [MAIN ] Update Progress: 497/2367 symbols completed. CNO took 26.5s. Estimated remaining: 3h 54m 37s. Rate: 8.0 symbols/min [2025-10-29T18:02:23.881793] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:02:23.881979] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-29T18:02:23.882017] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-29T18:02:23.882147] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-29T18:02:23.882187] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-29T18:02:23.882227] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-29T18:02:23.882259] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-29T18:02:24.265597] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:02:24.298695] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-29T18:02:24.393571] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-29T18:02:25.037499] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-29T18:02:25.193548] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-29T18:02:25.947884] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-29T18:02:25.958871] [INFO ] [REMOTE ] CNP: Full fetch complete (77166 records). [2025-10-29T18:02:25.959041] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-29T18:02:25.959897] [FATAL] [VALIDATOR ] CNP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:02:25.959993] [FATAL] [MAIN ] CNP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:02:25.960035] [WARN ] [MAIN ] CNP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:02:25.960072] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-29T18:02:25.960128] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-29T18:02:25.960165] [INFO ] [LOCAL ] CNP: Starting deletion of derivative data. [2025-10-29T18:02:25.960316] [DEBUG] [LOCAL ] CNP: Deleted derivative data file. [2025-10-29T18:02:25.960429] [INFO ] [MAIN ] Update Progress: 498/2367 symbols completed. CNP took 26.4s. Estimated remaining: 3h 54m 9s. Rate: 8.0 symbols/min [2025-10-29T18:02:25.998967] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-29T18:02:26.143633] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:02:26.143834] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-29T18:02:26.143887] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-29T18:02:26.144022] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-29T18:02:26.144067] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-29T18:02:26.144108] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-29T18:02:26.144140] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-29T18:02:26.539659] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:02:26.570466] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T18:02:26.793559] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-29T18:02:27.087159] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T18:02:27.593564] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-29T18:02:28.243495] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-29T18:02:28.393568] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-29T18:02:28.521983] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T18:02:29.193565] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-29T18:02:29.771443] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T18:02:29.993567] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-29T18:02:30.185592] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T18:02:30.192761] [INFO ] [REMOTE ] CNNE: Full fetch complete (50356 records). [2025-10-29T18:02:30.192931] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-29T18:02:30.193613] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:02:30.193739] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:02:30.193787] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:02:30.193853] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-29T18:02:30.194098] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-29T18:02:30.194132] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-29T18:02:30.194170] [DEBUG] [LOCAL ] CNNE: No derivative data file found to delete. [2025-10-29T18:02:30.194225] [INFO ] [MAIN ] Update Progress: 499/2367 symbols completed. CNNE took 45.2s. Estimated remaining: 3h 53m 50s. Rate: 8.0 symbols/min [2025-10-29T18:02:30.375512] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:02:30.425374] [DEBUG] [LOCAL ] CNX: Loaded 51279 existing records from primary storage. [2025-10-29T18:02:30.425739] [INFO ] [MAIN ] CNX: Loaded 51279 existing records. [2025-10-29T18:02:30.626244] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:02:30.626622] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-29T18:02:30.626707] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-29T18:02:30.627952] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-29T18:02:30.628014] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-29T18:02:30.795536] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-29T18:02:31.016518] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-29T18:02:31.085005] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:02:31.593611] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-29T18:02:32.245781] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T18:02:32.326237] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-29T18:02:32.393549] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-29T18:02:33.198691] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-29T18:02:33.209565] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T18:02:33.993574] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-29T18:02:34.526868] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T18:02:34.793590] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-29T18:02:35.077422] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T18:02:35.500607] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T18:02:35.593579] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-29T18:02:36.393534] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-29T18:02:36.859984] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T18:02:37.193552] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-29T18:02:37.726863] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T18:02:37.858977] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T18:02:37.993606] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-29T18:02:38.793632] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-29T18:02:39.441715] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T18:02:39.573382] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T18:02:39.584379] [INFO ] [REMOTE ] CNQ: Full fetch complete (77349 records). [2025-10-29T18:02:39.584515] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-29T18:02:39.585319] [FATAL] [VALIDATOR ] CNQ: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:02:39.585401] [FATAL] [MAIN ] CNQ: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:02:39.585442] [WARN ] [MAIN ] CNQ: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:02:39.585507] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-29T18:02:39.585568] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-29T18:02:39.585603] [INFO ] [LOCAL ] CNQ: Starting deletion of derivative data. [2025-10-29T18:02:39.585776] [DEBUG] [LOCAL ] CNQ: Deleted derivative data file. [2025-10-29T18:02:39.585889] [INFO ] [MAIN ] Update Progress: 500/2367 symbols completed. CNQ took 25.7s. Estimated remaining: 3h 53m 49s. Rate: 8.0 symbols/min [2025-10-29T18:02:39.598713] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-29T18:02:39.757459] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:02:39.757682] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-10-29T18:02:39.757735] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-10-29T18:02:39.757847] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-29T18:02:39.757887] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-29T18:02:39.757927] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-29T18:02:39.757957] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-29T18:02:40.136555] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:02:40.391609] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T18:02:40.396367] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-29T18:02:41.193541] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-29T18:02:41.709700] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T18:02:41.993589] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-29T18:02:42.476286] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T18:02:42.793577] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-29T18:02:42.885747] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:02:43.443276] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-29T18:02:43.593562] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-29T18:02:44.393614] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-29T18:02:44.657133] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T18:02:45.193603] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-29T18:02:45.592405] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T18:02:45.941210] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T18:02:45.993566] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-29T18:02:46.793631] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-29T18:02:46.985343] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T18:02:46.992061] [INFO ] [REMOTE ] CNS: Full fetch complete (31499 records). [2025-10-29T18:02:46.992295] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-29T18:02:46.993100] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:02:46.993193] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:02:46.993236] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:02:46.993276] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-29T18:02:46.993589] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-29T18:02:46.993875] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-29T18:02:46.993933] [DEBUG] [LOCAL ] CNS: No derivative data file found to delete. [2025-10-29T18:02:46.994036] [INFO ] [MAIN ] Update Progress: 501/2367 symbols completed. CNS took 21.0s. Estimated remaining: 3h 53m 41s. Rate: 8.0 symbols/min [2025-10-29T18:02:47.167138] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:02:47.216137] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-29T18:02:47.216459] [INFO ] [MAIN ] COF: Loaded 53625 existing records. [2025-10-29T18:02:47.397226] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:02:47.397466] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-29T18:02:47.397522] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-29T18:02:47.398823] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-29T18:02:47.398884] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-29T18:02:47.598822] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-29T18:02:47.790264] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:02:48.155932] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T18:02:48.318560] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T18:02:48.393596] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-29T18:02:49.193625] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-29T18:02:49.214247] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T18:02:49.993573] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-29T18:02:50.410782] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T18:02:50.793619] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-29T18:02:51.341887] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-29T18:02:51.593542] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-29T18:02:51.912053] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T18:02:52.393637] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-29T18:02:52.846624] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T18:02:53.193593] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-29T18:02:53.384558] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-29T18:02:53.993622] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-29T18:02:54.534769] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T18:02:54.793582] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-29T18:02:55.272585] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-29T18:02:55.593631] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-29T18:02:55.997560] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T18:02:56.393619] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-29T18:02:56.895612] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T18:02:57.193552] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-29T18:02:57.571903] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T18:02:57.993608] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-29T18:02:58.234044] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T18:02:58.793599] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-29T18:02:59.126296] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T18:02:59.593621] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-29T18:03:00.184595] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-29T18:03:00.393558] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-29T18:03:00.851805] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T18:03:01.193561] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-29T18:03:01.866553] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T18:03:01.993567] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-29T18:03:02.373107] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T18:03:02.793591] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-29T18:03:03.076588] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T18:03:03.593604] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-29T18:03:04.374880] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-29T18:03:04.393529] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-29T18:03:04.920760] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T18:03:04.930437] [INFO ] [REMOTE ] CNR: Full fetch complete (64336 records). [2025-10-29T18:03:04.930594] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-29T18:03:05.158006] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-29T18:03:05.159055] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:03:05.159153] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:03:05.159248] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-29T18:03:05.159337] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-29T18:03:05.159425] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-29T18:03:05.159495] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-29T18:03:05.159607] [INFO ] [MAIN ] Update Progress: 502/2367 symbols completed. CNR took 41.5s. Estimated remaining: 3h 54m 13s. Rate: 8.0 symbols/min [2025-10-29T18:03:05.198779] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-29T18:03:05.375101] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:03:05.430891] [DEBUG] [LOCAL ] COHR: Loaded 53375 existing records from primary storage. [2025-10-29T18:03:05.431287] [INFO ] [MAIN ] COHR: Loaded 53375 existing records. [2025-10-29T18:03:05.637114] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:03:05.637343] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-29T18:03:05.637402] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-29T18:03:05.638112] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-29T18:03:05.638195] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-29T18:03:05.998128] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-29T18:03:06.069381] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:03:06.138016] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-29T18:03:06.759317] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T18:03:06.770078] [INFO ] [REMOTE ] CODI: Full fetch complete (54258 records). [2025-10-29T18:03:06.770218] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-29T18:03:06.770894] [FATAL] [VALIDATOR ] CODI: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:03:06.770984] [FATAL] [MAIN ] CODI: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:03:06.771027] [WARN ] [MAIN ] CODI: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:03:06.771067] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-29T18:03:06.771122] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-29T18:03:06.771156] [INFO ] [LOCAL ] CODI: Starting deletion of derivative data. [2025-10-29T18:03:06.771196] [DEBUG] [LOCAL ] CODI: No derivative data file found to delete. [2025-10-29T18:03:06.771251] [INFO ] [MAIN ] Update Progress: 503/2367 symbols completed. CODI took 27.2s. Estimated remaining: 3h 53m 44s. Rate: 8.0 symbols/min [2025-10-29T18:03:06.798682] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-29T18:03:06.970399] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:03:06.970569] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-10-29T18:03:06.970608] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-10-29T18:03:06.970741] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-29T18:03:06.970790] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-29T18:03:06.970873] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-29T18:03:06.970925] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-29T18:03:07.356439] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:03:07.422630] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T18:03:07.593528] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-29T18:03:08.393610] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-29T18:03:08.738684] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-29T18:03:09.182082] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T18:03:09.193237] [INFO ] [REMOTE ] CNX: Full fetch complete (74883 records). [2025-10-29T18:03:09.193383] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-29T18:03:09.205464] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-29T18:03:09.608633] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-29T18:03:09.608773] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-29T18:03:09.609611] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-29T18:03:09.609715] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-29T18:03:09.635603] [DEBUG] [LOCAL ] CNX: Trimmed 74883 records to 51277 (keeping 200 days of data) [2025-10-29T18:03:09.636595] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T18:03:09.956086] [DEBUG] [LOCAL ] CNX: Primary data saved (51277 records). [2025-10-29T18:03:09.956216] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-29T18:03:09.957047] [INFO ] [MAIN ] Update Progress: 504/2367 symbols completed. CNX took 39.8s. Estimated remaining: 3h 53m 20s. Rate: 8.0 symbols/min [2025-10-29T18:03:09.998737] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-29T18:03:10.140952] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:03:10.192226] [DEBUG] [LOCAL ] COMP: Loaded 53398 existing records from primary storage. [2025-10-29T18:03:10.192520] [INFO ] [MAIN ] COMP: Loaded 53398 existing records. [2025-10-29T18:03:10.366177] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:03:10.366409] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-29T18:03:10.366456] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-29T18:03:10.367001] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-29T18:03:10.367058] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-29T18:03:10.728315] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:03:10.793509] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-29T18:03:10.868577] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-29T18:03:11.308161] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T18:03:11.593610] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-29T18:03:12.099441] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T18:03:12.393570] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-29T18:03:13.100284] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T18:03:13.193576] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-29T18:03:13.853511] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-29T18:03:13.993527] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-29T18:03:14.559142] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-29T18:03:14.793567] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-29T18:03:15.555003] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-29T18:03:15.593545] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-29T18:03:16.165310] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-29T18:03:16.393633] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-29T18:03:17.005633] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-29T18:03:17.193557] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-29T18:03:17.581475] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T18:03:17.993622] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-29T18:03:18.793607] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-29T18:03:19.124937] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-29T18:03:19.357341] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T18:03:19.593565] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-29T18:03:20.064551] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T18:03:20.160786] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-29T18:03:20.172164] [INFO ] [REMOTE ] COF: Full fetch complete (77719 records). [2025-10-29T18:03:20.172321] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-29T18:03:20.398744] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-29T18:03:20.618310] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-29T18:03:20.618396] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-29T18:03:20.619304] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-29T18:03:20.619370] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-29T18:03:20.620847] [DEBUG] [LOCAL ] COF: Trimmed 77719 records to 53625 (keeping 200 days of data) [2025-10-29T18:03:20.953584] [DEBUG] [LOCAL ] COF: Primary data saved (53625 records). [2025-10-29T18:03:20.953736] [INFO ] [MAIN ] COF: Full history saved. [2025-10-29T18:03:20.954720] [INFO ] [MAIN ] Update Progress: 505/2367 symbols completed. COF took 34.0s. Estimated remaining: 3h 53m 26s. Rate: 8.0 symbols/min [2025-10-29T18:03:21.139839] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:03:21.140025] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-29T18:03:21.140063] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-29T18:03:21.140175] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-29T18:03:21.140217] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-29T18:03:21.140258] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-29T18:03:21.140291] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-29T18:03:21.200299] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-29T18:03:21.549396] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:03:22.004022] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-29T18:03:22.029948] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-29T18:03:22.498397] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T18:03:22.793588] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-29T18:03:23.274452] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T18:03:23.593573] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-29T18:03:24.105400] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T18:03:24.393681] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-29T18:03:25.043367] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-29T18:03:25.193590] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-29T18:03:25.536552] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T18:03:25.993704] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-29T18:03:26.743465] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T18:03:26.793536] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-29T18:03:27.491280] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-29T18:03:27.593578] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-29T18:03:28.335349] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-29T18:03:28.393550] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-29T18:03:28.790711] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T18:03:29.193546] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-29T18:03:29.993553] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-29T18:03:30.279471] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-29T18:03:30.291934] [INFO ] [REMOTE ] COHR: Full fetch complete (77471 records). [2025-10-29T18:03:30.292134] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-29T18:03:30.775008] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-29T18:03:30.805996] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-29T18:03:30.904465] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T18:03:31.019233] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-29T18:03:31.019325] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-29T18:03:31.020320] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-29T18:03:31.020416] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-29T18:03:31.022173] [DEBUG] [LOCAL ] COHR: Trimmed 77471 records to 53371 (keeping 200 days of data) [2025-10-29T18:03:31.403284] [DEBUG] [LOCAL ] COHR: Primary data saved (53371 records). [2025-10-29T18:03:31.403437] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-29T18:03:31.403522] [INFO ] [MAIN ] Update Progress: 506/2367 symbols completed. COHR took 26.2s. Estimated remaining: 3h 53m 29s. Rate: 8.0 symbols/min [2025-10-29T18:03:31.598895] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:03:31.597093] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-29T18:03:31.632164] [DEBUG] [LOCAL ] COOK: Loaded 24632 existing records from primary storage. [2025-10-29T18:03:31.632505] [INFO ] [MAIN ] COOK: Loaded 24632 existing records. [2025-10-29T18:03:31.829447] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:03:31.829686] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-29T18:03:31.829745] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-29T18:03:31.830020] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-29T18:03:31.830104] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-29T18:03:32.208894] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:03:32.239246] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-29T18:03:32.393555] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-29T18:03:33.123818] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T18:03:33.164191] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T18:03:33.193515] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-29T18:03:33.699262] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T18:03:33.993549] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-29T18:03:34.793753] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-29T18:03:35.430468] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:03:35.593583] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-29T18:03:36.068043] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T18:03:36.393536] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-29T18:03:36.849792] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T18:03:37.193599] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-29T18:03:37.596805] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T18:03:37.993555] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-29T18:03:38.698019] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T18:03:38.709302] [INFO ] [REMOTE ] COLD: Full fetch complete (75069 records). [2025-10-29T18:03:38.709469] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-29T18:03:38.798755] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-29T18:03:38.887850] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T18:03:39.153145] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-29T18:03:39.153269] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-29T18:03:39.154148] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-29T18:03:39.154218] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-29T18:03:39.155766] [DEBUG] [LOCAL ] COLD: Trimmed 75069 records to 52504 (keeping 200 days of data) [2025-10-29T18:03:39.471785] [DEBUG] [LOCAL ] COLD: Primary data saved (52504 records). [2025-10-29T18:03:39.471926] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-29T18:03:39.471998] [INFO ] [MAIN ] Update Progress: 507/2367 symbols completed. COLD took 32.7s. Estimated remaining: 3h 53m 23s. Rate: 8.0 symbols/min [2025-10-29T18:03:39.598727] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-29T18:03:39.642740] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:03:39.642942] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-10-29T18:03:39.642984] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-10-29T18:03:39.643095] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-29T18:03:39.643137] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-29T18:03:39.643179] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-29T18:03:39.643211] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-29T18:03:40.039743] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:03:40.062273] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T18:03:40.393580] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-29T18:03:41.193556] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-29T18:03:41.399861] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-29T18:03:41.817794] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-29T18:03:41.998727] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-29T18:03:42.013358] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T18:03:42.793561] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-29T18:03:43.558094] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T18:03:43.569034] [INFO ] [REMOTE ] COMP: Full fetch complete (77028 records). [2025-10-29T18:03:43.569202] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-29T18:03:43.570006] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:03:43.570096] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:03:43.570138] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:03:43.570214] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-29T18:03:43.570313] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-29T18:03:43.570363] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-10-29T18:03:43.570513] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-10-29T18:03:43.571267] [INFO ] [MAIN ] Update Progress: 508/2367 symbols completed. COMP took 33.6s. Estimated remaining: 3h 53m 3s. Rate: 8.0 symbols/min [2025-10-29T18:03:43.603279] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-29T18:03:43.747290] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:03:43.747517] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-10-29T18:03:43.747560] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-10-29T18:03:43.747697] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-29T18:03:43.747750] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-29T18:03:43.747791] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-29T18:03:43.747822] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-29T18:03:44.140597] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:03:44.143087] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T18:03:44.393554] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-29T18:03:45.193606] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-29T18:03:45.802134] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-29T18:03:45.993563] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-29T18:03:46.654074] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-29T18:03:46.752520] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-29T18:03:46.793587] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-29T18:03:47.593560] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-29T18:03:47.595793] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-29T18:03:47.852329] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-29T18:03:48.393606] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-29T18:03:48.802388] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T18:03:49.193598] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-29T18:03:49.960543] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-29T18:03:49.993581] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-29T18:03:50.540076] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T18:03:50.793580] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-29T18:03:51.593596] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-29T18:03:51.693046] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-29T18:03:52.117025] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:03:52.393564] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-29T18:03:52.476866] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T18:03:53.193594] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-29T18:03:53.527334] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T18:03:53.993583] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-29T18:03:54.673615] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-29T18:03:54.740678] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T18:03:54.793601] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-29T18:03:55.534703] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T18:03:55.593574] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-29T18:03:56.361285] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T18:03:56.393553] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-29T18:03:57.193605] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-29T18:03:57.392497] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-29T18:03:57.397979] [INFO ] [REMOTE ] COOK: Full fetch complete (33153 records). [2025-10-29T18:03:57.398066] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-29T18:03:57.777575] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-29T18:03:57.777675] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-29T18:03:57.778177] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-29T18:03:57.778219] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-29T18:03:57.778965] [DEBUG] [LOCAL ] COOK: Trimmed 33153 records to 24631 (keeping 200 days of data) [2025-10-29T18:03:57.908663] [DEBUG] [LOCAL ] COOK: Primary data saved (24631 records). [2025-10-29T18:03:57.908792] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-29T18:03:57.908873] [INFO ] [MAIN ] Update Progress: 509/2367 symbols completed. COOK took 26.5s. Estimated remaining: 3h 53m 21s. Rate: 8.0 symbols/min [2025-10-29T18:03:57.999064] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-29T18:03:58.080019] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:03:58.125361] [DEBUG] [LOCAL ] COTY: Loaded 53246 existing records from primary storage. [2025-10-29T18:03:58.125675] [INFO ] [MAIN ] COTY: Loaded 53246 existing records. [2025-10-29T18:03:58.309307] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:03:58.309546] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-29T18:03:58.309687] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-29T18:03:58.310493] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-29T18:03:58.310552] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-29T18:03:58.588411] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T18:03:58.706970] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:03:58.793572] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-29T18:03:59.593743] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-29T18:04:00.405436] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-29T18:04:00.408400] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-29T18:04:00.656366] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-29T18:04:01.158240] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-29T18:04:01.193542] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-29T18:04:01.654857] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T18:04:01.993558] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-29T18:04:02.308201] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T18:04:02.793579] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-29T18:04:03.535004] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-29T18:04:03.593539] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-29T18:04:03.829257] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T18:04:04.393562] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-29T18:04:05.033556] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T18:04:05.193552] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-29T18:04:05.610893] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T18:04:05.790825] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T18:04:05.801626] [INFO ] [REMOTE ] COP: Full fetch complete (77516 records). [2025-10-29T18:04:05.801812] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-29T18:04:05.802491] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:04:05.802581] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:04:05.802624] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:04:05.802726] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-29T18:04:05.802799] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-29T18:04:05.802835] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-10-29T18:04:05.802888] [DEBUG] [LOCAL ] COP: No derivative data file found to delete. [2025-10-29T18:04:05.802985] [INFO ] [MAIN ] Update Progress: 510/2367 symbols completed. COP took 26.3s. Estimated remaining: 3h 53m 14s. Rate: 8.0 symbols/min [2025-10-29T18:04:05.972827] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:04:05.973036] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-10-29T18:04:05.973084] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-10-29T18:04:05.973200] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-29T18:04:05.973242] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-29T18:04:05.973285] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-29T18:04:05.973359] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-29T18:04:06.002563] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-29T18:04:06.337252] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:04:06.793560] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-29T18:04:07.423482] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T18:04:07.593558] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-29T18:04:08.038134] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T18:04:08.393618] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-29T18:04:08.827290] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-29T18:04:08.835248] [INFO ] [REMOTE ] CON: Full fetch complete (56232 records). [2025-10-29T18:04:08.835391] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-29T18:04:08.836122] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:04:08.836222] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:04:08.836300] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:04:08.836386] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-29T18:04:08.836461] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-29T18:04:08.836499] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-29T18:04:08.836539] [DEBUG] [LOCAL ] CON: No derivative data file found to delete. [2025-10-29T18:04:08.836595] [INFO ] [MAIN ] Update Progress: 511/2367 symbols completed. CON took 47.9s. Estimated remaining: 3h 52m 50s. Rate: 8.0 symbols/min [2025-10-29T18:04:09.018087] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:04:09.018282] [DEBUG] [LOCAL ] CP: No existing data file found in primary storage. [2025-10-29T18:04:09.018321] [WARN ] [MAIN ] CP: No existing data found, performing full refresh instead. [2025-10-29T18:04:09.018438] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-29T18:04:09.018479] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-29T18:04:09.018521] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-29T18:04:09.018553] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-29T18:04:09.202797] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-29T18:04:09.398771] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:04:09.743372] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T18:04:09.993675] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-29T18:04:10.751863] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-29T18:04:10.793534] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-29T18:04:11.503277] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-29T18:04:11.593556] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-29T18:04:12.020667] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T18:04:12.393582] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-29T18:04:12.952163] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T18:04:12.961069] [INFO ] [REMOTE ] COR: Full fetch complete (68194 records). [2025-10-29T18:04:12.961193] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-29T18:04:13.198636] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-29T18:04:13.346665] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-29T18:04:13.346749] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-29T18:04:13.347494] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-29T18:04:13.347553] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-29T18:04:13.348832] [DEBUG] [LOCAL ] COR: Trimmed 68194 records to 45866 (keeping 200 days of data) [2025-10-29T18:04:13.612302] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T18:04:13.670636] [DEBUG] [LOCAL ] COR: Primary data saved (45866 records). [2025-10-29T18:04:13.670781] [INFO ] [MAIN ] COR: Full history saved. [2025-10-29T18:04:13.670850] [INFO ] [MAIN ] Update Progress: 512/2367 symbols completed. COR took 30.1s. Estimated remaining: 3h 52m 33s. Rate: 8.0 symbols/min [2025-10-29T18:04:13.848491] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:04:13.848680] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-29T18:04:13.848733] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-29T18:04:13.848842] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-29T18:04:13.848882] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-29T18:04:13.848921] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-29T18:04:13.848951] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-29T18:04:13.999114] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-29T18:04:14.204622] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:04:14.391921] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:04:14.793618] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-29T18:04:15.357100] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-29T18:04:15.593692] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-29T18:04:15.772059] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-29T18:04:16.393589] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-29T18:04:16.898746] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T18:04:17.193576] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-29T18:04:17.587427] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T18:04:17.993626] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-29T18:04:18.458018] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T18:04:18.793634] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-29T18:04:19.236131] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:04:19.593606] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-29T18:04:19.709738] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-29T18:04:20.393631] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-29T18:04:21.086145] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-29T18:04:21.193529] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-29T18:04:21.290268] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T18:04:21.993699] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-29T18:04:22.582869] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T18:04:22.793573] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-29T18:04:23.593552] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-29T18:04:23.858697] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-29T18:04:24.369365] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-29T18:04:24.393527] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-29T18:04:24.606790] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T18:04:25.193545] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-29T18:04:25.617099] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T18:04:25.993567] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-29T18:04:26.279413] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T18:04:26.793600] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-29T18:04:27.066956] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T18:04:27.593592] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-29T18:04:28.317171] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-29T18:04:28.393553] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-29T18:04:28.452822] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T18:04:29.193547] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-29T18:04:29.721109] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T18:04:29.866591] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-29T18:04:29.993574] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-29T18:04:30.793546] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-29T18:04:30.857569] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-29T18:04:31.593556] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-29T18:04:32.393546] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-29T18:04:32.433322] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T18:04:32.470080] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-29T18:04:32.481018] [INFO ] [REMOTE ] COTY: Full fetch complete (77276 records). [2025-10-29T18:04:32.481160] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-29T18:04:32.874063] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-29T18:04:32.874141] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-29T18:04:32.874987] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-29T18:04:32.875049] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-29T18:04:32.876417] [DEBUG] [LOCAL ] COTY: Trimmed 77276 records to 53245 (keeping 200 days of data) [2025-10-29T18:04:33.166015] [DEBUG] [LOCAL ] COTY: Primary data saved (53245 records). [2025-10-29T18:04:33.166140] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-29T18:04:33.166215] [INFO ] [MAIN ] Update Progress: 513/2367 symbols completed. COTY took 35.3s. Estimated remaining: 3h 53m 9s. Rate: 8.0 symbols/min [2025-10-29T18:04:33.197686] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-29T18:04:33.334968] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:04:33.335150] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-29T18:04:33.335187] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-29T18:04:33.335314] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-29T18:04:33.335355] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-29T18:04:33.335396] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-29T18:04:33.335429] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-29T18:04:33.704370] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:04:33.744854] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T18:04:33.993578] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-29T18:04:34.639067] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:04:34.793553] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-29T18:04:35.336415] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T18:04:35.593548] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-29T18:04:35.978265] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T18:04:36.142939] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T18:04:36.393561] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-29T18:04:36.630616] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-29T18:04:37.193614] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-29T18:04:37.449331] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-29T18:04:37.993557] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-29T18:04:38.247901] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-29T18:04:38.793556] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-29T18:04:39.593563] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-29T18:04:39.733678] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T18:04:39.738759] [INFO ] [REMOTE ] CPA: Full fetch complete (40742 records). [2025-10-29T18:04:39.738862] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-29T18:04:40.114706] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-29T18:04:40.114836] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-29T18:04:40.115505] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-29T18:04:40.115570] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-29T18:04:40.116684] [DEBUG] [LOCAL ] CPA: Trimmed 40742 records to 27196 (keeping 200 days of data) [2025-10-29T18:04:40.289497] [DEBUG] [LOCAL ] CPA: Primary data saved (27196 records). [2025-10-29T18:04:40.289629] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-29T18:04:40.289735] [INFO ] [MAIN ] Update Progress: 514/2367 symbols completed. CPA took 26.6s. Estimated remaining: 3h 52m 60s. Rate: 8.0 symbols/min [2025-10-29T18:04:40.396313] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-29T18:04:40.467451] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:04:40.496565] [DEBUG] [LOCAL ] CPAY: Loaded 29462 existing records from primary storage. [2025-10-29T18:04:40.496865] [INFO ] [MAIN ] CPAY: Loaded 29462 existing records. [2025-10-29T18:04:40.675455] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:04:40.675676] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-29T18:04:40.675733] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-29T18:04:40.676337] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-29T18:04:40.676395] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-29T18:04:41.050206] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:04:41.084250] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T18:04:41.193579] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-29T18:04:41.681054] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T18:04:41.993606] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-29T18:04:42.180838] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T18:04:42.793570] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-29T18:04:43.599174] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-29T18:04:43.620257] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-29T18:04:43.631721] [INFO ] [REMOTE ] CP: Full fetch complete (77284 records). [2025-10-29T18:04:43.631844] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-29T18:04:43.928366] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T18:04:44.024965] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:04:44.069045] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-29T18:04:44.069124] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-29T18:04:44.069968] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-29T18:04:44.070030] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-29T18:04:44.071424] [DEBUG] [LOCAL ] CP: Trimmed 77284 records to 53201 (keeping 200 days of data) [2025-10-29T18:04:44.387300] [DEBUG] [LOCAL ] CP: Primary data saved (53201 records). [2025-10-29T18:04:44.387424] [INFO ] [MAIN ] CP: Full history saved. [2025-10-29T18:04:44.387491] [INFO ] [MAIN ] Update Progress: 515/2367 symbols completed. CP took 35.6s. Estimated remaining: 3h 52m 40s. Rate: 8.0 symbols/min [2025-10-29T18:04:44.398696] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-29T18:04:44.559695] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:04:44.573751] [DEBUG] [LOCAL ] CPF: Loaded 14819 existing records from primary storage. [2025-10-29T18:04:44.573966] [INFO ] [MAIN ] CPF: Loaded 14819 existing records. [2025-10-29T18:04:44.751118] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:04:44.751329] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-29T18:04:44.751374] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-29T18:04:44.751769] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-29T18:04:44.751826] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-29T18:04:45.098508] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:04:45.193533] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-29T18:04:45.500176] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T18:04:45.859577] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T18:04:45.993565] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-29T18:04:46.793562] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-29T18:04:47.593581] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-29T18:04:47.673068] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-29T18:04:47.686388] [INFO ] [REMOTE ] COUR: Full fetch complete (71016 records). [2025-10-29T18:04:47.686566] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-29T18:04:47.687304] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:04:47.687407] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:04:47.687449] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:04:47.687505] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-29T18:04:47.687561] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-29T18:04:47.687595] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-10-29T18:04:47.687634] [DEBUG] [LOCAL ] COUR: No derivative data file found to delete. [2025-10-29T18:04:47.687746] [INFO ] [MAIN ] Update Progress: 516/2367 symbols completed. COUR took 41.9s. Estimated remaining: 3h 52m 17s. Rate: 8.0 symbols/min [2025-10-29T18:04:47.869203] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:04:47.869442] [DEBUG] [LOCAL ] CPK: No existing data file found in primary storage. [2025-10-29T18:04:47.869526] [WARN ] [MAIN ] CPK: No existing data found, performing full refresh instead. [2025-10-29T18:04:47.869920] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-29T18:04:47.870028] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-29T18:04:47.870162] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-29T18:04:47.870221] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-29T18:04:48.061944] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T18:04:48.262720] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:04:48.350002] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-29T18:04:48.393525] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-29T18:04:49.091341] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-29T18:04:49.193552] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-29T18:04:49.913868] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T18:04:49.993584] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-29T18:04:50.709436] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T18:04:50.793562] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-29T18:04:51.593563] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-29T18:04:51.797541] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T18:04:51.980454] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T18:04:52.393585] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-29T18:04:53.193591] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-29T18:04:53.420584] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T18:04:53.686224] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T18:04:53.993571] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-29T18:04:54.769583] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T18:04:54.793532] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-29T18:04:55.509343] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T18:04:55.593541] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-29T18:04:56.160818] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T18:04:56.393560] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-29T18:04:56.870750] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-29T18:04:57.193562] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-29T18:04:57.826428] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-29T18:04:57.993524] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-29T18:04:58.752280] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T18:04:58.793679] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-29T18:04:59.108064] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:04:59.593604] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-29T18:04:59.913479] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-29T18:05:00.393566] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-29T18:05:00.819999] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T18:05:00.821430] [INFO ] [REMOTE ] CPAC: Full fetch complete (1798 records). [2025-10-29T18:05:00.821570] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-29T18:05:00.822156] [FATAL] [VALIDATOR ] CPAC: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:05:00.822261] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:05:00.822323] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:05:00.822408] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-29T18:05:00.822491] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-29T18:05:00.822543] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-29T18:05:00.822602] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-29T18:05:00.822708] [INFO ] [MAIN ] Update Progress: 517/2367 symbols completed. CPAC took 27.7s. Estimated remaining: 3h 52m 30s. Rate: 8.0 symbols/min [2025-10-29T18:05:01.193627] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-29T18:05:01.993621] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-29T18:05:02.129987] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T18:05:02.662112] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-29T18:05:02.793593] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-29T18:05:03.593702] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-29T18:05:03.787770] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T18:05:04.196362] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T18:05:04.393589] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-29T18:05:05.193560] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-29T18:05:05.216527] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-29T18:05:05.220688] [INFO ] [REMOTE ] CPK: Full fetch complete (18809 records). [2025-10-29T18:05:05.220788] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-29T18:05:05.221311] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:05:05.221399] [FATAL] [MAIN ] CPK: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:05:05.221443] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:05:05.221517] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-29T18:05:05.221587] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-29T18:05:05.221623] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-10-29T18:05:05.221712] [DEBUG] [LOCAL ] CPK: No derivative data file found to delete. [2025-10-29T18:05:05.221787] [INFO ] [MAIN ] Update Progress: 518/2367 symbols completed. CPK took 17.5s. Estimated remaining: 3h 52m 11s. Rate: 8.0 symbols/min [2025-10-29T18:05:05.964259] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-29T18:05:05.993550] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-29T18:05:06.646268] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T18:05:06.793586] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-29T18:05:07.445143] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T18:05:07.593595] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-29T18:05:08.242471] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T18:05:08.393603] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-29T18:05:09.077756] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T18:05:09.193601] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-29T18:05:09.995231] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-29T18:05:10.001909] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-29T18:05:10.793750] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-29T18:05:10.940666] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T18:05:10.945224] [INFO ] [REMOTE ] CPF: Full fetch complete (22984 records). [2025-10-29T18:05:10.945419] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-29T18:05:10.946216] [FATAL] [VALIDATOR ] CPF: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:05:10.946380] [FATAL] [MAIN ] CPF: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:05:10.946437] [WARN ] [MAIN ] CPF: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:05:10.946482] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-29T18:05:10.946550] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-29T18:05:10.946621] [INFO ] [LOCAL ] CPF: Starting deletion of derivative data. [2025-10-29T18:05:10.947108] [DEBUG] [LOCAL ] CPF: Deleted derivative data file. [2025-10-29T18:05:10.947243] [INFO ] [MAIN ] Update Progress: 519/2367 symbols completed. CPF took 26.6s. Estimated remaining: 3h 51m 57s. Rate: 8.0 symbols/min [2025-10-29T18:05:11.813430] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T18:05:11.819815] [INFO ] [REMOTE ] CPAY: Full fetch complete (44132 records). [2025-10-29T18:05:11.819946] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-29T18:05:11.821168] [FATAL] [VALIDATOR ] CPAY: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:05:11.821257] [FATAL] [MAIN ] CPAY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:05:11.821301] [WARN ] [MAIN ] CPAY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:05:11.821340] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-29T18:05:11.821412] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-10-29T18:05:11.821460] [INFO ] [LOCAL ] CPAY: Starting deletion of derivative data. [2025-10-29T18:05:11.821683] [DEBUG] [LOCAL ] CPAY: Deleted derivative data file. [2025-10-29T18:05:11.821785] [INFO ] [MAIN ] Update Progress: 520/2367 symbols completed. CPAY took 31.5s. Estimated remaining: 3h 51m 26s. Rate: 8.0 symbols/min [2025-10-29T18:05:12.489556] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:05:12.609800] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:05:12.624400] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:05:12.647799] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:05:12.624574] [DEBUG] [LOCAL ] CPRI: No existing data file found in primary storage. [2025-10-29T18:05:12.648727] [WARN ] [MAIN ] CPRI: No existing data found, performing full refresh instead. [2025-10-29T18:05:12.651371] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-29T18:05:12.651454] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-29T18:05:12.651505] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-29T18:05:12.651544] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-29T18:05:12.823381] [DEBUG] [LOCAL ] CPS: Loaded 24213 existing records from primary storage. [2025-10-29T18:05:12.873166] [INFO ] [MAIN ] CPS: Loaded 24213 existing records. [2025-10-29T18:05:13.099211] [DEBUG] [LOCAL ] CPT: Loaded 44251 existing records from primary storage. [2025-10-29T18:05:13.082287] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-29T18:05:13.206995] [INFO ] [MAIN ] CPT: Loaded 44251 existing records. [2025-10-29T18:05:13.222800] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-29T18:05:13.475897] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:05:13.590403] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-29T18:05:13.700318] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:05:13.770076] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:05:13.735637] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-29T18:05:13.776613] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-29T18:05:13.787082] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-29T18:05:13.797708] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-29T18:05:13.817388] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-29T18:05:13.849389] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-29T18:05:13.855273] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-29T18:05:13.855043] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:05:13.860878] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-29T18:05:13.855400] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-29T18:05:13.868156] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-29T18:05:13.923059] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-29T18:05:13.941741] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-29T18:05:14.870611] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:05:14.944766] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:05:14.956401] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-29T18:05:14.967601] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-29T18:05:15.037849] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:05:15.038622] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-29T18:05:15.143753] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T18:05:15.153986] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-29T18:05:16.048598] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T18:05:16.053417] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-29T18:05:16.292383] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T18:05:16.393597] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-29T18:05:16.605605] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T18:05:16.892513] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T18:05:16.942349] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-29T18:05:17.193546] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-29T18:05:17.507417] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:05:17.993568] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-29T18:05:18.770545] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-29T18:05:18.793516] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-29T18:05:19.593613] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-29T18:05:19.779295] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-29T18:05:20.289001] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-29T18:05:20.398665] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-29T18:05:20.412426] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T18:05:21.193563] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-29T18:05:21.565709] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T18:05:21.998616] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-29T18:05:22.009809] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T18:05:22.793565] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-29T18:05:23.313738] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:05:23.598633] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-29T18:05:23.610459] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T18:05:24.393573] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-29T18:05:25.181415] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-29T18:05:25.193516] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-29T18:05:25.993556] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-29T18:05:26.049055] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-29T18:05:26.454257] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T18:05:26.743044] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-29T18:05:26.793559] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-29T18:05:27.577260] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T18:05:27.593526] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-29T18:05:28.393547] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-29T18:05:29.193580] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-29T18:05:29.604509] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-29T18:05:29.735400] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T18:05:29.993576] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-29T18:05:30.330853] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T18:05:30.793597] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-29T18:05:31.022862] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T18:05:31.593567] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-29T18:05:31.915685] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T18:05:32.393579] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-29T18:05:32.906584] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T18:05:33.193619] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-29T18:05:33.880013] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-29T18:05:33.993534] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-29T18:05:34.526500] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T18:05:34.793585] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-29T18:05:35.593537] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-29T18:05:35.786997] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-29T18:05:36.147682] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T18:05:36.393569] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-29T18:05:36.883170] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T18:05:37.166065] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-29T18:05:37.193541] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-29T18:05:37.993550] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-29T18:05:38.595147] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T18:05:38.606113] [INFO ] [REMOTE ] CPRI: Full fetch complete (76154 records). [2025-10-29T18:05:38.606360] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-29T18:05:38.795038] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-29T18:05:38.933617] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-29T18:05:39.077060] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-29T18:05:39.077166] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-29T18:05:39.078031] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-29T18:05:39.078095] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-29T18:05:39.079499] [DEBUG] [LOCAL ] CPRI: Trimmed 76154 records to 52314 (keeping 200 days of data) [2025-10-29T18:05:39.377732] [DEBUG] [LOCAL ] CPRI: Primary data saved (52314 records). [2025-10-29T18:05:39.377868] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-29T18:05:39.377943] [INFO ] [MAIN ] Update Progress: 521/2367 symbols completed. CPRI took 27.6s. Estimated remaining: 3h 52m 29s. Rate: 7.9 symbols/min [2025-10-29T18:05:39.562825] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:05:39.580204] [DEBUG] [LOCAL ] CQP: Loaded 18615 existing records from primary storage. [2025-10-29T18:05:39.580448] [INFO ] [MAIN ] CQP: Loaded 18615 existing records. [2025-10-29T18:05:39.601150] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-29T18:05:39.764166] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:05:39.764403] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-29T18:05:39.764472] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-29T18:05:39.764914] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-29T18:05:39.764974] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-29T18:05:40.124464] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:05:40.193336] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T18:05:40.393558] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-29T18:05:40.589188] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T18:05:40.595888] [INFO ] [REMOTE ] CPS: Full fetch complete (36459 records). [2025-10-29T18:05:40.596061] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-29T18:05:40.976269] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-29T18:05:40.976352] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-29T18:05:40.976897] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-29T18:05:40.976959] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-29T18:05:40.977851] [DEBUG] [LOCAL ] CPS: Trimmed 36459 records to 24123 (keeping 200 days of data) [2025-10-29T18:05:41.113993] [DEBUG] [LOCAL ] CPS: Primary data saved (24123 records). [2025-10-29T18:05:41.114122] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-29T18:05:41.114197] [INFO ] [MAIN ] Update Progress: 522/2367 symbols completed. CPS took 29.3s. Estimated remaining: 3h 52m 1s. Rate: 8.0 symbols/min [2025-10-29T18:05:41.198728] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-29T18:05:41.284933] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:05:41.307598] [DEBUG] [LOCAL ] CR: Loaded 23923 existing records from primary storage. [2025-10-29T18:05:41.307897] [INFO ] [MAIN ] CR: Loaded 23923 existing records. [2025-10-29T18:05:41.485540] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:05:41.485811] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-29T18:05:41.485908] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-29T18:05:41.486461] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-29T18:05:41.486519] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-29T18:05:41.941847] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:05:41.968423] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-29T18:05:41.978911] [INFO ] [REMOTE ] CPT: Full fetch complete (64806 records). [2025-10-29T18:05:41.979069] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-29T18:05:42.001871] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-29T18:05:42.381214] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T18:05:42.434328] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-29T18:05:42.434421] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-29T18:05:42.435226] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-29T18:05:42.435316] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-29T18:05:42.436783] [DEBUG] [LOCAL ] CPT: Trimmed 64806 records to 44270 (keeping 200 days of data) [2025-10-29T18:05:42.712444] [DEBUG] [LOCAL ] CPT: Primary data saved (44270 records). [2025-10-29T18:05:42.712581] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-29T18:05:42.713730] [INFO ] [MAIN ] Update Progress: 523/2367 symbols completed. CPT took 30.9s. Estimated remaining: 3h 51m 33s. Rate: 8.0 symbols/min [2025-10-29T18:05:42.798766] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-29T18:05:42.893719] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:05:42.904456] [DEBUG] [LOCAL ] CRBD: Loaded 8602 existing records from primary storage. [2025-10-29T18:05:42.904715] [INFO ] [MAIN ] CRBD: Loaded 8602 existing records. [2025-10-29T18:05:43.090802] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:05:43.091175] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-29T18:05:43.091353] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-29T18:05:43.091725] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-29T18:05:43.091815] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-29T18:05:43.192793] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T18:05:43.481451] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:05:43.593551] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-29T18:05:44.138831] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-29T18:05:44.393560] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-29T18:05:44.681577] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-29T18:05:44.747757] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-29T18:05:45.193550] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-29T18:05:45.993585] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-29T18:05:46.793530] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-29T18:05:46.888286] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T18:05:46.890800] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-29T18:05:47.306465] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T18:05:47.593601] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-29T18:05:48.072000] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-29T18:05:48.393551] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-29T18:05:49.131733] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T18:05:49.193561] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-29T18:05:49.853248] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-29T18:05:49.993558] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-29T18:05:50.750570] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T18:05:50.793554] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-29T18:05:51.598672] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-29T18:05:51.610763] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T18:05:52.289460] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T18:05:52.393595] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-29T18:05:53.193639] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-29T18:05:53.272041] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T18:05:53.697499] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T18:05:53.993616] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-29T18:05:54.610479] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T18:05:54.793586] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-29T18:05:55.241605] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-29T18:05:55.593564] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-29T18:05:56.393547] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-29T18:05:56.482635] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T18:05:56.939758] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-29T18:05:57.193549] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-29T18:05:57.993685] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-29T18:05:58.159552] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-29T18:05:58.793568] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-29T18:05:59.281913] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-29T18:05:59.593599] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-29T18:06:00.008894] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-29T18:06:00.020087] [INFO ] [REMOTE ] CPNG: Full fetch complete (77793 records). [2025-10-29T18:06:00.020230] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-29T18:06:00.401713] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-29T18:06:00.427730] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-29T18:06:00.427848] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-29T18:06:00.428771] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-29T18:06:00.446587] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-29T18:06:00.448786] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-29T18:06:00.456020] [DEBUG] [LOCAL ] CPNG: Trimmed 77793 records to 53679 (keeping 200 days of data) [2025-10-29T18:06:00.794940] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-29T18:06:00.795130] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-29T18:06:00.795257] [INFO ] [MAIN ] Update Progress: 524/2367 symbols completed. CPNG took 48.9s. Estimated remaining: 3h 52m 2s. Rate: 7.9 symbols/min [2025-10-29T18:06:00.983624] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:00.998542] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T18:06:01.039192] [DEBUG] [LOCAL ] CRBG: Loaded 52565 existing records from primary storage. [2025-10-29T18:06:01.039507] [INFO ] [MAIN ] CRBG: Loaded 52565 existing records. [2025-10-29T18:06:01.203240] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-29T18:06:01.239118] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:06:01.239436] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-29T18:06:01.239491] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-29T18:06:01.240602] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-29T18:06:01.240698] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-29T18:06:01.655789] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:01.955711] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-29T18:06:01.958085] [INFO ] [REMOTE ] CRBD: Full fetch complete (12609 records). [2025-10-29T18:06:01.958260] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-29T18:06:01.958906] [FATAL] [VALIDATOR ] CRBD: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:06:01.958986] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:06:01.959053] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:06:01.959124] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-29T18:06:01.959188] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-29T18:06:01.959223] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-10-29T18:06:01.959419] [DEBUG] [LOCAL ] CRBD: Deleted derivative data file. [2025-10-29T18:06:01.959510] [INFO ] [MAIN ] Update Progress: 525/2367 symbols completed. CRBD took 19.2s. Estimated remaining: 3h 51m 32s. Rate: 8.0 symbols/min [2025-10-29T18:06:01.995691] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-29T18:06:02.157730] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:02.197385] [DEBUG] [LOCAL ] CRC: Loaded 43708 existing records from primary storage. [2025-10-29T18:06:02.197698] [INFO ] [MAIN ] CRC: Loaded 43708 existing records. [2025-10-29T18:06:02.374166] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:06:02.374357] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-29T18:06:02.374403] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-29T18:06:02.375165] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-29T18:06:02.375221] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-29T18:06:02.732157] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:02.793556] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-29T18:06:03.375386] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T18:06:03.593561] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-29T18:06:03.999421] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T18:06:04.393612] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-29T18:06:04.778311] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-29T18:06:05.193562] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-29T18:06:05.995712] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-29T18:06:06.009956] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T18:06:06.105296] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-29T18:06:06.793611] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-29T18:06:07.374233] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T18:06:07.593560] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-29T18:06:07.665402] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T18:06:08.393605] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-29T18:06:08.488819] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-29T18:06:09.193573] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-29T18:06:09.587459] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T18:06:09.932476] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T18:06:09.993594] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-29T18:06:10.793623] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-29T18:06:11.215876] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T18:06:11.593571] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-29T18:06:12.088847] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:06:12.305447] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-29T18:06:12.309135] [INFO ] [REMOTE ] CQP: Full fetch complete (29341 records). [2025-10-29T18:06:12.309246] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-29T18:06:12.398761] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-29T18:06:12.686884] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-29T18:06:12.687008] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-29T18:06:12.687587] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-29T18:06:12.687638] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-29T18:06:12.688457] [DEBUG] [LOCAL ] CQP: Trimmed 29341 records to 18643 (keeping 200 days of data) [2025-10-29T18:06:12.798110] [DEBUG] [LOCAL ] CQP: Primary data saved (18643 records). [2025-10-29T18:06:12.798244] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-29T18:06:12.798321] [INFO ] [MAIN ] Update Progress: 526/2367 symbols completed. CQP took 33.4s. Estimated remaining: 3h 51m 36s. Rate: 7.9 symbols/min [2025-10-29T18:06:12.968523] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:12.968768] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-29T18:06:12.968814] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-29T18:06:12.968918] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-29T18:06:12.968960] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-29T18:06:12.969000] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-29T18:06:12.969031] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-29T18:06:13.200003] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-29T18:06:13.327190] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:13.589373] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T18:06:13.993621] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-29T18:06:14.174457] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T18:06:14.174753] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-29T18:06:14.174835] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:06:14.174905] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-29T18:06:14.174970] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:06:14.175035] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-29T18:06:14.175095] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-29T18:06:14.175132] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-29T18:06:14.175170] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-29T18:06:14.175214] [INFO ] [MAIN ] Update Progress: 527/2367 symbols completed. CRCL took 1.4s. Estimated remaining: 3h 51m 7s. Rate: 8.0 symbols/min [2025-10-29T18:06:14.340778] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:14.384976] [DEBUG] [LOCAL ] CRGY: Loaded 52484 existing records from primary storage. [2025-10-29T18:06:14.385479] [INFO ] [MAIN ] CRGY: Loaded 52484 existing records. [2025-10-29T18:06:14.563704] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:06:14.563961] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-29T18:06:14.564034] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-29T18:06:14.564992] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-29T18:06:14.565076] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-29T18:06:14.803519] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-29T18:06:14.945774] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-29T18:06:14.950848] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:15.593569] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-29T18:06:16.023364] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T18:06:16.393564] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-29T18:06:16.800459] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T18:06:17.122263] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T18:06:17.193598] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-29T18:06:17.993558] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-29T18:06:18.425591] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T18:06:18.793624] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-29T18:06:18.945918] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T18:06:18.951195] [INFO ] [REMOTE ] CR: Full fetch complete (34926 records). [2025-10-29T18:06:18.951305] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-29T18:06:18.951879] [FATAL] [VALIDATOR ] CR: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:06:18.951976] [FATAL] [MAIN ] CR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:06:18.952054] [WARN ] [MAIN ] CR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:06:18.952147] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-29T18:06:18.952224] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-10-29T18:06:18.952261] [INFO ] [LOCAL ] CR: Starting deletion of derivative data. [2025-10-29T18:06:18.952406] [DEBUG] [LOCAL ] CR: Deleted derivative data file. [2025-10-29T18:06:18.952480] [INFO ] [MAIN ] Update Progress: 528/2367 symbols completed. CR took 37.8s. Estimated remaining: 3h 50m 50s. Rate: 8.0 symbols/min [2025-10-29T18:06:19.136312] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:19.184895] [DEBUG] [LOCAL ] CRH: Loaded 53383 existing records from primary storage. [2025-10-29T18:06:19.185233] [INFO ] [MAIN ] CRH: Loaded 53383 existing records. [2025-10-29T18:06:19.373844] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:06:19.374073] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-29T18:06:19.374124] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-29T18:06:19.375085] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-29T18:06:19.375148] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-29T18:06:19.602194] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-29T18:06:19.767091] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:20.038237] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T18:06:20.393574] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-29T18:06:21.003544] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-29T18:06:21.193577] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-29T18:06:21.952895] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-29T18:06:21.993553] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-29T18:06:22.319098] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:06:22.793557] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-29T18:06:23.325118] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T18:06:23.593552] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-29T18:06:24.007193] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T18:06:24.393550] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-29T18:06:24.916622] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T18:06:25.193589] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-29T18:06:25.924439] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T18:06:25.936150] [INFO ] [REMOTE ] CRBG: Full fetch complete (76038 records). [2025-10-29T18:06:25.936311] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-29T18:06:25.999586] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-29T18:06:26.335021] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-29T18:06:26.335101] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-29T18:06:26.336003] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-29T18:06:26.336067] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-29T18:06:26.337537] [DEBUG] [LOCAL ] CRBG: Trimmed 76038 records to 52558 (keeping 200 days of data) [2025-10-29T18:06:26.681516] [DEBUG] [LOCAL ] CRBG: Primary data saved (52558 records). [2025-10-29T18:06:26.684421] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-29T18:06:26.686123] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-29T18:06:26.685066] [INFO ] [MAIN ] Update Progress: 529/2367 symbols completed. CRBG took 25.9s. Estimated remaining: 3h 50m 43s. Rate: 8.0 symbols/min [2025-10-29T18:06:26.798695] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-29T18:06:26.883706] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:26.924126] [DEBUG] [LOCAL ] CRI: Loaded 49467 existing records from primary storage. [2025-10-29T18:06:26.924408] [INFO ] [MAIN ] CRI: Loaded 49467 existing records. [2025-10-29T18:06:27.107397] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:06:27.107631] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-29T18:06:27.107717] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-29T18:06:27.108760] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-29T18:06:27.108821] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-29T18:06:27.432725] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T18:06:27.521898] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:27.593523] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-29T18:06:28.336963] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T18:06:28.393534] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-29T18:06:28.692869] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T18:06:29.193603] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-29T18:06:29.540945] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T18:06:29.993561] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-29T18:06:30.359791] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T18:06:30.793560] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-29T18:06:31.098685] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T18:06:31.593598] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-29T18:06:32.096389] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T18:06:32.393619] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-29T18:06:32.711505] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-29T18:06:33.193565] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-29T18:06:33.663455] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T18:06:33.993570] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-29T18:06:34.665441] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-29T18:06:34.793572] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-29T18:06:35.326733] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T18:06:35.593559] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-29T18:06:35.958056] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T18:06:36.393587] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-29T18:06:37.041611] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-29T18:06:37.193549] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-29T18:06:37.770289] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T18:06:37.993596] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-29T18:06:38.707993] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T18:06:38.723196] [INFO ] [REMOTE ] CRGY: Full fetch complete (76170 records). [2025-10-29T18:06:38.723357] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-29T18:06:38.798742] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-29T18:06:39.146029] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-29T18:06:39.146306] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-29T18:06:39.147367] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-29T18:06:39.147543] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-29T18:06:39.149374] [DEBUG] [LOCAL ] CRGY: Trimmed 76170 records to 52483 (keeping 200 days of data) [2025-10-29T18:06:39.297612] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T18:06:39.494447] [DEBUG] [LOCAL ] CRGY: Primary data saved (52483 records). [2025-10-29T18:06:39.494581] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-29T18:06:39.494682] [INFO ] [MAIN ] Update Progress: 530/2367 symbols completed. CRGY took 25.3s. Estimated remaining: 3h 50m 54s. Rate: 8.0 symbols/min [2025-10-29T18:06:39.601510] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-29T18:06:39.679076] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:39.679267] [DEBUG] [LOCAL ] CRK: No existing data file found in primary storage. [2025-10-29T18:06:39.679306] [WARN ] [MAIN ] CRK: No existing data found, performing full refresh instead. [2025-10-29T18:06:39.679448] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-29T18:06:39.679490] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-29T18:06:39.679531] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-29T18:06:39.679564] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-29T18:06:40.049252] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:40.285853] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T18:06:40.393515] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-29T18:06:40.950715] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T18:06:41.193593] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-29T18:06:41.828445] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-29T18:06:41.993570] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-29T18:06:42.536182] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T18:06:42.793577] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-29T18:06:43.356634] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T18:06:43.593633] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-29T18:06:43.974363] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-29T18:06:44.393615] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-29T18:06:45.193550] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-29T18:06:45.319123] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-29T18:06:45.330558] [INFO ] [REMOTE ] CRH: Full fetch complete (77512 records). [2025-10-29T18:06:45.330748] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-29T18:06:45.761305] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-29T18:06:45.761550] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-29T18:06:45.762729] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-29T18:06:45.762822] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-29T18:06:45.764352] [DEBUG] [LOCAL ] CRH: Trimmed 77512 records to 53382 (keeping 200 days of data) [2025-10-29T18:06:45.888694] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-29T18:06:46.014757] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-29T18:06:46.135084] [DEBUG] [LOCAL ] CRH: Primary data saved (53382 records). [2025-10-29T18:06:46.135229] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-29T18:06:46.135310] [INFO ] [MAIN ] Update Progress: 531/2367 symbols completed. CRH took 27.2s. Estimated remaining: 3h 50m 43s. Rate: 8.0 symbols/min [2025-10-29T18:06:46.319743] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:46.358472] [DEBUG] [LOCAL ] CRL: Loaded 42469 existing records from primary storage. [2025-10-29T18:06:46.358809] [INFO ] [MAIN ] CRL: Loaded 42469 existing records. [2025-10-29T18:06:46.539965] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:06:46.540297] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-29T18:06:46.540449] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-29T18:06:46.551171] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-29T18:06:46.565505] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-29T18:06:46.651827] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-29T18:06:46.801587] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-29T18:06:46.939150] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:47.225981] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T18:06:47.593631] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-29T18:06:48.138168] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T18:06:48.147526] [INFO ] [REMOTE ] CRC: Full fetch complete (62740 records). [2025-10-29T18:06:48.147714] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-29T18:06:48.398744] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-29T18:06:48.574957] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-29T18:06:48.575054] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-29T18:06:48.576041] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-29T18:06:48.576229] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-29T18:06:48.578001] [DEBUG] [LOCAL ] CRC: Trimmed 62740 records to 43661 (keeping 200 days of data) [2025-10-29T18:06:48.701089] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T18:06:48.866835] [DEBUG] [LOCAL ] CRC: Primary data saved (43661 records). [2025-10-29T18:06:48.866957] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-29T18:06:48.867892] [INFO ] [MAIN ] Update Progress: 532/2367 symbols completed. CRC took 46.9s. Estimated remaining: 3h 50m 19s. Rate: 8.0 symbols/min [2025-10-29T18:06:49.036872] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:06:49.088088] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-29T18:06:49.088380] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-29T18:06:49.198726] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-29T18:06:49.283702] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:06:49.284037] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-29T18:06:49.284117] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-29T18:06:49.285607] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-29T18:06:49.285707] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-29T18:06:49.659318] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:06:49.691864] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T18:06:49.993574] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-29T18:06:50.376061] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-29T18:06:50.793586] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-29T18:06:51.181597] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T18:06:51.593715] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-29T18:06:51.899660] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T18:06:52.393585] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-29T18:06:52.935636] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T18:06:53.193561] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-29T18:06:53.792748] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T18:06:53.993590] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-29T18:06:54.338080] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T18:06:54.793585] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-29T18:06:55.287253] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T18:06:55.593603] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-29T18:06:56.393520] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-29T18:06:56.451375] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-29T18:06:56.754395] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:06:57.193556] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-29T18:06:57.638771] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T18:06:57.993632] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-29T18:06:58.536143] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T18:06:58.793560] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-29T18:06:59.158808] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-29T18:06:59.168731] [INFO ] [REMOTE ] CRI: Full fetch complete (71058 records). [2025-10-29T18:06:59.168859] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-29T18:06:59.565580] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-29T18:06:59.565712] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-29T18:06:59.566547] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-29T18:06:59.566610] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-29T18:06:59.568041] [DEBUG] [LOCAL ] CRI: Trimmed 71058 records to 49443 (keeping 200 days of data) [2025-10-29T18:06:59.619971] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-29T18:06:59.861472] [DEBUG] [LOCAL ] CRI: Primary data saved (49443 records). [2025-10-29T18:06:59.861594] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-29T18:06:59.861705] [INFO ] [MAIN ] Update Progress: 533/2367 symbols completed. CRI took 33.2s. Estimated remaining: 3h 50m 24s. Rate: 8.0 symbols/min [2025-10-29T18:07:00.045810] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:07:00.074545] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T18:07:00.116947] [DEBUG] [LOCAL ] CRS: Loaded 43073 existing records from primary storage. [2025-10-29T18:07:00.117233] [INFO ] [MAIN ] CRS: Loaded 43073 existing records. [2025-10-29T18:07:00.301226] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:07:00.301617] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-29T18:07:00.301708] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-29T18:07:00.303024] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-29T18:07:00.303082] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-29T18:07:00.401803] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-29T18:07:00.683005] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:07:01.029811] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-29T18:07:01.193539] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-29T18:07:01.676073] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T18:07:01.993553] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-29T18:07:02.437433] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T18:07:02.793574] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-29T18:07:03.593539] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-29T18:07:03.696285] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-29T18:07:03.924318] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T18:07:04.393561] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-29T18:07:05.193530] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-29T18:07:05.235716] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T18:07:05.246894] [INFO ] [REMOTE ] CRK: Full fetch complete (75730 records). [2025-10-29T18:07:05.247031] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-29T18:07:05.662492] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-29T18:07:05.662680] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-29T18:07:05.663614] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-29T18:07:05.663734] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-29T18:07:05.665717] [DEBUG] [LOCAL ] CRK: Trimmed 75730 records to 52141 (keeping 200 days of data) [2025-10-29T18:07:05.782076] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T18:07:05.995309] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-29T18:07:06.022217] [DEBUG] [LOCAL ] CRK: Primary data saved (52141 records). [2025-10-29T18:07:06.022344] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-29T18:07:06.022416] [INFO ] [MAIN ] Update Progress: 534/2367 symbols completed. CRK took 26.5s. Estimated remaining: 3h 50m 11s. Rate: 8.0 symbols/min [2025-10-29T18:07:06.217204] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:07:06.224151] [DEBUG] [LOCAL ] CRT: Loaded 4820 existing records from primary storage. [2025-10-29T18:07:06.224399] [INFO ] [MAIN ] CRT: Loaded 4820 existing records. [2025-10-29T18:07:06.497626] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:07:06.497910] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-29T18:07:06.497964] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-29T18:07:06.498203] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-29T18:07:06.498262] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-29T18:07:06.799075] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-29T18:07:06.948348] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:07:07.129767] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-29T18:07:07.164481] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T18:07:07.593568] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-29T18:07:07.902690] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T18:07:08.393559] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-29T18:07:08.841868] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T18:07:09.193567] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-29T18:07:09.993569] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-29T18:07:10.191294] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-29T18:07:10.347199] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T18:07:10.356536] [INFO ] [REMOTE ] CRL: Full fetch complete (63824 records). [2025-10-29T18:07:10.356686] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-29T18:07:10.675070] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-29T18:07:10.760479] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-29T18:07:10.760571] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-29T18:07:10.761402] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-29T18:07:10.761491] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-29T18:07:10.762715] [DEBUG] [LOCAL ] CRL: Trimmed 63824 records to 42415 (keeping 200 days of data) [2025-10-29T18:07:10.812929] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-29T18:07:11.015208] [DEBUG] [LOCAL ] CRL: Primary data saved (42415 records). [2025-10-29T18:07:11.015328] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-29T18:07:11.015400] [INFO ] [MAIN ] Update Progress: 535/2367 symbols completed. CRL took 24.9s. Estimated remaining: 3h 49m 55s. Rate: 8.0 symbols/min [2025-10-29T18:07:11.190337] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:07:11.226473] [DEBUG] [LOCAL ] CSAN: Loaded 41980 existing records from primary storage. [2025-10-29T18:07:11.226876] [INFO ] [MAIN ] CSAN: Loaded 41980 existing records. [2025-10-29T18:07:11.328749] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T18:07:11.445166] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:07:11.445381] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-29T18:07:11.445430] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-29T18:07:11.446141] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-29T18:07:11.446200] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-29T18:07:11.598685] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-29T18:07:11.825225] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:07:12.393636] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-29T18:07:13.193544] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-29T18:07:13.517770] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-29T18:07:13.758875] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-29T18:07:13.993539] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-29T18:07:14.445074] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T18:07:14.557011] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T18:07:14.793610] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-29T18:07:15.593553] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-29T18:07:15.787778] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T18:07:16.393568] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-29T18:07:17.193529] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-29T18:07:17.337941] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-29T18:07:17.588981] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-29T18:07:17.621784] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T18:07:17.993553] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-29T18:07:18.793565] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-29T18:07:19.593632] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-29T18:07:19.813841] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T18:07:20.018746] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-29T18:07:20.393553] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-29T18:07:20.825921] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T18:07:21.193614] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-29T18:07:21.993572] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-29T18:07:22.424239] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T18:07:22.541988] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-29T18:07:22.684187] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-29T18:07:22.793670] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-29T18:07:23.593607] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-29T18:07:24.393573] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-29T18:07:24.732531] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-29T18:07:24.787131] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T18:07:24.791904] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T18:07:25.193604] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-29T18:07:25.601557] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-29T18:07:25.993590] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-29T18:07:26.793557] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-29T18:07:27.009948] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T18:07:27.186915] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T18:07:27.593683] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-29T18:07:28.210194] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T18:07:28.221492] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-10-29T18:07:28.221686] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-29T18:07:28.398752] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-29T18:07:28.623571] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-29T18:07:28.623693] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-29T18:07:28.624550] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-29T18:07:28.624601] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-29T18:07:28.626195] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 53770 (keeping 200 days of data) [2025-10-29T18:07:28.969057] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-29T18:07:28.969208] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-29T18:07:28.970203] [INFO ] [MAIN ] Update Progress: 536/2367 symbols completed. CRM took 40.1s. Estimated remaining: 3h 50m 23s. Rate: 7.9 symbols/min [2025-10-29T18:07:29.145469] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:07:29.145750] [DEBUG] [LOCAL ] CSL: No existing data file found in primary storage. [2025-10-29T18:07:29.145850] [WARN ] [MAIN ] CSL: No existing data found, performing full refresh instead. [2025-10-29T18:07:29.146000] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-29T18:07:29.146096] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-29T18:07:29.146160] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-10-29T18:07:29.146197] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-29T18:07:29.202036] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-29T18:07:29.501045] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:07:29.650597] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-29T18:07:29.675908] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T18:07:29.993607] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-29T18:07:30.793579] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-29T18:07:30.817283] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T18:07:31.593572] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-29T18:07:31.957880] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T18:07:32.054514] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-29T18:07:32.059596] [INFO ] [REMOTE ] CRT: Full fetch complete (7425 records). [2025-10-29T18:07:32.059756] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-29T18:07:32.394588] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-29T18:07:32.420724] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-29T18:07:32.420795] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-29T18:07:32.421005] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-29T18:07:32.421044] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-29T18:07:32.421423] [DEBUG] [LOCAL ] CRT: Trimmed 7425 records to 4804 (keeping 200 days of data) [2025-10-29T18:07:32.450160] [DEBUG] [LOCAL ] CRT: Primary data saved (4804 records). [2025-10-29T18:07:32.450243] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-29T18:07:32.450311] [INFO ] [MAIN ] Update Progress: 537/2367 symbols completed. CRT took 26.4s. Estimated remaining: 3h 50m 2s. Rate: 8.0 symbols/min [2025-10-29T18:07:32.625190] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:07:32.625334] [DEBUG] [LOCAL ] CSR: No existing data file found in primary storage. [2025-10-29T18:07:32.625372] [WARN ] [MAIN ] CSR: No existing data found, performing full refresh instead. [2025-10-29T18:07:32.625506] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-29T18:07:32.625568] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-29T18:07:32.625614] [DEBUG] [LOCAL ] CSR: No primary data file found to delete. [2025-10-29T18:07:32.625674] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-29T18:07:32.990553] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:07:33.193582] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-29T18:07:33.522958] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:07:33.993716] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-29T18:07:34.494014] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-29T18:07:34.502602] [INFO ] [REMOTE ] CRS: Full fetch complete (62502 records). [2025-10-29T18:07:34.502782] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-29T18:07:34.503491] [FATAL] [VALIDATOR ] CRS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:07:34.503576] [FATAL] [MAIN ] CRS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:07:34.503638] [WARN ] [MAIN ] CRS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:07:34.503736] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-29T18:07:34.503795] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-29T18:07:34.503829] [INFO ] [LOCAL ] CRS: Starting deletion of derivative data. [2025-10-29T18:07:34.503974] [DEBUG] [LOCAL ] CRS: Deleted derivative data file. [2025-10-29T18:07:34.504044] [INFO ] [MAIN ] Update Progress: 538/2367 symbols completed. CRS took 34.6s. Estimated remaining: 3h 49m 36s. Rate: 8.0 symbols/min [2025-10-29T18:07:34.671636] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:07:34.716937] [DEBUG] [LOCAL ] CSTM: Loaded 47316 existing records from primary storage. [2025-10-29T18:07:34.717322] [INFO ] [MAIN ] CSTM: Loaded 47316 existing records. [2025-10-29T18:07:34.798766] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-29T18:07:34.900366] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:07:34.900701] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-29T18:07:34.900770] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-29T18:07:34.901682] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-29T18:07:34.901743] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-29T18:07:35.318448] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:07:35.320559] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T18:07:35.563305] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T18:07:35.593517] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-29T18:07:36.061379] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-29T18:07:36.393696] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-29T18:07:37.193565] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-29T18:07:37.471894] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T18:07:37.742059] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-29T18:07:37.993591] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-29T18:07:38.793574] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-29T18:07:38.944487] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-29T18:07:39.593589] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-29T18:07:39.862920] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T18:07:40.393694] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-29T18:07:40.782029] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T18:07:41.193621] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-29T18:07:41.542595] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T18:07:41.806431] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-29T18:07:41.993570] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-29T18:07:42.793558] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-29T18:07:43.152806] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T18:07:43.593624] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-29T18:07:44.092983] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T18:07:44.393582] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-29T18:07:44.840840] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T18:07:44.849329] [INFO ] [REMOTE ] CSAN: Full fetch complete (60323 records). [2025-10-29T18:07:44.849460] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-29T18:07:45.198709] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-29T18:07:45.243291] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-29T18:07:45.243374] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-29T18:07:45.244186] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-29T18:07:45.244250] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-29T18:07:45.245500] [DEBUG] [LOCAL ] CSAN: Trimmed 60323 records to 41986 (keeping 200 days of data) [2025-10-29T18:07:45.478329] [DEBUG] [LOCAL ] CSAN: Primary data saved (41986 records). [2025-10-29T18:07:45.478490] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-29T18:07:45.478572] [INFO ] [MAIN ] Update Progress: 539/2367 symbols completed. CSAN took 34.5s. Estimated remaining: 3h 49m 40s. Rate: 8.0 symbols/min [2025-10-29T18:07:45.655132] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:07:45.685274] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T18:07:45.700387] [DEBUG] [LOCAL ] CSV: Loaded 11936 existing records from primary storage. [2025-10-29T18:07:45.700590] [INFO ] [MAIN ] CSV: Loaded 11936 existing records. [2025-10-29T18:07:45.875844] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:07:45.876090] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-29T18:07:45.876145] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-29T18:07:45.876503] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-29T18:07:45.876561] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-29T18:07:45.994629] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-29T18:07:46.013337] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-29T18:07:46.242268] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:07:46.793594] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-29T18:07:46.816703] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T18:07:47.593561] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-29T18:07:48.110019] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:07:48.393534] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-29T18:07:48.479027] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T18:07:48.804150] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-29T18:07:49.193637] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-29T18:07:49.993624] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-29T18:07:50.338696] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T18:07:50.691280] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-29T18:07:50.793555] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-29T18:07:51.365157] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T18:07:51.593559] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-29T18:07:52.393564] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-29T18:07:52.767201] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T18:07:53.193587] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-29T18:07:53.409426] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-29T18:07:53.842461] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-29T18:07:53.993638] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-29T18:07:54.671233] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-29T18:07:54.793558] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-29T18:07:55.593546] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-29T18:07:55.944142] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T18:07:56.276829] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-29T18:07:56.393544] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-29T18:07:57.014372] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-29T18:07:57.193580] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-29T18:07:57.775206] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-29T18:07:57.993567] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-29T18:07:58.487369] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-29T18:07:58.793565] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-29T18:07:59.327184] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T18:07:59.593556] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-29T18:08:00.400340] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-29T18:08:00.405171] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-29T18:08:00.409691] [INFO ] [REMOTE ] CSR: Full fetch complete (17929 records). [2025-10-29T18:08:00.409802] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-29T18:08:00.833154] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-29T18:08:00.833248] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-29T18:08:00.833883] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-29T18:08:00.833946] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-29T18:08:00.834805] [DEBUG] [LOCAL ] CSR: Trimmed 17929 records to 13271 (keeping 200 days of data) [2025-10-29T18:08:00.917036] [DEBUG] [LOCAL ] CSR: Primary data saved (13271 records). [2025-10-29T18:08:00.917181] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-29T18:08:00.917253] [INFO ] [MAIN ] Update Progress: 540/2367 symbols completed. CSR took 28.5s. Estimated remaining: 3h 49m 59s. Rate: 7.9 symbols/min [2025-10-29T18:08:01.091098] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:01.091287] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-29T18:08:01.091324] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-29T18:08:01.091436] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-29T18:08:01.091475] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-29T18:08:01.091515] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-29T18:08:01.091545] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-29T18:08:01.193594] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-29T18:08:01.467886] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:01.533912] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T18:08:01.993603] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-29T18:08:02.156937] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T18:08:02.793726] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-29T18:08:03.094484] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T18:08:03.374975] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-29T18:08:03.593585] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-29T18:08:04.239855] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-29T18:08:04.393584] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-29T18:08:05.193581] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-29T18:08:05.811689] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-29T18:08:05.993593] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-29T18:08:06.332418] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-29T18:08:06.340220] [INFO ] [REMOTE ] CSL: Full fetch complete (45793 records). [2025-10-29T18:08:06.340390] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-29T18:08:06.765224] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-29T18:08:06.765360] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-29T18:08:06.766305] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-29T18:08:06.766399] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-29T18:08:06.768391] [DEBUG] [LOCAL ] CSL: Trimmed 45793 records to 30811 (keeping 200 days of data) [2025-10-29T18:08:06.827964] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-29T18:08:06.995043] [DEBUG] [LOCAL ] CSL: Primary data saved (30811 records). [2025-10-29T18:08:06.995309] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-29T18:08:06.995461] [INFO ] [MAIN ] Update Progress: 541/2367 symbols completed. CSL took 38.0s. Estimated remaining: 3h 49m 46s. Rate: 7.9 symbols/min [2025-10-29T18:08:07.199097] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:07.240201] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T18:08:07.244171] [DEBUG] [LOCAL ] CTBB: Loaded 6178 existing records from primary storage. [2025-10-29T18:08:07.254812] [INFO ] [MAIN ] CTBB: Loaded 6178 existing records. [2025-10-29T18:08:07.459874] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:08:07.460213] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-29T18:08:07.460395] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-29T18:08:07.460837] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-29T18:08:07.460903] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-29T18:08:07.595244] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-29T18:08:07.602146] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T18:08:07.641213] [INFO ] [REMOTE ] CSV: Full fetch complete (18836 records). [2025-10-29T18:08:07.671487] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-29T18:08:07.912118] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T18:08:07.976290] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-29T18:08:08.008800] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:08.019441] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:08:08.024945] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-29T18:08:08.058328] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:08:08.086098] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-29T18:08:08.143801] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-29T18:08:08.190349] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-29T18:08:08.214636] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-29T18:08:08.214909] [INFO ] [MAIN ] Update Progress: 542/2367 symbols completed. CSW took 7.3s. Estimated remaining: 3h 49m 17s. Rate: 8.0 symbols/min [2025-10-29T18:08:08.401900] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-29T18:08:08.418003] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-29T18:08:08.428502] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-29T18:08:08.429548] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-29T18:08:08.434748] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-29T18:08:08.499507] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:08.499637] [DEBUG] [LOCAL ] CSV: Trimmed 18836 records to 11835 (keeping 200 days of data) [2025-10-29T18:08:08.563896] [DEBUG] [LOCAL ] CTDD: Loaded 4993 existing records from primary storage. [2025-10-29T18:08:08.565628] [INFO ] [MAIN ] CTDD: Loaded 4993 existing records. [2025-10-29T18:08:08.779284] [DEBUG] [LOCAL ] CSV: Primary data saved (11835 records). [2025-10-29T18:08:08.785276] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:08:08.785507] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-29T18:08:08.785672] [INFO ] [MAIN ] Update Progress: 543/2367 symbols completed. CSV took 23.3s. Estimated remaining: 3h 48m 46s. Rate: 8.0 symbols/min [2025-10-29T18:08:08.785843] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-29T18:08:08.791188] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-29T18:08:08.819205] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-29T18:08:08.834033] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-29T18:08:09.134876] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:09.155937] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-29T18:08:09.181679] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-29T18:08:09.200257] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-29T18:08:09.200039] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-29T18:08:09.245597] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-29T18:08:09.271618] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-29T18:08:09.309469] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-29T18:08:09.620579] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:09.838065] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-29T18:08:09.911234] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:09.943180] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T18:08:09.954393] [INFO ] [REMOTE ] CSTM: Full fetch complete (69570 records). [2025-10-29T18:08:09.954596] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-29T18:08:09.998718] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-29T18:08:10.386160] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-29T18:08:10.386292] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-29T18:08:10.387611] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-29T18:08:10.387708] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-29T18:08:10.389775] [DEBUG] [LOCAL ] CSTM: Trimmed 69570 records to 47329 (keeping 200 days of data) [2025-10-29T18:08:10.586695] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-29T18:08:10.701816] [DEBUG] [LOCAL ] CSTM: Primary data saved (47329 records). [2025-10-29T18:08:10.702028] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-29T18:08:10.702153] [INFO ] [MAIN ] Update Progress: 544/2367 symbols completed. CSTM took 36.2s. Estimated remaining: 3h 48m 20s. Rate: 8.0 symbols/min [2025-10-29T18:08:10.798758] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-29T18:08:10.907056] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:10.937954] [DEBUG] [LOCAL ] CTO: Loaded 27014 existing records from primary storage. [2025-10-29T18:08:10.938338] [INFO ] [MAIN ] CTO: Loaded 27014 existing records. [2025-10-29T18:08:11.153986] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:08:11.154289] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-29T18:08:11.154345] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-29T18:08:11.155138] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-29T18:08:11.155202] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-29T18:08:11.309968] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T18:08:11.564299] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:11.593548] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-29T18:08:12.393566] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-29T18:08:12.455681] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T18:08:12.541270] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T18:08:12.541615] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-29T18:08:12.541754] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:08:12.541829] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-29T18:08:12.541896] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:08:12.541965] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-29T18:08:12.542029] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-29T18:08:12.542066] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-29T18:08:12.542104] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-29T18:08:12.542150] [INFO ] [MAIN ] Update Progress: 545/2367 symbols completed. CTEV took 3.8s. Estimated remaining: 3h 47m 54s. Rate: 8.0 symbols/min [2025-10-29T18:08:12.729969] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:12.767131] [DEBUG] [LOCAL ] CTOS: Loaded 37111 existing records from primary storage. [2025-10-29T18:08:12.767624] [INFO ] [MAIN ] CTOS: Loaded 37111 existing records. [2025-10-29T18:08:12.972220] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:08:12.972703] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-29T18:08:12.972850] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-29T18:08:12.973808] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-29T18:08:12.973883] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-29T18:08:13.198851] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-29T18:08:13.376722] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:13.761768] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-29T18:08:13.993601] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-29T18:08:14.793556] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-29T18:08:15.103064] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T18:08:15.157043] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T18:08:15.593607] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-29T18:08:16.081984] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-29T18:08:16.393570] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-29T18:08:17.193528] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-29T18:08:17.270006] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T18:08:17.942754] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T18:08:17.993517] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-29T18:08:18.793544] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-29T18:08:18.934555] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T18:08:19.593546] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-29T18:08:19.820496] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T18:08:20.393525] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-29T18:08:20.609215] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-29T18:08:20.967318] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T18:08:21.193606] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-29T18:08:21.636317] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-29T18:08:21.993589] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-29T18:08:22.397431] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-29T18:08:22.793560] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-29T18:08:23.467490] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T18:08:23.593576] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-29T18:08:24.393562] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-29T18:08:24.641207] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-29T18:08:24.824900] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-29T18:08:25.193636] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-29T18:08:25.641927] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-29T18:08:25.993576] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-29T18:08:26.301550] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-29T18:08:26.793555] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-29T18:08:27.593553] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-29T18:08:27.833422] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T18:08:27.929525] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-29T18:08:28.393580] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-29T18:08:29.193596] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-29T18:08:29.248916] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T18:08:29.632538] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-29T18:08:29.993582] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-29T18:08:30.793547] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-29T18:08:30.922540] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T18:08:31.170601] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-29T18:08:31.593597] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-29T18:08:32.285478] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-29T18:08:32.287147] [INFO ] [REMOTE ] CTBB: Full fetch complete (9946 records). [2025-10-29T18:08:32.287222] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-29T18:08:32.398700] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-29T18:08:32.669503] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-29T18:08:32.669577] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-29T18:08:32.669827] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-29T18:08:32.669887] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-29T18:08:32.670282] [DEBUG] [LOCAL ] CTBB: Trimmed 9946 records to 6134 (keeping 200 days of data) [2025-10-29T18:08:32.706260] [DEBUG] [LOCAL ] CTBB: Primary data saved (6134 records). [2025-10-29T18:08:32.706366] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-29T18:08:32.706439] [INFO ] [MAIN ] Update Progress: 546/2367 symbols completed. CTBB took 25.7s. Estimated remaining: 3h 48m 28s. Rate: 8.0 symbols/min [2025-10-29T18:08:32.886671] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:32.938551] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-29T18:08:32.938953] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-29T18:08:33.120172] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:08:33.120356] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-29T18:08:33.120403] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-29T18:08:33.121263] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-29T18:08:33.121321] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-29T18:08:33.198806] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-29T18:08:33.478389] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:33.500686] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-29T18:08:33.735638] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-29T18:08:33.993601] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-29T18:08:34.793566] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-29T18:08:35.223331] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-29T18:08:35.431451] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T18:08:35.593542] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-29T18:08:36.132839] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-29T18:08:36.134192] [INFO ] [REMOTE ] CTDD: Full fetch complete (7889 records). [2025-10-29T18:08:36.134273] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-29T18:08:36.398787] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-29T18:08:36.501934] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-29T18:08:36.502013] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-29T18:08:36.502206] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-29T18:08:36.502245] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-29T18:08:36.502718] [DEBUG] [LOCAL ] CTDD: Trimmed 7889 records to 4885 (keeping 200 days of data) [2025-10-29T18:08:36.532393] [DEBUG] [LOCAL ] CTDD: Primary data saved (4885 records). [2025-10-29T18:08:36.532521] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-29T18:08:36.532597] [INFO ] [MAIN ] Update Progress: 547/2367 symbols completed. CTDD took 28.3s. Estimated remaining: 3h 48m 9s. Rate: 8.0 symbols/min [2025-10-29T18:08:36.704482] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:36.746483] [DEBUG] [LOCAL ] CTRE: Loaded 49394 existing records from primary storage. [2025-10-29T18:08:36.746840] [INFO ] [MAIN ] CTRE: Loaded 49394 existing records. [2025-10-29T18:08:36.921207] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:08:36.921430] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-29T18:08:36.921477] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-29T18:08:36.922261] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-29T18:08:36.922318] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-29T18:08:37.195120] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-29T18:08:37.290339] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:37.324450] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-29T18:08:37.993562] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-29T18:08:38.217143] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T18:08:38.793556] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-29T18:08:39.432193] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T18:08:39.593582] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-29T18:08:39.719311] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T18:08:40.393540] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-29T18:08:40.417096] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T18:08:41.200859] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-29T18:08:41.212578] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T18:08:41.993550] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-29T18:08:42.314238] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:08:42.793569] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-29T18:08:43.302496] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-29T18:08:43.311579] [INFO ] [REMOTE ] CTOS: Full fetch complete (54157 records). [2025-10-29T18:08:43.311758] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-29T18:08:43.596986] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-29T18:08:43.713025] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-29T18:08:43.719139] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-29T18:08:43.721278] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T18:08:43.720404] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-29T18:08:43.727197] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-29T18:08:43.728942] [DEBUG] [LOCAL ] CTOS: Trimmed 54157 records to 37123 (keeping 200 days of data) [2025-10-29T18:08:43.929810] [DEBUG] [LOCAL ] CTOS: Primary data saved (37123 records). [2025-10-29T18:08:43.929942] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-29T18:08:43.930018] [INFO ] [MAIN ] Update Progress: 548/2367 symbols completed. CTOS took 31.4s. Estimated remaining: 3h 48m 1s. Rate: 8.0 symbols/min [2025-10-29T18:08:44.110139] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:44.148383] [DEBUG] [LOCAL ] CTRI: Loaded 41153 existing records from primary storage. [2025-10-29T18:08:44.148720] [INFO ] [MAIN ] CTRI: Loaded 41153 existing records. [2025-10-29T18:08:44.360991] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:08:44.361221] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-29T18:08:44.361269] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-29T18:08:44.361996] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-29T18:08:44.362055] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-29T18:08:44.400367] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-29T18:08:44.766479] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:44.913974] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-29T18:08:45.193607] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-29T18:08:45.596879] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T18:08:45.993607] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-29T18:08:46.518357] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T18:08:46.793685] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-29T18:08:47.112464] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T18:08:47.119441] [INFO ] [REMOTE ] CTO: Full fetch complete (41172 records). [2025-10-29T18:08:47.119617] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-29T18:08:47.120381] [FATAL] [VALIDATOR ] CTO: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:08:47.120486] [FATAL] [MAIN ] CTO: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:08:47.120538] [WARN ] [MAIN ] CTO: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:08:47.120603] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-29T18:08:47.120734] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-29T18:08:47.120808] [INFO ] [LOCAL ] CTO: Starting deletion of derivative data. [2025-10-29T18:08:47.120977] [DEBUG] [LOCAL ] CTO: Deleted derivative data file. [2025-10-29T18:08:47.121070] [INFO ] [MAIN ] Update Progress: 549/2367 symbols completed. CTO took 36.4s. Estimated remaining: 3h 47m 39s. Rate: 8.0 symbols/min [2025-10-29T18:08:47.304190] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:08:47.322751] [DEBUG] [LOCAL ] CTS: Loaded 19303 existing records from primary storage. [2025-10-29T18:08:47.322998] [INFO ] [MAIN ] CTS: Loaded 19303 existing records. [2025-10-29T18:08:47.509614] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:08:47.509865] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-29T18:08:47.509912] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-29T18:08:47.510364] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-29T18:08:47.510421] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-29T18:08:47.600333] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-29T18:08:47.883421] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:08:47.982068] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T18:08:48.393562] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-29T18:08:48.606058] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T18:08:49.193730] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-29T18:08:49.701527] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T18:08:49.909225] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T18:08:49.993521] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-29T18:08:50.638207] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T18:08:50.793554] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-29T18:08:51.593590] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-29T18:08:52.030794] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:08:52.393597] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-29T18:08:53.021171] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T18:08:53.064034] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T18:08:53.193599] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-29T18:08:53.958814] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-29T18:08:53.993566] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-29T18:08:54.793587] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-29T18:08:55.483212] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-29T18:08:55.566349] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T18:08:55.593514] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-29T18:08:56.393536] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-29T18:08:56.419366] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T18:08:57.022948] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T18:08:57.193560] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-29T18:08:57.801245] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T18:08:57.993566] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-29T18:08:58.793560] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-29T18:08:59.271396] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T18:08:59.593561] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-29T18:09:00.112253] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T18:09:00.302967] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T18:09:00.393560] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-29T18:09:01.193585] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-29T18:09:01.993563] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-29T18:09:02.067857] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-29T18:09:02.206010] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T18:09:02.793634] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-29T18:09:03.210745] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T18:09:03.593596] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-29T18:09:04.247708] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T18:09:04.393605] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-29T18:09:04.566960] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-29T18:09:05.193560] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-29T18:09:05.854558] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-29T18:09:05.993558] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-29T18:09:06.506716] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T18:09:06.793616] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-29T18:09:07.515597] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T18:09:07.526816] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-29T18:09:07.526952] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-29T18:09:07.601272] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-29T18:09:07.915880] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-29T18:09:07.915981] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-29T18:09:07.916904] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-29T18:09:07.916973] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-29T18:09:07.918707] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-29T18:09:08.236064] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-29T18:09:08.236243] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-29T18:09:08.237288] [INFO ] [MAIN ] Update Progress: 550/2367 symbols completed. CTRA took 35.5s. Estimated remaining: 3h 48m 16s. Rate: 8.0 symbols/min [2025-10-29T18:09:08.327365] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T18:09:08.386982] [INFO ] [REMOTE ] CTRE: Full fetch complete (71414 records). [2025-10-29T18:09:08.397706] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-29T18:09:08.397956] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-29T18:09:08.456109] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-29T18:09:08.508854] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:09:08.924809] [DEBUG] [LOCAL ] CTVA: Loaded 53299 existing records from primary storage. [2025-10-29T18:09:08.936245] [INFO ] [MAIN ] CTVA: Loaded 53299 existing records. [2025-10-29T18:09:09.216629] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-29T18:09:09.232721] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-29T18:09:09.268479] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-29T18:09:09.281025] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-29T18:09:09.281123] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-29T18:09:09.291803] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:09:09.292940] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-29T18:09:09.293527] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-29T18:09:09.294856] [DEBUG] [LOCAL ] CTRE: Trimmed 71414 records to 49403 (keeping 200 days of data) [2025-10-29T18:09:09.295284] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-29T18:09:09.295605] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-29T18:09:10.050263] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:09:10.071708] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-29T18:09:10.089314] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-29T18:09:10.100892] [DEBUG] [LOCAL ] CTRE: Primary data saved (49403 records). [2025-10-29T18:09:10.101102] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-29T18:09:10.101230] [INFO ] [MAIN ] Update Progress: 551/2367 symbols completed. CTRE took 33.6s. Estimated remaining: 3h 47m 50s. Rate: 8.0 symbols/min [2025-10-29T18:09:10.227632] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T18:09:10.305128] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:09:10.305374] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-29T18:09:10.305415] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-29T18:09:10.305537] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-29T18:09:10.305580] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-29T18:09:10.305620] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-29T18:09:10.305687] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-29T18:09:10.689482] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:09:10.793583] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-29T18:09:11.376060] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T18:09:11.593610] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-29T18:09:11.840732] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T18:09:12.016216] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-29T18:09:12.393540] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-29T18:09:12.616941] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-29T18:09:13.193585] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-29T18:09:13.993591] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-29T18:09:14.113142] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-29T18:09:14.118675] [INFO ] [REMOTE ] CTS: Full fetch complete (27599 records). [2025-10-29T18:09:14.118800] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-29T18:09:14.524887] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-29T18:09:14.525002] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-29T18:09:14.525551] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-29T18:09:14.525634] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-29T18:09:14.526511] [DEBUG] [LOCAL ] CTS: Trimmed 27599 records to 19342 (keeping 200 days of data) [2025-10-29T18:09:14.652622] [DEBUG] [LOCAL ] CTS: Primary data saved (19342 records). [2025-10-29T18:09:14.652870] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-29T18:09:14.652981] [INFO ] [MAIN ] Update Progress: 552/2367 symbols completed. CTS took 27.5s. Estimated remaining: 3h 47m 33s. Rate: 8.0 symbols/min [2025-10-29T18:09:14.801541] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-29T18:09:14.828998] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:09:14.829444] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-10-29T18:09:14.829847] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-10-29T18:09:14.830813] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-29T18:09:14.830874] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-29T18:09:14.830923] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-29T18:09:14.830958] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-29T18:09:15.158811] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-29T18:09:15.238963] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:09:15.270229] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T18:09:15.593561] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-29T18:09:15.833375] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-29T18:09:16.393560] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-29T18:09:17.193555] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-29T18:09:17.475692] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T18:09:17.993561] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-29T18:09:18.793617] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-29T18:09:19.150343] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-29T18:09:19.285979] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-29T18:09:19.593583] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-29T18:09:19.844517] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-29T18:09:19.894474] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-29T18:09:19.907957] [INFO ] [REMOTE ] CTRI: Full fetch complete (55294 records). [2025-10-29T18:09:19.908163] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-29T18:09:20.340242] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-29T18:09:20.340320] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-29T18:09:20.341025] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-29T18:09:20.341086] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-29T18:09:20.342152] [DEBUG] [LOCAL ] CTRI: Trimmed 55294 records to 41288 (keeping 200 days of data) [2025-10-29T18:09:20.397261] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-29T18:09:20.578530] [DEBUG] [LOCAL ] CTRI: Primary data saved (41288 records). [2025-10-29T18:09:20.578896] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-29T18:09:20.578981] [INFO ] [MAIN ] Update Progress: 553/2367 symbols completed. CTRI took 36.6s. Estimated remaining: 3h 47m 20s. Rate: 8.0 symbols/min [2025-10-29T18:09:20.745181] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:09:20.769436] [DEBUG] [LOCAL ] CUBI: Loaded 26775 existing records from primary storage. [2025-10-29T18:09:20.769732] [INFO ] [MAIN ] CUBI: Loaded 26775 existing records. [2025-10-29T18:09:20.948034] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:09:20.948261] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-29T18:09:20.948306] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-29T18:09:20.949109] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-29T18:09:20.949166] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-29T18:09:21.198769] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-29T18:09:21.317576] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:09:21.934733] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-29T18:09:21.993546] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-29T18:09:22.439307] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T18:09:22.793602] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-29T18:09:23.301760] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T18:09:23.593560] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-29T18:09:23.942363] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T18:09:24.393583] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-29T18:09:24.986868] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T18:09:25.193576] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-29T18:09:25.602319] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T18:09:25.993589] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-29T18:09:26.268548] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-29T18:09:26.793602] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-29T18:09:27.315817] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:09:27.533134] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-29T18:09:27.593582] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-29T18:09:28.328706] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T18:09:28.393594] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-29T18:09:29.193631] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-29T18:09:29.550369] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T18:09:29.993597] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-29T18:09:30.359761] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T18:09:30.793601] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-29T18:09:30.890603] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-29T18:09:31.140615] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-29T18:09:31.593569] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-29T18:09:32.393576] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-29T18:09:32.895438] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T18:09:33.016160] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T18:09:33.193596] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-29T18:09:33.993605] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-29T18:09:34.227496] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-29T18:09:34.708320] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T18:09:34.793551] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-29T18:09:35.593600] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-29T18:09:36.303799] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-29T18:09:36.335921] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T18:09:36.393618] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-29T18:09:37.193562] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-29T18:09:37.691147] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T18:09:37.993616] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-29T18:09:38.606173] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T18:09:38.793570] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-29T18:09:38.909075] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-29T18:09:39.593594] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-29T18:09:39.648482] [DEBUG] [REMOTE ] CUBI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-29T18:09:39.648925] [WARN ] [REMOTE ] CUBI: No data returned for month 2025-08 [2025-10-29T18:09:39.649032] [FATAL] [REMOTE ] CUBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:09:39.649153] [FATAL] [MAIN ] CUBI: Failed to fetch primary data. [2025-10-29T18:09:39.649228] [WARN ] [MAIN ] CUBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:09:39.649304] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-29T18:09:39.649376] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-29T18:09:39.649414] [INFO ] [LOCAL ] CUBI: Starting deletion of derivative data. [2025-10-29T18:09:39.649629] [DEBUG] [LOCAL ] CUBI: Deleted derivative data file. [2025-10-29T18:09:39.649768] [INFO ] [MAIN ] Update Progress: 554/2367 symbols completed. CUBI took 19.1s. Estimated remaining: 3h 47m 50s. Rate: 8.0 symbols/min [2025-10-29T18:09:39.836933] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:09:39.890410] [DEBUG] [LOCAL ] CUK: Loaded 51034 existing records from primary storage. [2025-10-29T18:09:39.891074] [INFO ] [MAIN ] CUK: Loaded 51034 existing records. [2025-10-29T18:09:40.087579] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:09:40.088027] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-29T18:09:40.088083] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-29T18:09:40.089077] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-29T18:09:40.089136] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-29T18:09:40.319564] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T18:09:40.393800] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-29T18:09:40.529186] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:09:41.193688] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-29T18:09:41.993537] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-29T18:09:42.047859] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-29T18:09:42.059790] [INFO ] [REMOTE ] CTVA: Full fetch complete (77237 records). [2025-10-29T18:09:42.059957] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-29T18:09:42.338454] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-29T18:09:42.555993] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-29T18:09:42.556227] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-29T18:09:42.557599] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-29T18:09:42.557725] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-29T18:09:42.600393] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T18:09:42.611881] [DEBUG] [LOCAL ] CTVA: Trimmed 77237 records to 53297 (keeping 200 days of data) [2025-10-29T18:09:42.808790] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-29T18:09:42.975790] [DEBUG] [LOCAL ] CTVA: Primary data saved (53297 records). [2025-10-29T18:09:42.976015] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-29T18:09:42.976126] [INFO ] [MAIN ] Update Progress: 555/2367 symbols completed. CTVA took 34.7s. Estimated remaining: 3h 47m 29s. Rate: 8.0 symbols/min [2025-10-29T18:09:43.160477] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:09:43.165133] [DEBUG] [LOCAL ] CULP: Loaded 2753 existing records from primary storage. [2025-10-29T18:09:43.165300] [INFO ] [MAIN ] CULP: Loaded 2753 existing records. [2025-10-29T18:09:43.357135] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:09:43.357468] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-29T18:09:43.357526] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-29T18:09:43.357765] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-29T18:09:43.357829] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-29T18:09:43.598689] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-29T18:09:43.741999] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:09:44.382683] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-29T18:09:44.393879] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-29T18:09:44.395480] [INFO ] [REMOTE ] CUBE: Full fetch complete (73325 records). [2025-10-29T18:09:44.395601] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-29T18:09:44.830103] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-29T18:09:44.830243] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-29T18:09:44.831830] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-29T18:09:44.831908] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-29T18:09:44.834112] [DEBUG] [LOCAL ] CUBE: Trimmed 73325 records to 50834 (keeping 200 days of data) [2025-10-29T18:09:45.033078] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-29T18:09:45.202746] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-29T18:09:45.213375] [DEBUG] [LOCAL ] CUBE: Primary data saved (50834 records). [2025-10-29T18:09:45.215718] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-29T18:09:45.216528] [INFO ] [MAIN ] Update Progress: 556/2367 symbols completed. CUBE took 30.6s. Estimated remaining: 3h 47m 4s. Rate: 8.0 symbols/min [2025-10-29T18:09:45.218929] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-29T18:09:45.420210] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:09:45.453608] [DEBUG] [LOCAL ] CURB: Loaded 32676 existing records from primary storage. [2025-10-29T18:09:45.454088] [INFO ] [MAIN ] CURB: Loaded 32676 existing records. [2025-10-29T18:09:45.645938] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:09:45.646235] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-29T18:09:45.646288] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-29T18:09:45.647009] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-29T18:09:45.647069] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-29T18:09:45.761426] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-29T18:09:45.768293] [INFO ] [REMOTE ] CUBB: Full fetch complete (968 records). [2025-10-29T18:09:45.788882] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-29T18:09:45.998868] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-29T18:09:46.231700] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-29T18:09:46.233142] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:09:46.255409] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:09:46.255520] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:09:46.259970] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-29T18:09:46.260157] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-29T18:09:46.260217] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-29T18:09:46.260271] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-29T18:09:46.260403] [INFO ] [MAIN ] Update Progress: 557/2367 symbols completed. CUBB took 36.2s. Estimated remaining: 3h 46m 36s. Rate: 8.0 symbols/min [2025-10-29T18:09:46.793615] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-29T18:09:47.103429] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-29T18:09:47.267533] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T18:09:47.593596] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-29T18:09:48.393561] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-29T18:09:48.553722] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T18:09:48.804529] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-29T18:09:49.193562] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-29T18:09:49.564088] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-29T18:09:49.993569] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-29T18:09:50.288763] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-29T18:09:50.793609] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-29T18:09:51.593522] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-29T18:09:51.714720] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-29T18:09:51.940106] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-29T18:09:52.393557] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-29T18:09:52.757498] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-29T18:09:53.193575] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-29T18:09:53.523674] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-29T18:09:53.993689] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-29T18:09:54.793580] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-29T18:09:54.915580] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T18:09:55.593600] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-29T18:09:56.263755] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T18:09:56.393529] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-29T18:09:56.602230] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T18:09:57.193579] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-29T18:09:57.575009] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-29T18:09:57.772334] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T18:09:57.993546] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-29T18:09:58.426032] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T18:09:58.427119] [INFO ] [REMOTE ] CULP: Full fetch complete (4377 records). [2025-10-29T18:09:58.427188] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-29T18:09:58.786198] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-29T18:09:58.786295] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-29T18:09:58.786433] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-29T18:09:58.786470] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-29T18:09:58.786837] [DEBUG] [LOCAL ] CULP: Trimmed 4377 records to 2721 (keeping 200 days of data) [2025-10-29T18:09:58.801904] [DEBUG] [LOCAL ] CULP: Primary data saved (2721 records). [2025-10-29T18:09:58.794172] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-29T18:09:58.802040] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-29T18:09:58.803445] [INFO ] [MAIN ] Update Progress: 558/2367 symbols completed. CULP took 15.8s. Estimated remaining: 3h 46m 44s. Rate: 8.0 symbols/min [2025-10-29T18:09:59.593622] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-29T18:10:00.049241] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T18:10:00.393605] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-29T18:10:00.544404] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T18:10:01.193558] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-29T18:10:01.915219] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-29T18:10:01.993707] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-29T18:10:02.288461] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T18:10:02.793631] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-29T18:10:03.556205] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-29T18:10:03.593548] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-29T18:10:03.743147] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T18:10:04.393610] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-29T18:10:05.008794] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-29T18:10:05.193557] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-29T18:10:05.428785] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T18:10:05.993581] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-29T18:10:06.696708] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-29T18:10:06.793515] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-29T18:10:06.815011] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T18:10:07.593597] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-29T18:10:08.384472] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T18:10:08.395568] [INFO ] [REMOTE ] CUK: Full fetch complete (74404 records). [2025-10-29T18:10:08.395777] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-29T18:10:08.795811] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-29T18:10:08.795947] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-29T18:10:08.796946] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-29T18:10:08.797065] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-29T18:10:08.799132] [DEBUG] [LOCAL ] CUK: Trimmed 74404 records to 51035 (keeping 200 days of data) [2025-10-29T18:10:08.941502] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T18:10:09.044113] [INFO ] [REMOTE ] CURB: Full fetch complete (47698 records). [2025-10-29T18:10:09.052373] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-29T18:10:09.575290] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-29T18:10:09.575419] [DEBUG] [LOCAL ] CUK: Primary data saved (51035 records). [2025-10-29T18:10:09.575516] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-29T18:10:09.575583] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-29T18:10:09.576441] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-29T18:10:09.576519] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-29T18:10:09.576670] [INFO ] [MAIN ] Update Progress: 559/2367 symbols completed. CUK took 29.9s. Estimated remaining: 3h 46m 47s. Rate: 8.0 symbols/min [2025-10-29T18:10:09.577851] [DEBUG] [LOCAL ] CURB: Trimmed 47698 records to 32622 (keeping 200 days of data) [2025-10-29T18:10:09.768228] [DEBUG] [LOCAL ] CURB: Primary data saved (32622 records). [2025-10-29T18:10:09.768355] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-29T18:10:09.768430] [INFO ] [MAIN ] Update Progress: 560/2367 symbols completed. CURB took 24.5s. Estimated remaining: 3h 46m 16s. Rate: 8.0 symbols/min [2025-10-29T18:10:10.295501] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:10.376083] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:10.473943] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:10.504167] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:10.509888] [DEBUG] [LOCAL ] CVEO: Loaded 15047 existing records from primary storage. [2025-10-29T18:10:10.510556] [INFO ] [MAIN ] CVEO: Loaded 15047 existing records. [2025-10-29T18:10:10.737575] [DEBUG] [LOCAL ] CURV: Loaded 27484 existing records from primary storage. [2025-10-29T18:10:10.737859] [INFO ] [MAIN ] CURV: Loaded 27484 existing records. [2025-10-29T18:10:10.736301] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:10:10.768623] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-29T18:10:10.815783] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-29T18:10:10.861285] [DEBUG] [LOCAL ] CVE: Loaded 53558 existing records from primary storage. [2025-10-29T18:10:10.872080] [INFO ] [MAIN ] CVE: Loaded 53558 existing records. [2025-10-29T18:10:10.860603] [DEBUG] [LOCAL ] CUZ: Loaded 49295 existing records from primary storage. [2025-10-29T18:10:10.875316] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-29T18:10:10.910714] [INFO ] [MAIN ] CUZ: Loaded 49295 existing records. [2025-10-29T18:10:10.896713] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-29T18:10:11.253123] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:10:11.290921] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-29T18:10:11.351319] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-29T18:10:11.424020] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-29T18:10:11.470118] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:10:11.489732] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-29T18:10:11.527464] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:10:11.527622] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-29T18:10:11.582636] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-29T18:10:11.582575] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-29T18:10:11.612116] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-29T18:10:11.621632] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-29T18:10:11.659623] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-29T18:10:11.665846] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-29T18:10:11.676248] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-29T18:10:12.380637] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:10:12.544522] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-29T18:10:12.647841] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:10:12.673307] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-29T18:10:12.874140] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:10:12.891187] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-29T18:10:12.917998] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:10:12.918430] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-29T18:10:13.300421] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T18:10:13.303000] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-29T18:10:13.761108] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T18:10:13.767621] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-29T18:10:13.782563] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-29T18:10:13.787406] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-29T18:10:14.083015] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T18:10:14.092378] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-29T18:10:14.371101] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-29T18:10:14.513702] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T18:10:14.724174] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T18:10:14.793539] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-29T18:10:15.001999] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T18:10:15.593560] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-29T18:10:15.674316] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T18:10:16.393585] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-29T18:10:16.878195] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T18:10:17.193585] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-29T18:10:17.299238] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-29T18:10:17.993585] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-29T18:10:18.450197] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T18:10:18.666756] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T18:10:18.793595] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-29T18:10:19.593618] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-29T18:10:20.083557] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T18:10:20.105600] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T18:10:20.393620] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-29T18:10:21.143753] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-29T18:10:21.193603] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-29T18:10:21.993610] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-29T18:10:22.768621] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-29T18:10:22.793541] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-29T18:10:23.183731] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-29T18:10:23.593580] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-29T18:10:24.119521] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T18:10:24.393589] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-29T18:10:24.486974] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T18:10:24.979835] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T18:10:25.193593] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-29T18:10:25.783906] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-29T18:10:25.993624] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-29T18:10:26.793633] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-29T18:10:27.230637] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:10:27.593615] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-29T18:10:27.803964] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T18:10:28.188208] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T18:10:28.393677] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-29T18:10:28.890773] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-29T18:10:29.193600] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-29T18:10:29.993556] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-29T18:10:30.022632] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T18:10:30.793589] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-29T18:10:31.171024] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T18:10:31.540510] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-29T18:10:31.544681] [INFO ] [REMOTE ] CVEO: Full fetch complete (21021 records). [2025-10-29T18:10:31.544895] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-29T18:10:31.598849] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-29T18:10:31.963411] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-29T18:10:31.963510] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-29T18:10:31.964196] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-29T18:10:31.964260] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-29T18:10:31.965100] [DEBUG] [LOCAL ] CVEO: Trimmed 21021 records to 15070 (keeping 200 days of data) [2025-10-29T18:10:32.063928] [DEBUG] [LOCAL ] CVEO: Primary data saved (15070 records). [2025-10-29T18:10:32.064190] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-29T18:10:32.064349] [INFO ] [MAIN ] Update Progress: 561/2367 symbols completed. CVEO took 22.3s. Estimated remaining: 3h 46m 56s. Rate: 8.0 symbols/min [2025-10-29T18:10:32.248749] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:32.249043] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-29T18:10:32.249099] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-29T18:10:32.249222] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-29T18:10:32.249263] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-29T18:10:32.249322] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-29T18:10:32.249375] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-29T18:10:32.397937] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-29T18:10:32.640160] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:10:32.758025] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:10:33.193633] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-29T18:10:33.922158] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-29T18:10:33.993619] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-29T18:10:34.434309] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T18:10:34.793621] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-29T18:10:35.491904] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-29T18:10:35.593565] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-29T18:10:36.040623] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T18:10:36.393599] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-29T18:10:36.766086] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T18:10:37.193613] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-29T18:10:37.505579] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T18:10:37.513383] [INFO ] [REMOTE ] CURV: Full fetch complete (39199 records). [2025-10-29T18:10:37.513562] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-29T18:10:37.924313] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-29T18:10:37.924430] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-29T18:10:37.925066] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-29T18:10:37.925132] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-29T18:10:37.926380] [DEBUG] [LOCAL ] CURV: Trimmed 39199 records to 27572 (keeping 200 days of data) [2025-10-29T18:10:38.008506] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-29T18:10:38.088867] [DEBUG] [LOCAL ] CURV: Primary data saved (27572 records). [2025-10-29T18:10:38.089015] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-29T18:10:38.089099] [INFO ] [MAIN ] Update Progress: 562/2367 symbols completed. CURV took 28.3s. Estimated remaining: 3h 46m 44s. Rate: 8.0 symbols/min [2025-10-29T18:10:38.263136] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:38.277565] [DEBUG] [LOCAL ] CVLG: Loaded 15144 existing records from primary storage. [2025-10-29T18:10:38.277825] [INFO ] [MAIN ] CVLG: Loaded 15144 existing records. [2025-10-29T18:10:38.459764] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:10:38.460215] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-29T18:10:38.460293] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-29T18:10:38.460811] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-29T18:10:38.460884] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-29T18:10:38.802229] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-29T18:10:38.891244] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-29T18:10:38.910223] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:10:39.117727] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:10:39.593693] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-29T18:10:40.279171] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T18:10:40.289395] [INFO ] [REMOTE ] CUZ: Full fetch complete (70807 records). [2025-10-29T18:10:40.289517] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-29T18:10:40.398726] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-29T18:10:40.679594] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-29T18:10:40.679838] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-29T18:10:40.680776] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-29T18:10:40.680909] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-29T18:10:40.683059] [DEBUG] [LOCAL ] CUZ: Trimmed 70807 records to 49288 (keeping 200 days of data) [2025-10-29T18:10:40.828368] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:10:41.018167] [DEBUG] [LOCAL ] CUZ: Primary data saved (49288 records). [2025-10-29T18:10:41.018330] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-29T18:10:41.018466] [INFO ] [MAIN ] Update Progress: 563/2367 symbols completed. CUZ took 31.2s. Estimated remaining: 3h 46m 22s. Rate: 8.0 symbols/min [2025-10-29T18:10:41.183499] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:41.193579] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-29T18:10:41.230969] [DEBUG] [LOCAL ] CVNA: Loaded 52804 existing records from primary storage. [2025-10-29T18:10:41.231305] [INFO ] [MAIN ] CVNA: Loaded 52804 existing records. [2025-10-29T18:10:41.405133] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:10:41.405328] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-29T18:10:41.405376] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-29T18:10:41.406200] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-29T18:10:41.406270] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-29T18:10:41.755229] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:10:41.899154] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-29T18:10:41.922373] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-29T18:10:41.993597] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-29T18:10:42.793549] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-29T18:10:43.308760] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T18:10:43.593532] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-29T18:10:43.687319] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-29T18:10:44.393563] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-29T18:10:44.880922] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T18:10:45.024582] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-29T18:10:45.193590] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-29T18:10:45.976172] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-29T18:10:45.993568] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-29T18:10:46.793633] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-29T18:10:47.216891] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T18:10:47.378312] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-29T18:10:47.390892] [INFO ] [REMOTE ] CVE: Full fetch complete (77711 records). [2025-10-29T18:10:47.391057] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-29T18:10:47.606607] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-29T18:10:47.813743] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-29T18:10:47.813840] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-29T18:10:47.814798] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-29T18:10:47.814866] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-29T18:10:47.816428] [DEBUG] [LOCAL ] CVE: Trimmed 77711 records to 53558 (keeping 200 days of data) [2025-10-29T18:10:48.166002] [DEBUG] [LOCAL ] CVE: Primary data saved (53558 records). [2025-10-29T18:10:48.166143] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-29T18:10:48.166224] [INFO ] [MAIN ] Update Progress: 564/2367 symbols completed. CVE took 38.4s. Estimated remaining: 3h 46m 13s. Rate: 8.0 symbols/min [2025-10-29T18:10:48.340153] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:48.357262] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-29T18:10:48.404984] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-29T18:10:48.408381] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-29T18:10:48.408828] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-29T18:10:48.587967] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:10:48.588261] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-29T18:10:48.588316] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-29T18:10:48.589234] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-29T18:10:48.589294] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-29T18:10:48.947193] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:10:49.193620] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-29T18:10:49.938715] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-29T18:10:49.993522] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-29T18:10:50.776832] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-29T18:10:50.793526] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-29T18:10:51.593573] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-29T18:10:51.633245] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-29T18:10:52.196604] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-29T18:10:52.393580] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-29T18:10:52.550702] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-29T18:10:53.193586] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-29T18:10:53.945028] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-29T18:10:53.993564] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-29T18:10:54.118071] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-29T18:10:54.595406] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-29T18:10:54.793586] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-29T18:10:55.300711] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T18:10:55.593590] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-29T18:10:56.188744] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T18:10:56.393616] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-29T18:10:57.193600] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-29T18:10:57.993537] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-29T18:10:58.130843] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-29T18:10:58.429137] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:10:58.793592] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-29T18:10:58.812890] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-29T18:10:58.816294] [INFO ] [REMOTE ] CVLG: Full fetch complete (21397 records). [2025-10-29T18:10:58.816410] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-29T18:10:59.177427] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-29T18:10:59.177502] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-29T18:10:59.177953] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-29T18:10:59.178014] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-29T18:10:59.178597] [DEBUG] [LOCAL ] CVLG: Trimmed 21397 records to 15169 (keeping 200 days of data) [2025-10-29T18:10:59.266748] [DEBUG] [LOCAL ] CVLG: Primary data saved (15169 records). [2025-10-29T18:10:59.266881] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-29T18:10:59.266957] [INFO ] [MAIN ] Update Progress: 565/2367 symbols completed. CVLG took 21.2s. Estimated remaining: 3h 46m 17s. Rate: 8.0 symbols/min [2025-10-29T18:10:59.434314] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:10:59.486411] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-29T18:10:59.486778] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-29T18:10:59.598716] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-29T18:10:59.670668] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:10:59.671563] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-29T18:10:59.671698] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-29T18:10:59.672003] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-29T18:10:59.672060] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-29T18:11:00.033385] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:00.120279] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T18:11:00.393572] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-29T18:11:01.193567] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-29T18:11:01.495818] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-29T18:11:01.681475] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T18:11:01.993586] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-29T18:11:02.793618] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-29T18:11:02.988748] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-29T18:11:03.475048] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T18:11:03.593555] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-29T18:11:04.355816] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-29T18:11:04.393558] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-29T18:11:05.193852] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-29T18:11:05.193923] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-29T18:11:05.993553] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-29T18:11:06.048761] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-29T18:11:06.558258] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T18:11:06.793563] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-29T18:11:07.192262] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T18:11:07.593564] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-29T18:11:08.393567] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-29T18:11:08.647197] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-29T18:11:09.193552] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-29T18:11:09.331168] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-29T18:11:09.341034] [INFO ] [REMOTE ] CVI: Full fetch complete (67123 records). [2025-10-29T18:11:09.341183] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-29T18:11:09.730062] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-29T18:11:09.730161] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-29T18:11:09.731007] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-29T18:11:09.731091] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-29T18:11:09.732530] [DEBUG] [LOCAL ] CVI: Trimmed 67123 records to 46432 (keeping 200 days of data) [2025-10-29T18:11:09.998637] [DEBUG] [LOCAL ] CVI: Primary data saved (46432 records). [2025-10-29T18:11:09.998781] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-29T18:11:09.998861] [INFO ] [MAIN ] Update Progress: 566/2367 symbols completed. CVI took 37.9s. Estimated remaining: 3h 46m 19s. Rate: 8.0 symbols/min [2025-10-29T18:11:09.996513] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-29T18:11:10.171356] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:11:10.205205] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-29T18:11:10.231987] [DEBUG] [LOCAL ] CW: Loaded 21599 existing records from primary storage. [2025-10-29T18:11:10.232230] [INFO ] [MAIN ] CW: Loaded 21599 existing records. [2025-10-29T18:11:10.405759] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:11:10.406001] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-29T18:11:10.406057] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-29T18:11:10.406269] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-29T18:11:10.406309] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-29T18:11:10.758815] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:10.793525] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-29T18:11:11.039558] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-29T18:11:11.395443] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T18:11:11.593551] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-29T18:11:11.693638] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:11:12.393576] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-29T18:11:13.193556] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-29T18:11:13.333371] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T18:11:13.332488] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-29T18:11:13.993556] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-29T18:11:14.750545] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-29T18:11:14.778334] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T18:11:14.793524] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-29T18:11:15.593551] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-29T18:11:16.393629] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-29T18:11:16.829101] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-29T18:11:16.840393] [INFO ] [REMOTE ] CVNA: Full fetch complete (76708 records). [2025-10-29T18:11:16.840556] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-29T18:11:17.240749] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-29T18:11:17.265498] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-29T18:11:17.266599] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-29T18:11:17.267717] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-29T18:11:17.267840] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-29T18:11:17.282532] [DEBUG] [LOCAL ] CVNA: Trimmed 76708 records to 52803 (keeping 200 days of data) [2025-10-29T18:11:17.287302] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T18:11:17.432766] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-29T18:11:17.659815] [DEBUG] [LOCAL ] CVNA: Primary data saved (52803 records). [2025-10-29T18:11:17.659945] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-29T18:11:17.660732] [INFO ] [MAIN ] Update Progress: 567/2367 symbols completed. CVNA took 36.6s. Estimated remaining: 3h 46m 12s. Rate: 8.0 symbols/min [2025-10-29T18:11:17.831445] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:11:17.883307] [DEBUG] [LOCAL ] CWAN: Loaded 52664 existing records from primary storage. [2025-10-29T18:11:17.883680] [INFO ] [MAIN ] CWAN: Loaded 52664 existing records. [2025-10-29T18:11:17.998726] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-29T18:11:18.067093] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:11:18.067991] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-29T18:11:18.068107] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-29T18:11:18.068755] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-29T18:11:18.068871] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-29T18:11:18.439135] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:18.793542] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-29T18:11:18.874095] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T18:11:19.129584] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-29T18:11:19.593580] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-29T18:11:20.057616] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T18:11:20.393694] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-29T18:11:21.196985] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-29T18:11:21.199619] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T18:11:21.286716] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-29T18:11:21.993568] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-29T18:11:22.605952] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T18:11:22.793608] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-29T18:11:23.155088] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T18:11:23.258836] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-29T18:11:23.270288] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-29T18:11:23.270423] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-29T18:11:23.598735] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-29T18:11:23.708665] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-29T18:11:23.708780] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-29T18:11:23.709772] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-29T18:11:23.709839] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-29T18:11:23.711335] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-29T18:11:24.055695] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-29T18:11:24.055878] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-29T18:11:24.055969] [INFO ] [MAIN ] Update Progress: 568/2367 symbols completed. CVS took 35.9s. Estimated remaining: 3h 46m 1s. Rate: 8.0 symbols/min [2025-10-29T18:11:24.230749] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:11:24.270809] [DEBUG] [LOCAL ] CWEN: Loaded 45068 existing records from primary storage. [2025-10-29T18:11:24.271117] [INFO ] [MAIN ] CWEN: Loaded 45068 existing records. [2025-10-29T18:11:24.398733] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-29T18:11:24.465758] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:11:24.466022] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-29T18:11:24.466073] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-29T18:11:24.466612] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-29T18:11:24.466698] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-29T18:11:24.847544] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:25.193536] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-29T18:11:25.233172] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-29T18:11:25.465627] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-29T18:11:25.993576] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-29T18:11:26.260329] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-29T18:11:26.746817] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T18:11:26.793518] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-29T18:11:27.473178] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T18:11:27.593595] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-29T18:11:28.393581] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-29T18:11:29.193607] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-29T18:11:29.516092] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-29T18:11:29.592496] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T18:11:29.993583] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-29T18:11:30.342615] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T18:11:30.348004] [INFO ] [REMOTE ] CW: Full fetch complete (32950 records). [2025-10-29T18:11:30.348271] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-29T18:11:30.747785] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-29T18:11:30.747894] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-29T18:11:30.748842] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-29T18:11:30.748909] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-29T18:11:30.749863] [DEBUG] [LOCAL ] CW: Trimmed 32950 records to 21666 (keeping 200 days of data) [2025-10-29T18:11:30.807036] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-29T18:11:30.905350] [DEBUG] [LOCAL ] CW: Primary data saved (21666 records). [2025-10-29T18:11:30.905624] [INFO ] [MAIN ] CW: Full history saved. [2025-10-29T18:11:30.905766] [INFO ] [MAIN ] Update Progress: 569/2367 symbols completed. CW took 20.9s. Estimated remaining: 3h 45m 51s. Rate: 8.0 symbols/min [2025-10-29T18:11:31.101882] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:11:31.153253] [DEBUG] [LOCAL ] CWH: Loaded 51203 existing records from primary storage. [2025-10-29T18:11:31.153590] [INFO ] [MAIN ] CWH: Loaded 51203 existing records. [2025-10-29T18:11:31.338764] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:11:31.339090] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-29T18:11:31.339164] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-29T18:11:31.339877] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-29T18:11:31.340008] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-29T18:11:31.588671] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-29T18:11:31.599819] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-29T18:11:31.783197] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:31.815220] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T18:11:32.393592] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-29T18:11:33.193620] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-29T18:11:33.273592] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-29T18:11:33.662152] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T18:11:33.993560] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-29T18:11:34.413271] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T18:11:34.793586] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-29T18:11:35.128559] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T18:11:35.593580] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-29T18:11:36.393634] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-29T18:11:36.783500] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-29T18:11:36.795500] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-29T18:11:36.795706] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-29T18:11:37.200697] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-29T18:11:37.226475] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-29T18:11:37.226625] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-29T18:11:37.228462] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-29T18:11:37.228585] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-29T18:11:37.252577] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-29T18:11:37.276707] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-29T18:11:37.647697] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T18:11:37.663046] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-29T18:11:37.663163] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-29T18:11:37.663279] [INFO ] [MAIN ] Update Progress: 570/2367 symbols completed. CVX took 38.4s. Estimated remaining: 3h 45m 41s. Rate: 8.0 symbols/min [2025-10-29T18:11:37.846425] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:11:37.846624] [DEBUG] [LOCAL ] CWK: No existing data file found in primary storage. [2025-10-29T18:11:37.846694] [WARN ] [MAIN ] CWK: No existing data found, performing full refresh instead. [2025-10-29T18:11:37.846830] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-29T18:11:37.846872] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-29T18:11:37.846913] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-29T18:11:37.846946] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-29T18:11:37.998721] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-29T18:11:38.226580] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:38.342236] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T18:11:38.793627] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-29T18:11:39.309137] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T18:11:39.593628] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-29T18:11:39.786039] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T18:11:40.393571] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-29T18:11:40.740986] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T18:11:41.193577] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-29T18:11:41.261875] [DEBUG] [REMOTE ] CWK: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-29T18:11:41.262173] [WARN ] [REMOTE ] CWK: No data returned for month 2025-02 [2025-10-29T18:11:41.262290] [FATAL] [REMOTE ] CWK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:11:41.262396] [FATAL] [MAIN ] CWK: Failed to fetch primary data. [2025-10-29T18:11:41.262466] [WARN ] [MAIN ] CWK: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:11:41.262539] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-29T18:11:41.262620] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-29T18:11:41.262726] [INFO ] [LOCAL ] CWK: Starting deletion of derivative data. [2025-10-29T18:11:41.262822] [DEBUG] [LOCAL ] CWK: No derivative data file found to delete. [2025-10-29T18:11:41.262904] [INFO ] [MAIN ] Update Progress: 571/2367 symbols completed. CWK took 3.6s. Estimated remaining: 3h 45m 21s. Rate: 8.0 symbols/min [2025-10-29T18:11:41.463086] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:11:41.491126] [DEBUG] [LOCAL ] CWT: Loaded 27707 existing records from primary storage. [2025-10-29T18:11:41.491407] [INFO ] [MAIN ] CWT: Loaded 27707 existing records. [2025-10-29T18:11:41.709575] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:11:41.709794] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-29T18:11:41.709996] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-29T18:11:41.710436] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-29T18:11:41.710505] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-29T18:11:41.885271] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T18:11:42.001201] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-29T18:11:42.182142] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:42.793566] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-29T18:11:43.203107] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T18:11:43.593542] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-29T18:11:44.095253] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T18:11:44.393584] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-29T18:11:44.559823] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T18:11:45.193564] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-29T18:11:45.993537] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-29T18:11:46.080171] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T18:11:46.799953] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-29T18:11:46.821499] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-29T18:11:47.202801] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T18:11:47.593563] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-29T18:11:48.127948] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T18:11:48.393582] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-29T18:11:49.008471] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T18:11:49.193560] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-29T18:11:49.874403] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T18:11:49.887434] [INFO ] [REMOTE ] CWAN: Full fetch complete (75641 records). [2025-10-29T18:11:49.887604] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-29T18:11:49.993932] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-29T18:11:50.307570] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T18:11:50.307797] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-29T18:11:50.313532] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-29T18:11:50.314968] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-29T18:11:50.315350] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-29T18:11:50.316780] [DEBUG] [LOCAL ] CWAN: Trimmed 75641 records to 52667 (keeping 200 days of data) [2025-10-29T18:11:50.622610] [DEBUG] [LOCAL ] CWAN: Primary data saved (52667 records). [2025-10-29T18:11:50.622763] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-29T18:11:50.623682] [INFO ] [MAIN ] Update Progress: 572/2367 symbols completed. CWAN took 33.0s. Estimated remaining: 3h 45m 20s. Rate: 8.0 symbols/min [2025-10-29T18:11:50.793862] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-29T18:11:50.795461] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:11:50.849725] [DEBUG] [LOCAL ] CX: Loaded 52770 existing records from primary storage. [2025-10-29T18:11:50.850108] [INFO ] [MAIN ] CX: Loaded 52770 existing records. [2025-10-29T18:11:51.064377] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:11:51.064632] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-29T18:11:51.064895] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-29T18:11:51.065189] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-29T18:11:51.065294] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-29T18:11:51.385115] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T18:11:51.476028] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:51.593583] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-29T18:11:51.757915] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-29T18:11:52.393565] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-29T18:11:52.578569] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-29T18:11:53.193622] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-29T18:11:53.655578] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T18:11:53.993593] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-29T18:11:54.462801] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-29T18:11:54.472763] [INFO ] [REMOTE ] CWEN: Full fetch complete (65709 records). [2025-10-29T18:11:54.472914] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-29T18:11:54.799514] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-29T18:11:54.859255] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-29T18:11:54.859466] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-29T18:11:54.860395] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-29T18:11:54.860485] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-29T18:11:54.877585] [DEBUG] [LOCAL ] CWEN: Trimmed 65709 records to 45066 (keeping 200 days of data) [2025-10-29T18:11:54.878814] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T18:11:55.143258] [DEBUG] [LOCAL ] CWEN: Primary data saved (45066 records). [2025-10-29T18:11:55.143377] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-29T18:11:55.143451] [INFO ] [MAIN ] Update Progress: 573/2367 symbols completed. CWEN took 31.1s. Estimated remaining: 3h 45m 3s. Rate: 8.0 symbols/min [2025-10-29T18:11:55.309764] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:11:55.318130] [DEBUG] [LOCAL ] CXE: Loaded 6302 existing records from primary storage. [2025-10-29T18:11:55.318314] [INFO ] [MAIN ] CXE: Loaded 6302 existing records. [2025-10-29T18:11:55.500452] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:11:55.500665] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-29T18:11:55.500727] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-29T18:11:55.500880] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-29T18:11:55.500919] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-29T18:11:55.598410] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-29T18:11:55.883751] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:11:55.921439] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T18:11:56.393618] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-29T18:11:56.825123] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:11:56.970367] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T18:11:57.193610] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-29T18:11:57.744964] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T18:11:57.993569] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-29T18:11:58.769470] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T18:11:58.793531] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-29T18:11:59.593560] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-29T18:12:00.054989] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T18:12:00.124818] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T18:12:00.393571] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-29T18:12:01.193556] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-29T18:12:01.532359] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T18:12:01.993586] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-29T18:12:02.480269] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T18:12:02.643009] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T18:12:02.793580] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-29T18:12:03.593597] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-29T18:12:04.032114] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T18:12:04.058008] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-29T18:12:04.393578] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-29T18:12:05.193567] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-29T18:12:05.652061] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-29T18:12:05.793422] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T18:12:05.804561] [INFO ] [REMOTE ] CWH: Full fetch complete (72904 records). [2025-10-29T18:12:05.804822] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-29T18:12:05.806078] [FATAL] [VALIDATOR ] CWH: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:12:05.806182] [FATAL] [MAIN ] CWH: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:12:05.806227] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:12:05.806273] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-29T18:12:05.806342] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-29T18:12:05.806382] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-10-29T18:12:05.806717] [DEBUG] [LOCAL ] CWH: Deleted derivative data file. [2025-10-29T18:12:05.806844] [INFO ] [MAIN ] Update Progress: 574/2367 symbols completed. CWH took 34.9s. Estimated remaining: 3h 45m 5s. Rate: 8.0 symbols/min [2025-10-29T18:12:05.988072] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:12:05.996522] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-29T18:12:05.997125] [DEBUG] [LOCAL ] CXH: Loaded 4335 existing records from primary storage. [2025-10-29T18:12:05.998452] [INFO ] [MAIN ] CXH: Loaded 4335 existing records. [2025-10-29T18:12:06.200066] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:12:06.200392] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-29T18:12:06.200450] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-29T18:12:06.200743] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-29T18:12:06.200806] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-29T18:12:06.586070] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:12:06.793541] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-29T18:12:06.855232] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-29T18:12:07.593551] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-29T18:12:08.141794] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-29T18:12:08.402316] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-29T18:12:08.427685] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-29T18:12:09.193550] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-29T18:12:09.395678] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T18:12:09.405684] [INFO ] [REMOTE ] CWT: Full fetch complete (41254 records). [2025-10-29T18:12:09.405881] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-29T18:12:09.808322] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-29T18:12:09.808428] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-29T18:12:09.809034] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-29T18:12:09.809095] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-29T18:12:09.810057] [DEBUG] [LOCAL ] CWT: Trimmed 41254 records to 27620 (keeping 200 days of data) [2025-10-29T18:12:09.971836] [DEBUG] [LOCAL ] CWT: Primary data saved (27620 records). [2025-10-29T18:12:09.972014] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-29T18:12:09.972106] [INFO ] [MAIN ] Update Progress: 575/2367 symbols completed. CWT took 28.7s. Estimated remaining: 3h 44m 47s. Rate: 8.0 symbols/min [2025-10-29T18:12:10.003872] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-29T18:12:10.152969] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:12:10.193727] [DEBUG] [LOCAL ] CXM: Loaded 47019 existing records from primary storage. [2025-10-29T18:12:10.194036] [INFO ] [MAIN ] CXM: Loaded 47019 existing records. [2025-10-29T18:12:10.374511] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:12:10.374916] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-29T18:12:10.378224] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-29T18:12:10.378398] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-29T18:12:10.379762] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-29T18:12:10.379835] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-29T18:12:10.736566] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:12:10.770384] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-29T18:12:10.793592] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-29T18:12:11.205173] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-29T18:12:11.593586] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-29T18:12:11.914561] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-29T18:12:12.393625] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-29T18:12:12.806003] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T18:12:13.193562] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-29T18:12:13.993611] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-29T18:12:14.228891] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T18:12:14.793581] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-29T18:12:15.287421] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T18:12:15.593705] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-29T18:12:15.724329] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-29T18:12:16.303819] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T18:12:16.393562] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-29T18:12:16.671291] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-29T18:12:17.193576] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-29T18:12:17.993568] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-29T18:12:18.605104] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T18:12:18.793605] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-29T18:12:19.219207] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:12:19.593544] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-29T18:12:19.988232] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T18:12:20.393587] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-29T18:12:20.726307] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T18:12:21.193593] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-29T18:12:21.692069] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T18:12:21.730743] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-29T18:12:21.735373] [INFO ] [REMOTE ] CXE: Full fetch complete (10942 records). [2025-10-29T18:12:21.735575] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-29T18:12:22.003125] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-29T18:12:22.310768] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-29T18:12:22.310880] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-29T18:12:22.311292] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-29T18:12:22.311348] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-29T18:12:22.312179] [DEBUG] [LOCAL ] CXE: Trimmed 10942 records to 6315 (keeping 200 days of data) [2025-10-29T18:12:22.373496] [DEBUG] [LOCAL ] CXE: Primary data saved (6315 records). [2025-10-29T18:12:22.373713] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-29T18:12:22.373842] [INFO ] [MAIN ] Update Progress: 576/2367 symbols completed. CXE took 27.2s. Estimated remaining: 3h 44m 54s. Rate: 8.0 symbols/min [2025-10-29T18:12:22.654294] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:12:22.682504] [DEBUG] [LOCAL ] CXT: Loaded 30366 existing records from primary storage. [2025-10-29T18:12:22.682851] [INFO ] [MAIN ] CXT: Loaded 30366 existing records. [2025-10-29T18:12:22.798683] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-29T18:12:22.889407] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:12:22.889661] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-29T18:12:22.889722] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-29T18:12:22.890247] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-29T18:12:22.890288] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-29T18:12:23.281376] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:12:23.306567] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:12:23.365271] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-29T18:12:23.593546] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-29T18:12:24.393579] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-29T18:12:24.980369] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T18:12:25.193536] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-29T18:12:25.322410] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T18:12:25.993576] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-29T18:12:26.340010] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T18:12:26.731826] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-29T18:12:26.793597] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-29T18:12:27.593707] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-29T18:12:28.130404] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T18:12:28.393688] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-29T18:12:28.717732] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T18:12:29.193634] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-29T18:12:29.481356] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T18:12:29.993565] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-29T18:12:30.248295] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T18:12:30.793550] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-29T18:12:30.824522] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T18:12:31.169960] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-29T18:12:31.593632] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-29T18:12:32.393547] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-29T18:12:32.564709] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-29T18:12:33.193587] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-29T18:12:33.669021] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T18:12:33.678555] [INFO ] [REMOTE ] CXM: Full fetch complete (67979 records). [2025-10-29T18:12:33.678763] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-29T18:12:33.679598] [FATAL] [VALIDATOR ] CXM: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:12:33.679716] [FATAL] [MAIN ] CXM: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:12:33.679759] [WARN ] [MAIN ] CXM: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:12:33.679799] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-29T18:12:33.679855] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-10-29T18:12:33.679894] [INFO ] [LOCAL ] CXM: Starting deletion of derivative data. [2025-10-29T18:12:33.680113] [DEBUG] [LOCAL ] CXM: Deleted derivative data file. [2025-10-29T18:12:33.680207] [INFO ] [MAIN ] Update Progress: 577/2367 symbols completed. CXM took 23.7s. Estimated remaining: 3h 44m 59s. Rate: 8.0 symbols/min [2025-10-29T18:12:33.852621] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:12:33.891313] [DEBUG] [LOCAL ] CXW: Loaded 43420 existing records from primary storage. [2025-10-29T18:12:33.891693] [INFO ] [MAIN ] CXW: Loaded 43420 existing records. [2025-10-29T18:12:34.002402] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-29T18:12:34.094879] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:12:34.095302] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-29T18:12:34.095396] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-29T18:12:34.096088] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-29T18:12:34.096150] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-29T18:12:34.391530] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T18:12:34.497938] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:12:34.793550] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-29T18:12:35.558807] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T18:12:35.574204] [INFO ] [REMOTE ] CX: Full fetch complete (76554 records). [2025-10-29T18:12:35.574499] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-29T18:12:35.598691] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-29T18:12:35.754562] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T18:12:36.002381] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-29T18:12:36.002489] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-29T18:12:36.003363] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-29T18:12:36.003426] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-29T18:12:36.004930] [DEBUG] [LOCAL ] CX: Trimmed 76554 records to 52765 (keeping 200 days of data) [2025-10-29T18:12:36.183765] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T18:12:36.318502] [DEBUG] [LOCAL ] CX: Primary data saved (52765 records). [2025-10-29T18:12:36.318635] [INFO ] [MAIN ] CX: Full history saved. [2025-10-29T18:12:36.319476] [INFO ] [MAIN ] Update Progress: 578/2367 symbols completed. CX took 45.7s. Estimated remaining: 3h 44m 36s. Rate: 8.0 symbols/min [2025-10-29T18:12:36.398764] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-29T18:12:36.492663] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:12:36.493342] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-29T18:12:36.493395] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-29T18:12:36.493505] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-29T18:12:36.493545] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-29T18:12:36.493585] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-29T18:12:36.493616] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-29T18:12:36.836797] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:12:37.193571] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-29T18:12:37.688010] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T18:12:37.689526] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-29T18:12:37.993583] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-29T18:12:38.373573] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-29T18:12:38.793597] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-29T18:12:39.593593] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-29T18:12:39.688344] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:12:40.190869] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T18:12:40.393620] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-29T18:12:41.193557] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-29T18:12:41.673727] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T18:12:41.988569] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-29T18:12:41.994865] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-29T18:12:42.793546] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-29T18:12:43.180179] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T18:12:43.593558] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-29T18:12:44.020189] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:12:44.393531] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-29T18:12:44.461744] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T18:12:44.468011] [INFO ] [REMOTE ] CXT: Full fetch complete (45225 records). [2025-10-29T18:12:44.468106] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-29T18:12:44.468692] [FATAL] [VALIDATOR ] CXT: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:12:44.468798] [FATAL] [MAIN ] CXT: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:12:44.468842] [WARN ] [MAIN ] CXT: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:12:44.468906] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-29T18:12:44.468966] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-10-29T18:12:44.469001] [INFO ] [LOCAL ] CXT: Starting deletion of derivative data. [2025-10-29T18:12:44.469185] [DEBUG] [LOCAL ] CXT: Deleted derivative data file. [2025-10-29T18:12:44.469273] [INFO ] [MAIN ] Update Progress: 579/2367 symbols completed. CXT took 22.1s. Estimated remaining: 3h 44m 30s. Rate: 8.0 symbols/min [2025-10-29T18:12:44.645204] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:12:44.688184] [DEBUG] [LOCAL ] CYH: Loaded 47632 existing records from primary storage. [2025-10-29T18:12:44.688495] [INFO ] [MAIN ] CYH: Loaded 47632 existing records. [2025-10-29T18:12:44.888692] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:12:44.888898] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-29T18:12:44.888947] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-29T18:12:44.889435] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-29T18:12:44.889493] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-29T18:12:45.199011] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-29T18:12:45.285714] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:12:45.303522] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-29T18:12:45.601138] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T18:12:45.993721] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-29T18:12:46.421496] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T18:12:46.422519] [INFO ] [REMOTE ] CXH: Full fetch complete (5303 records). [2025-10-29T18:12:46.422592] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-29T18:12:46.797532] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-29T18:12:46.822617] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-29T18:12:46.823427] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-29T18:12:46.823609] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-29T18:12:46.823700] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-29T18:12:46.824107] [DEBUG] [LOCAL ] CXH: Trimmed 5303 records to 4331 (keeping 200 days of data) [2025-10-29T18:12:46.849939] [DEBUG] [LOCAL ] CXH: Primary data saved (4331 records). [2025-10-29T18:12:46.850052] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-29T18:12:46.850129] [INFO ] [MAIN ] Update Progress: 580/2367 symbols completed. CXH took 41.0s. Estimated remaining: 3h 44m 7s. Rate: 8.0 symbols/min [2025-10-29T18:12:47.037766] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:12:47.085906] [DEBUG] [LOCAL ] D: Loaded 53648 existing records from primary storage. [2025-10-29T18:12:47.086198] [INFO ] [MAIN ] D: Loaded 53648 existing records. [2025-10-29T18:12:47.268358] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:12:47.268675] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-29T18:12:47.268735] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-29T18:12:47.269149] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-29T18:12:47.269208] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-29T18:12:47.598731] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-29T18:12:47.654038] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:12:48.148708] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T18:12:48.393615] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-29T18:12:48.752491] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T18:12:49.193555] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-29T18:12:49.736801] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T18:12:49.993528] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-29T18:12:50.170142] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-29T18:12:50.793557] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-29T18:12:51.059048] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T18:12:51.593619] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-29T18:12:51.919337] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:12:52.398633] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-29T18:12:52.407244] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-29T18:12:53.193561] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-29T18:12:53.688572] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T18:12:53.998637] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-29T18:12:54.010091] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T18:12:54.793564] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-29T18:12:55.259985] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T18:12:55.593552] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-29T18:12:55.863516] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T18:12:56.393614] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-29T18:12:57.042876] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T18:12:57.193573] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-29T18:12:57.501032] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-29T18:12:57.874017] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-29T18:12:57.993566] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-29T18:12:58.793560] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-29T18:12:59.364970] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T18:12:59.593570] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-29T18:13:00.007841] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T18:13:00.393570] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-29T18:13:00.887600] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T18:13:01.193580] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-29T18:13:01.347238] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-29T18:13:01.933309] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T18:13:01.993577] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-29T18:13:02.793566] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-29T18:13:03.163304] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T18:13:03.593579] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-29T18:13:04.012840] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T18:13:04.393555] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-29T18:13:04.787350] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T18:13:05.193567] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-29T18:13:05.471305] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-29T18:13:05.478258] [INFO ] [REMOTE ] CYD: Full fetch complete (36653 records). [2025-10-29T18:13:05.478384] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-29T18:13:05.478927] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:13:05.479028] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:13:05.479102] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:13:05.479198] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-29T18:13:05.479278] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-29T18:13:05.479317] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-29T18:13:05.479360] [DEBUG] [LOCAL ] CYD: No derivative data file found to delete. [2025-10-29T18:13:05.479415] [INFO ] [MAIN ] Update Progress: 581/2367 symbols completed. CYD took 29.2s. Estimated remaining: 3h 44m 33s. Rate: 8.0 symbols/min [2025-10-29T18:13:05.665346] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:05.679339] [DEBUG] [LOCAL ] DAC: Loaded 11883 existing records from primary storage. [2025-10-29T18:13:05.679563] [INFO ] [MAIN ] DAC: Loaded 11883 existing records. [2025-10-29T18:13:05.876262] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:13:05.876504] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-29T18:13:05.876563] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-29T18:13:05.876742] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-29T18:13:05.876797] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-29T18:13:05.998684] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-29T18:13:06.260146] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:06.288471] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T18:13:06.793537] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-29T18:13:07.457522] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T18:13:07.593527] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-29T18:13:07.619316] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-29T18:13:08.393555] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-29T18:13:09.061661] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T18:13:09.062570] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-29T18:13:09.193623] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-29T18:13:09.993636] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-29T18:13:10.645222] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-29T18:13:10.793583] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-29T18:13:11.329070] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T18:13:11.593621] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-29T18:13:12.324885] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T18:13:12.335018] [INFO ] [REMOTE ] CYH: Full fetch complete (70009 records). [2025-10-29T18:13:12.335148] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-29T18:13:12.398776] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-29T18:13:12.727588] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-29T18:13:12.727724] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-29T18:13:12.728702] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-29T18:13:12.728825] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-29T18:13:12.730277] [DEBUG] [LOCAL ] CYH: Trimmed 70009 records to 47644 (keeping 200 days of data) [2025-10-29T18:13:12.993987] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-29T18:13:13.052129] [DEBUG] [LOCAL ] CYH: Primary data saved (47644 records). [2025-10-29T18:13:13.052384] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-29T18:13:13.052533] [INFO ] [MAIN ] Update Progress: 582/2367 symbols completed. CYH took 28.6s. Estimated remaining: 3h 44m 26s. Rate: 8.0 symbols/min [2025-10-29T18:13:13.197724] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-29T18:13:13.204064] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-29T18:13:13.262191] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-29T18:13:13.292773] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:13.292995] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-29T18:13:13.685469] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-29T18:13:13.720096] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-29T18:13:13.867778] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-29T18:13:13.893860] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-29T18:13:13.899026] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-29T18:13:13.899670] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-29T18:13:13.979421] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:13:13.980272] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-29T18:13:13.980079] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 53648 (keeping 200 days of data) [2025-10-29T18:13:13.980576] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-29T18:13:13.981332] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-29T18:13:13.981396] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-29T18:13:14.049078] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-29T18:13:14.207004] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T18:13:14.657344] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:14.764298] [DEBUG] [LOCAL ] D: Primary data saved (53648 records). [2025-10-29T18:13:14.764432] [INFO ] [MAIN ] D: Full history saved. [2025-10-29T18:13:14.764512] [INFO ] [MAIN ] Update Progress: 583/2367 symbols completed. D took 27.9s. Estimated remaining: 3h 44m 1s. Rate: 8.0 symbols/min [2025-10-29T18:13:14.796257] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-29T18:13:14.934764] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:14.934930] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-29T18:13:14.934967] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-29T18:13:14.935098] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-29T18:13:14.935137] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-29T18:13:14.935177] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-29T18:13:14.935208] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-29T18:13:15.305627] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:15.360348] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T18:13:15.593569] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-29T18:13:16.388768] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-29T18:13:16.398887] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-29T18:13:16.947712] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T18:13:17.193565] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-29T18:13:17.484100] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T18:13:17.993576] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-29T18:13:18.169364] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T18:13:18.793580] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-29T18:13:19.330026] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T18:13:19.486636] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-29T18:13:19.593556] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-29T18:13:20.185177] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T18:13:20.393562] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-29T18:13:21.044146] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T18:13:21.193577] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-29T18:13:21.714904] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T18:13:21.993561] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-29T18:13:22.793600] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-29T18:13:23.234294] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T18:13:23.308368] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T18:13:23.593574] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-29T18:13:24.393569] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-29T18:13:25.050817] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T18:13:25.059917] [INFO ] [REMOTE ] CXW: Full fetch complete (64757 records). [2025-10-29T18:13:25.060067] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-29T18:13:25.198737] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-29T18:13:25.502684] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-29T18:13:25.502896] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-29T18:13:25.504185] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-29T18:13:25.504291] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-29T18:13:25.506189] [DEBUG] [LOCAL ] CXW: Trimmed 64757 records to 43431 (keeping 200 days of data) [2025-10-29T18:13:25.760815] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T18:13:25.805363] [DEBUG] [LOCAL ] CXW: Primary data saved (43431 records). [2025-10-29T18:13:25.805492] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-29T18:13:25.805570] [INFO ] [MAIN ] Update Progress: 584/2367 symbols completed. CXW took 52.1s. Estimated remaining: 3h 44m 4s. Rate: 8.0 symbols/min [2025-10-29T18:13:25.972771] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:25.990700] [DEBUG] [LOCAL ] DAO: Loaded 19584 existing records from primary storage. [2025-10-29T18:13:25.990949] [INFO ] [MAIN ] DAO: Loaded 19584 existing records. [2025-10-29T18:13:26.002157] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-29T18:13:26.175023] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:13:26.175237] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-29T18:13:26.175287] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-29T18:13:26.175549] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-29T18:13:26.175621] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-29T18:13:26.519037] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:26.793605] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-29T18:13:26.966362] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-29T18:13:27.229854] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T18:13:27.297820] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-29T18:13:27.593594] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-29T18:13:28.393584] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-29T18:13:29.134076] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-29T18:13:29.193527] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-29T18:13:29.400857] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-29T18:13:29.993530] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-29T18:13:30.045709] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T18:13:30.793560] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-29T18:13:30.829054] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-29T18:13:30.833174] [INFO ] [REMOTE ] DAC: Full fetch complete (18740 records). [2025-10-29T18:13:30.833269] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-29T18:13:31.203012] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-29T18:13:31.203117] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-29T18:13:31.203529] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-29T18:13:31.203571] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-29T18:13:31.204197] [DEBUG] [LOCAL ] DAC: Trimmed 18740 records to 11817 (keeping 200 days of data) [2025-10-29T18:13:31.278814] [DEBUG] [LOCAL ] DAC: Primary data saved (11817 records). [2025-10-29T18:13:31.278950] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-29T18:13:31.279047] [INFO ] [MAIN ] Update Progress: 585/2367 symbols completed. DAC took 25.8s. Estimated remaining: 3h 43m 50s. Rate: 8.0 symbols/min [2025-10-29T18:13:31.465363] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:31.518504] [DEBUG] [LOCAL ] DAR: Loaded 51973 existing records from primary storage. [2025-10-29T18:13:31.518870] [INFO ] [MAIN ] DAR: Loaded 51973 existing records. [2025-10-29T18:13:31.603302] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-29T18:13:31.724886] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:13:31.725145] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-29T18:13:31.725195] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-29T18:13:31.725696] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-29T18:13:31.725755] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-29T18:13:32.137272] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:32.164516] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-29T18:13:32.393554] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-29T18:13:32.441015] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-29T18:13:33.193592] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-29T18:13:33.547041] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T18:13:33.935692] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-29T18:13:33.993518] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-29T18:13:34.675128] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-29T18:13:34.793546] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-29T18:13:35.593549] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-29T18:13:36.163543] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T18:13:36.393562] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-29T18:13:36.623561] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T18:13:36.968483] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-29T18:13:37.193572] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-29T18:13:37.727557] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T18:13:37.993592] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-29T18:13:38.793620] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-29T18:13:39.233601] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T18:13:39.593579] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-29T18:13:40.087404] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T18:13:40.393701] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-29T18:13:40.928768] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T18:13:40.939495] [INFO ] [REMOTE ] DAN: Full fetch complete (71477 records). [2025-10-29T18:13:40.939662] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-29T18:13:41.198736] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-29T18:13:41.287632] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:13:41.362963] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-29T18:13:41.363045] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-29T18:13:41.363986] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-29T18:13:41.364049] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-29T18:13:41.365336] [DEBUG] [LOCAL ] DAN: Trimmed 71477 records to 49322 (keeping 200 days of data) [2025-10-29T18:13:41.656565] [DEBUG] [LOCAL ] DAN: Primary data saved (49322 records). [2025-10-29T18:13:41.656863] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-29T18:13:41.656942] [INFO ] [MAIN ] Update Progress: 586/2367 symbols completed. DAN took 26.9s. Estimated remaining: 3h 43m 51s. Rate: 8.0 symbols/min [2025-10-29T18:13:41.856160] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:41.894873] [DEBUG] [LOCAL ] DAVA: Loaded 41936 existing records from primary storage. [2025-10-29T18:13:41.895142] [INFO ] [MAIN ] DAVA: Loaded 41936 existing records. [2025-10-29T18:13:41.998802] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-29T18:13:42.074621] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:13:42.074846] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-29T18:13:42.074894] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-29T18:13:42.075290] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-29T18:13:42.075351] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-29T18:13:42.425043] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:42.793623] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-29T18:13:42.853775] [DEBUG] [REMOTE ] DAVA: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-29T18:13:42.854244] [WARN ] [REMOTE ] DAVA: No data returned for month 2025-01 [2025-10-29T18:13:42.854348] [FATAL] [REMOTE ] DAVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:13:42.854442] [FATAL] [MAIN ] DAVA: Failed to fetch primary data. [2025-10-29T18:13:42.854514] [WARN ] [MAIN ] DAVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:13:42.854598] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-29T18:13:42.854738] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-29T18:13:42.854789] [INFO ] [LOCAL ] DAVA: Starting deletion of derivative data. [2025-10-29T18:13:42.854975] [DEBUG] [LOCAL ] DAVA: Deleted derivative data file. [2025-10-29T18:13:42.855069] [INFO ] [MAIN ] Update Progress: 587/2367 symbols completed. DAVA took 1.2s. Estimated remaining: 3h 43m 24s. Rate: 8.0 symbols/min [2025-10-29T18:13:43.076497] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:43.111338] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-29T18:13:43.152991] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T18:13:43.206165] [DEBUG] [LOCAL ] DAY: Loaded 49049 existing records from primary storage. [2025-10-29T18:13:43.206592] [INFO ] [MAIN ] DAY: Loaded 49049 existing records. [2025-10-29T18:13:43.420048] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:13:43.420361] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-29T18:13:43.420416] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-29T18:13:43.420900] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-29T18:13:43.420959] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-29T18:13:43.593820] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-29T18:13:43.830537] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:44.393532] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-29T18:13:45.128770] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-29T18:13:45.192312] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-29T18:13:45.194672] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-29T18:13:45.993637] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-29T18:13:46.480538] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T18:13:46.793554] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-29T18:13:47.211892] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T18:13:47.593603] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-29T18:13:48.393627] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-29T18:13:48.570629] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-29T18:13:48.600939] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T18:13:48.606391] [INFO ] [REMOTE ] DAO: Full fetch complete (32856 records). [2025-10-29T18:13:48.606496] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-29T18:13:48.977515] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-29T18:13:48.977594] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-29T18:13:48.978205] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-29T18:13:48.978267] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-29T18:13:48.979068] [DEBUG] [LOCAL ] DAO: Trimmed 32856 records to 19601 (keeping 200 days of data) [2025-10-29T18:13:49.085244] [DEBUG] [LOCAL ] DAO: Primary data saved (19601 records). [2025-10-29T18:13:49.085386] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-29T18:13:49.085464] [INFO ] [MAIN ] Update Progress: 588/2367 symbols completed. DAO took 23.3s. Estimated remaining: 3h 43m 13s. Rate: 8.0 symbols/min [2025-10-29T18:13:49.198721] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-29T18:13:49.256674] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:49.304614] [DEBUG] [LOCAL ] DB: Loaded 52388 existing records from primary storage. [2025-10-29T18:13:49.304939] [INFO ] [MAIN ] DB: Loaded 52388 existing records. [2025-10-29T18:13:49.483847] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:13:49.484157] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-29T18:13:49.484315] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-29T18:13:49.484718] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-29T18:13:49.484829] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-29T18:13:49.683960] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T18:13:49.874013] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:49.993530] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-29T18:13:50.793582] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-29T18:13:50.832482] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-29T18:13:51.393368] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-29T18:13:51.593588] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-29T18:13:52.107469] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T18:13:52.393571] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-29T18:13:52.707016] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T18:13:53.193572] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-29T18:13:53.993538] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-29T18:13:54.266580] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-29T18:13:54.414142] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T18:13:54.793596] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-29T18:13:55.093325] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T18:13:55.593590] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-29T18:13:55.892036] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T18:13:56.242685] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-29T18:13:56.256594] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-29T18:13:56.256859] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-29T18:13:56.398721] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-29T18:13:56.646628] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-29T18:13:56.646727] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-29T18:13:56.647613] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-29T18:13:56.647680] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-29T18:13:56.649037] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 53753 (keeping 200 days of data) [2025-10-29T18:13:56.962872] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-29T18:13:56.962992] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-29T18:13:56.963066] [INFO ] [MAIN ] Update Progress: 589/2367 symbols completed. DAL took 43.9s. Estimated remaining: 3h 43m 6s. Rate: 8.0 symbols/min [2025-10-29T18:13:57.129911] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:13:57.130066] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-29T18:13:57.130102] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-29T18:13:57.130203] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-29T18:13:57.130243] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-29T18:13:57.130282] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-29T18:13:57.130315] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-29T18:13:57.198790] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-29T18:13:57.482874] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:13:57.719295] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T18:13:57.993572] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-29T18:13:58.539968] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T18:13:58.793577] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-29T18:13:59.599061] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-29T18:13:59.627720] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-29T18:14:00.131299] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T18:14:00.177349] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T18:14:00.393569] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-29T18:14:01.193563] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-29T18:14:01.999832] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-29T18:14:02.006366] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-29T18:14:02.387696] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T18:14:02.601328] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-29T18:14:02.793552] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-29T18:14:03.593589] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-29T18:14:04.393585] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-29T18:14:04.477759] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-29T18:14:04.965206] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-29T18:14:05.193513] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-29T18:14:05.688621] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T18:14:05.993577] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-29T18:14:06.360118] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T18:14:06.793614] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-29T18:14:07.524413] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-29T18:14:07.551916] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T18:14:07.593545] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-29T18:14:08.185263] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-29T18:14:08.393564] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-29T18:14:09.068063] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T18:14:09.193623] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-29T18:14:09.993568] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-29T18:14:10.714600] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T18:14:10.726599] [INFO ] [REMOTE ] DAR: Full fetch complete (75206 records). [2025-10-29T18:14:10.726884] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-29T18:14:10.798820] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-29T18:14:11.140801] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-29T18:14:11.140908] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-29T18:14:11.142375] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-29T18:14:11.142457] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-29T18:14:11.144694] [DEBUG] [LOCAL ] DAR: Trimmed 75206 records to 51972 (keeping 200 days of data) [2025-10-29T18:14:11.511156] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-29T18:14:11.539949] [DEBUG] [LOCAL ] DAR: Primary data saved (51972 records). [2025-10-29T18:14:11.540070] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-29T18:14:11.540791] [INFO ] [MAIN ] Update Progress: 590/2367 symbols completed. DAR took 40.3s. Estimated remaining: 3h 43m 20s. Rate: 8.0 symbols/min [2025-10-29T18:14:11.603606] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-29T18:14:11.780328] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:14:11.821060] [DEBUG] [LOCAL ] DBI: Loaded 42870 existing records from primary storage. [2025-10-29T18:14:11.821520] [INFO ] [MAIN ] DBI: Loaded 42870 existing records. [2025-10-29T18:14:12.018628] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:14:12.019087] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-29T18:14:12.019161] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-29T18:14:12.019491] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-29T18:14:12.019532] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-29T18:14:12.334253] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T18:14:12.402044] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-29T18:14:12.421338] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:14:12.394994] [INFO ] [REMOTE ] DAY: Full fetch complete (71959 records). [2025-10-29T18:14:12.422300] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-29T18:14:12.812025] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-29T18:14:12.812111] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-29T18:14:12.812991] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-29T18:14:12.813055] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-29T18:14:12.814446] [DEBUG] [LOCAL ] DAY: Trimmed 71959 records to 49072 (keeping 200 days of data) [2025-10-29T18:14:13.128065] [DEBUG] [LOCAL ] DAY: Primary data saved (49072 records). [2025-10-29T18:14:13.131140] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-29T18:14:13.131252] [INFO ] [MAIN ] Update Progress: 591/2367 symbols completed. DAY took 30.3s. Estimated remaining: 3h 42m 55s. Rate: 8.0 symbols/min [2025-10-29T18:14:13.175567] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-29T18:14:13.196412] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-29T18:14:13.321781] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:14:13.337856] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-29T18:14:13.350219] [DEBUG] [LOCAL ] DBL: Loaded 9211 existing records from primary storage. [2025-10-29T18:14:13.350386] [INFO ] [MAIN ] DBL: Loaded 9211 existing records. [2025-10-29T18:14:13.537443] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:14:13.537684] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-29T18:14:13.537747] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-29T18:14:13.537940] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-29T18:14:13.538011] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-29T18:14:13.965294] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:14:13.993535] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-29T18:14:14.558564] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T18:14:14.573475] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T18:14:14.793612] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-29T18:14:15.209764] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-29T18:14:15.593639] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-29T18:14:16.398302] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-29T18:14:16.405943] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T18:14:16.798537] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T18:14:17.193581] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-29T18:14:17.993590] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-29T18:14:18.793707] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-29T18:14:18.860774] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-29T18:14:19.116543] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T18:14:19.310472] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-29T18:14:19.593573] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-29T18:14:20.277303] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T18:14:20.393710] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-29T18:14:21.146629] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T18:14:21.193531] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-29T18:14:21.994289] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-29T18:14:21.997594] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T18:14:22.003742] [INFO ] [REMOTE ] DBD: Full fetch complete (32234 records). [2025-10-29T18:14:22.003865] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-29T18:14:22.004690] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:14:22.004812] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:14:22.004883] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:14:22.005292] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-29T18:14:22.005487] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-29T18:14:22.005548] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-29T18:14:22.005632] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-29T18:14:22.005798] [INFO ] [MAIN ] Update Progress: 592/2367 symbols completed. DBD took 25.0s. Estimated remaining: 3h 42m 51s. Rate: 8.0 symbols/min [2025-10-29T18:14:22.172403] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:14:22.215004] [DEBUG] [LOCAL ] DBRG: Loaded 49956 existing records from primary storage. [2025-10-29T18:14:22.215311] [INFO ] [MAIN ] DBRG: Loaded 49956 existing records. [2025-10-29T18:14:22.394844] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:14:22.395085] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-29T18:14:22.395214] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-29T18:14:22.395710] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-29T18:14:22.395806] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-29T18:14:22.501497] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-29T18:14:22.751179] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:14:22.793524] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-29T18:14:23.593576] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-29T18:14:24.177613] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T18:14:24.178052] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-29T18:14:24.393577] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-29T18:14:25.193574] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-29T18:14:25.717178] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T18:14:25.993583] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-29T18:14:26.175744] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T18:14:26.793568] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-29T18:14:27.351012] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T18:14:27.518888] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-29T18:14:27.593538] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-29T18:14:28.235480] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T18:14:28.393558] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-29T18:14:29.096296] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T18:14:29.193559] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-29T18:14:29.782992] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T18:14:29.785171] [INFO ] [REMOTE ] DBL: Full fetch complete (12710 records). [2025-10-29T18:14:29.785242] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-29T18:14:29.998761] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-29T18:14:30.169113] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-29T18:14:30.169187] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-29T18:14:30.169476] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-29T18:14:30.169513] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-29T18:14:30.169996] [DEBUG] [LOCAL ] DBL: Trimmed 12710 records to 9191 (keeping 200 days of data) [2025-10-29T18:14:30.224245] [DEBUG] [LOCAL ] DBL: Primary data saved (9191 records). [2025-10-29T18:14:30.224368] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-29T18:14:30.224441] [INFO ] [MAIN ] Update Progress: 593/2367 symbols completed. DBL took 17.1s. Estimated remaining: 3h 42m 46s. Rate: 8.0 symbols/min [2025-10-29T18:14:30.393798] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:14:30.393984] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-29T18:14:30.394020] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-29T18:14:30.394129] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-29T18:14:30.394169] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-29T18:14:30.394209] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-29T18:14:30.394240] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-29T18:14:30.755160] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:14:30.793533] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-29T18:14:31.593581] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-29T18:14:31.666628] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-29T18:14:31.678834] [INFO ] [REMOTE ] DB: Full fetch complete (75771 records). [2025-10-29T18:14:31.679048] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-29T18:14:32.092960] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-29T18:14:32.093104] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-29T18:14:32.094076] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-29T18:14:32.094192] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-29T18:14:32.122853] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T18:14:32.121761] [DEBUG] [LOCAL ] DB: Trimmed 75771 records to 52384 (keeping 200 days of data) [2025-10-29T18:14:32.399183] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-29T18:14:32.444743] [DEBUG] [LOCAL ] DB: Primary data saved (52384 records). [2025-10-29T18:14:32.444884] [INFO ] [MAIN ] DB: Full history saved. [2025-10-29T18:14:32.444963] [INFO ] [MAIN ] Update Progress: 594/2367 symbols completed. DB took 43.4s. Estimated remaining: 3h 42m 22s. Rate: 8.0 symbols/min [2025-10-29T18:14:32.625333] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:14:32.625560] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-29T18:14:32.625725] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-29T18:14:32.626033] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-29T18:14:32.626144] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-29T18:14:32.626778] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-29T18:14:32.627010] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-29T18:14:32.720220] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T18:14:33.044070] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:14:33.193538] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-29T18:14:33.681661] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T18:14:33.700964] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-29T18:14:33.993591] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-29T18:14:34.493676] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T18:14:34.793575] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-29T18:14:35.593570] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-29T18:14:36.077531] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T18:14:36.100312] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T18:14:36.393579] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-29T18:14:37.193592] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-29T18:14:37.666197] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T18:14:37.993595] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-29T18:14:38.067194] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T18:14:38.504516] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T18:14:38.793551] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-29T18:14:39.593574] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-29T18:14:39.975587] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T18:14:40.009011] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-29T18:14:40.393561] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-29T18:14:41.193559] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-29T18:14:41.668435] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T18:14:41.750436] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-29T18:14:41.993566] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-29T18:14:42.793557] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-29T18:14:43.120963] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T18:14:43.461281] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-29T18:14:43.593563] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-29T18:14:44.306193] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T18:14:44.393602] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-29T18:14:45.193614] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-29T18:14:45.496042] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-29T18:14:45.870608] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T18:14:45.993572] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-29T18:14:46.735584] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-29T18:14:46.739831] [INFO ] [REMOTE ] DCO: Full fetch complete (19884 records). [2025-10-29T18:14:46.739918] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-29T18:14:46.740325] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:14:46.740403] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:14:46.740444] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:14:46.740508] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-29T18:14:46.740566] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-29T18:14:46.740600] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-29T18:14:46.740637] [DEBUG] [LOCAL ] DCO: No derivative data file found to delete. [2025-10-29T18:14:46.740730] [INFO ] [MAIN ] Update Progress: 595/2367 symbols completed. DCO took 14.3s. Estimated remaining: 3h 42m 35s. Rate: 8.0 symbols/min [2025-10-29T18:14:46.798821] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-29T18:14:46.933993] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:14:46.991940] [DEBUG] [LOCAL ] DD: Loaded 52906 existing records from primary storage. [2025-10-29T18:14:46.992417] [INFO ] [MAIN ] DD: Loaded 52906 existing records. [2025-10-29T18:14:47.194742] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:14:47.195102] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-29T18:14:47.195163] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-29T18:14:47.195878] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-29T18:14:47.195943] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-29T18:14:47.573246] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:14:47.593535] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-29T18:14:47.945697] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T18:14:48.393574] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-29T18:14:48.978784] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T18:14:49.193574] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-29T18:14:49.463425] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T18:14:49.993569] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-29T18:14:50.491116] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T18:14:50.793528] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-29T18:14:51.181976] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:14:51.593564] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-29T18:14:51.830387] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-29T18:14:52.393603] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-29T18:14:52.893851] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T18:14:53.193557] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-29T18:14:53.528330] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T18:14:53.993541] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-29T18:14:54.418521] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T18:14:54.793582] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-29T18:14:55.507308] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T18:14:55.593521] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-29T18:14:55.843696] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-29T18:14:56.393566] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-29T18:14:56.870260] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T18:14:57.193564] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-29T18:14:57.457902] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T18:14:57.465635] [INFO ] [REMOTE ] DBI: Full fetch complete (64373 records). [2025-10-29T18:14:57.465817] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-29T18:14:57.859840] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-29T18:14:57.859915] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-29T18:14:57.860735] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-29T18:14:57.860797] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-29T18:14:57.861978] [DEBUG] [LOCAL ] DBI: Trimmed 64373 records to 42869 (keeping 200 days of data) [2025-10-29T18:14:58.022301] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-29T18:14:58.106985] [DEBUG] [LOCAL ] DBI: Primary data saved (42869 records). [2025-10-29T18:14:58.107141] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-29T18:14:58.107933] [INFO ] [MAIN ] Update Progress: 596/2367 symbols completed. DBI took 46.6s. Estimated remaining: 3h 42m 39s. Rate: 8.0 symbols/min [2025-10-29T18:14:58.304594] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:14:58.337544] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T18:14:58.390891] [DEBUG] [LOCAL ] DDD: Loaded 50922 existing records from primary storage. [2025-10-29T18:14:58.391199] [INFO ] [MAIN ] DDD: Loaded 50922 existing records. [2025-10-29T18:14:58.572886] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:14:58.573137] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-29T18:14:58.573183] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-29T18:14:58.573411] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-29T18:14:58.573466] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-29T18:14:58.802169] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-29T18:14:58.927123] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:14:59.163688] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T18:14:59.593550] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-29T18:15:00.203508] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T18:15:00.393581] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-29T18:15:00.867725] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:15:01.193563] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-29T18:15:01.923725] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-29T18:15:01.993549] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-29T18:15:02.793550] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-29T18:15:02.832912] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T18:15:02.843624] [INFO ] [REMOTE ] DBRG: Full fetch complete (72294 records). [2025-10-29T18:15:02.843880] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-29T18:15:02.844817] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:15:02.844930] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:15:02.844975] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:15:02.845054] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-29T18:15:02.845122] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-29T18:15:02.845159] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-10-29T18:15:02.845354] [DEBUG] [LOCAL ] DBRG: Deleted derivative data file. [2025-10-29T18:15:02.845454] [INFO ] [MAIN ] Update Progress: 597/2367 symbols completed. DBRG took 40.8s. Estimated remaining: 3h 42m 23s. Rate: 8.0 symbols/min [2025-10-29T18:15:03.331349] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T18:15:03.593619] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-29T18:15:03.880637] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T18:15:04.393714] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-29T18:15:05.194041] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-29T18:15:05.207482] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-29T18:15:05.922468] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-29T18:15:05.993722] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-29T18:15:06.484077] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T18:15:06.793601] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-29T18:15:07.223108] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:15:07.408461] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-29T18:15:07.421613] [INFO ] [REMOTE ] DD: Full fetch complete (76631 records). [2025-10-29T18:15:07.421860] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-29T18:15:07.604533] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-29T18:15:07.830070] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-29T18:15:07.830161] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-29T18:15:07.831074] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-29T18:15:07.831141] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-29T18:15:07.832629] [DEBUG] [LOCAL ] DD: Trimmed 76631 records to 52905 (keeping 200 days of data) [2025-10-29T18:15:08.149996] [DEBUG] [LOCAL ] DD: Primary data saved (52905 records). [2025-10-29T18:15:08.150137] [INFO ] [MAIN ] DD: Full history saved. [2025-10-29T18:15:08.150218] [INFO ] [MAIN ] Update Progress: 598/2367 symbols completed. DD took 21.4s. Estimated remaining: 3h 42m 9s. Rate: 8.0 symbols/min [2025-10-29T18:15:08.393637] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-29T18:15:08.977626] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T18:15:09.193628] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-29T18:15:09.920077] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T18:15:09.993563] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-29T18:15:10.442750] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T18:15:10.450383] [INFO ] [REMOTE ] DCI: Full fetch complete (53803 records). [2025-10-29T18:15:10.450505] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-29T18:15:10.843235] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-29T18:15:10.843335] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-29T18:15:10.844055] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-29T18:15:10.844116] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-29T18:15:10.845233] [DEBUG] [LOCAL ] DCI: Trimmed 53803 records to 36552 (keeping 200 days of data) [2025-10-29T18:15:11.060504] [DEBUG] [LOCAL ] DCI: Primary data saved (36552 records). [2025-10-29T18:15:11.060664] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-29T18:15:11.060754] [INFO ] [MAIN ] Update Progress: 599/2367 symbols completed. DCI took 40.8s. Estimated remaining: 3h 41m 48s. Rate: 8.0 symbols/min [2025-10-29T18:15:11.352318] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-29T18:15:11.363605] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-29T18:15:12.784368] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T18:15:12.795202] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-29T18:15:14.466244] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-29T18:15:14.477428] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-29T18:15:16.078062] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-29T18:15:16.088871] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-29T18:15:17.588989] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-29T18:15:17.601995] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-29T18:15:19.318280] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-29T18:15:19.329627] [INFO ] [REMOTE ] DDD: Full fetch complete (74022 records). [2025-10-29T18:15:19.329805] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-29T18:15:19.717481] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-29T18:15:19.717588] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-29T18:15:19.718482] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-29T18:15:19.718546] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-29T18:15:19.719951] [DEBUG] [LOCAL ] DDD: Trimmed 74022 records to 50923 (keeping 200 days of data) [2025-10-29T18:15:20.005449] [DEBUG] [LOCAL ] DDD: Primary data saved (50923 records). [2025-10-29T18:15:20.005599] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-29T18:15:20.005771] [INFO ] [MAIN ] Update Progress: 600/2367 symbols completed. DDD took 21.9s. Estimated remaining: 3h 41m 44s. Rate: 8.0 symbols/min [2025-10-29T18:15:20.670340] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:15:20.646810] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:15:20.711587] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:15:20.758694] [DEBUG] [LOCAL ] DDT: Loaded 1781 existing records from primary storage. [2025-10-29T18:15:20.778277] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:15:20.781500] [INFO ] [MAIN ] DDT: Loaded 1781 existing records. [2025-10-29T18:15:20.822931] [DEBUG] [LOCAL ] DDS: Loaded 11887 existing records from primary storage. [2025-10-29T18:15:20.850556] [INFO ] [MAIN ] DDS: Loaded 11887 existing records. [2025-10-29T18:15:21.119760] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:15:21.147947] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-29T18:15:21.181255] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-29T18:15:21.181950] [DEBUG] [LOCAL ] DE: Loaded 47337 existing records from primary storage. [2025-10-29T18:15:21.228582] [INFO ] [MAIN ] DE: Loaded 47337 existing records. [2025-10-29T18:15:21.228459] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:15:21.234226] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-29T18:15:21.250004] [DEBUG] [LOCAL ] DDL: Loaded 37084 existing records from primary storage. [2025-10-29T18:15:21.249122] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-29T18:15:21.228969] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-29T18:15:21.261063] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-29T18:15:21.306096] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-29T18:15:21.306024] [INFO ] [MAIN ] DDL: Loaded 37084 existing records. [2025-10-29T18:15:21.341776] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-29T18:15:21.855988] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:15:21.951665] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:15:21.902483] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-29T18:15:21.976454] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-29T18:15:21.976604] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-29T18:15:22.008874] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-29T18:15:22.030053] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-29T18:15:22.045225] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-29T18:15:22.055595] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-29T18:15:22.152051] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-29T18:15:22.578177] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:15:22.683581] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:15:22.726313] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-29T18:15:22.716856] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-29T18:15:23.153577] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:15:23.173523] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-29T18:15:23.173301] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:15:23.174510] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-29T18:15:23.321236] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T18:15:23.322287] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-29T18:15:23.434877] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T18:15:23.437863] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-29T18:15:23.657830] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-29T18:15:23.658883] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-29T18:15:23.952800] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-29T18:15:23.953959] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-29T18:15:24.057595] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T18:15:24.064447] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-29T18:15:24.112240] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-29T18:15:24.115255] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-29T18:15:24.304784] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-29T18:15:24.306279] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-29T18:15:24.504313] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T18:15:24.514775] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-29T18:15:24.701523] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-29T18:15:24.702530] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-29T18:15:25.109039] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T18:15:25.193530] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-29T18:15:25.206679] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-29T18:15:25.230148] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T18:15:25.993522] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-29T18:15:26.091482] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-29T18:15:26.215670] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-29T18:15:26.793573] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-29T18:15:27.144012] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-29T18:15:27.170524] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T18:15:27.593617] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-29T18:15:28.393623] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-29T18:15:28.927232] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T18:15:29.193582] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-29T18:15:29.653672] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T18:15:29.993606] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-29T18:15:30.554586] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T18:15:30.793574] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-29T18:15:31.286959] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T18:15:31.593597] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-29T18:15:32.137936] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T18:15:32.225892] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T18:15:32.393602] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-29T18:15:32.695046] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-29T18:15:33.193535] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-29T18:15:33.619674] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-29T18:15:33.993563] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-29T18:15:34.522629] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T18:15:34.523516] [INFO ] [REMOTE ] DDT: Full fetch complete (2800 records). [2025-10-29T18:15:34.523580] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-29T18:15:34.523958] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:15:34.524040] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:15:34.524081] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:15:34.524122] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-29T18:15:34.524217] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-29T18:15:34.524270] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-29T18:15:34.524440] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-10-29T18:15:34.524531] [INFO ] [MAIN ] Update Progress: 601/2367 symbols completed. DDT took 14.5s. Estimated remaining: 3h 41m 57s. Rate: 8.0 symbols/min [2025-10-29T18:15:34.697236] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:15:34.733256] [DEBUG] [LOCAL ] DEA: Loaded 39679 existing records from primary storage. [2025-10-29T18:15:34.733536] [INFO ] [MAIN ] DEA: Loaded 39679 existing records. [2025-10-29T18:15:34.798762] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-29T18:15:34.911471] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:15:34.911713] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-29T18:15:34.911771] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-29T18:15:34.912032] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-29T18:15:34.912072] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-29T18:15:35.259948] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:15:35.593669] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-29T18:15:35.799352] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T18:15:36.393569] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-29T18:15:36.957006] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-29T18:15:37.193538] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-29T18:15:37.228263] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-29T18:15:37.993590] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-29T18:15:38.586172] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T18:15:38.672593] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T18:15:38.793685] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-29T18:15:39.593569] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-29T18:15:39.764682] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T18:15:40.171231] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-29T18:15:40.393566] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-29T18:15:41.193558] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-29T18:15:41.519208] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T18:15:41.993702] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-29T18:15:42.388945] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T18:15:42.793589] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-29T18:15:43.484630] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-29T18:15:43.538866] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T18:15:43.593613] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-29T18:15:44.393569] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-29T18:15:44.944148] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T18:15:44.954117] [INFO ] [REMOTE ] DDL: Full fetch complete (54041 records). [2025-10-29T18:15:44.954264] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-29T18:15:45.199503] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-29T18:15:45.214215] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T18:15:45.388062] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-29T18:15:45.388145] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-29T18:15:45.388857] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-29T18:15:45.388922] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-29T18:15:45.390094] [DEBUG] [LOCAL ] DDL: Trimmed 54041 records to 37085 (keeping 200 days of data) [2025-10-29T18:15:45.590938] [DEBUG] [LOCAL ] DDL: Primary data saved (37085 records). [2025-10-29T18:15:45.591083] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-29T18:15:45.591163] [INFO ] [MAIN ] Update Progress: 602/2367 symbols completed. DDL took 25.6s. Estimated remaining: 3h 42m 0s. Rate: 8.0 symbols/min [2025-10-29T18:15:45.756421] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:15:45.756613] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-29T18:15:45.756680] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-29T18:15:45.756800] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-29T18:15:45.756858] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-29T18:15:45.756899] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-29T18:15:45.756929] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-29T18:15:46.004211] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-29T18:15:46.132990] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:15:46.607972] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T18:15:46.681261] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-29T18:15:46.683380] [INFO ] [REMOTE ] DDS: Full fetch complete (18046 records). [2025-10-29T18:15:46.683468] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-29T18:15:46.683940] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:15:46.684057] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:15:46.684099] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:15:46.684166] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-29T18:15:46.684240] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-29T18:15:46.684293] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-10-29T18:15:46.684842] [DEBUG] [LOCAL ] DDS: Deleted derivative data file. [2025-10-29T18:15:46.684927] [INFO ] [MAIN ] Update Progress: 603/2367 symbols completed. DDS took 26.7s. Estimated remaining: 3h 41m 34s. Rate: 8.0 symbols/min [2025-10-29T18:15:46.798752] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-29T18:15:46.860313] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:15:46.914288] [DEBUG] [LOCAL ] DECK: Loaded 53302 existing records from primary storage. [2025-10-29T18:15:46.914623] [INFO ] [MAIN ] DECK: Loaded 53302 existing records. [2025-10-29T18:15:47.101415] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:15:47.101620] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-29T18:15:47.101696] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-29T18:15:47.102160] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-29T18:15:47.102221] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-29T18:15:47.458794] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:15:47.593598] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-29T18:15:48.290389] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-29T18:15:48.393557] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-29T18:15:48.429792] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T18:15:48.937589] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-29T18:15:48.947817] [INFO ] [REMOTE ] DE: Full fetch complete (69855 records). [2025-10-29T18:15:48.947983] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-29T18:15:49.203829] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-29T18:15:49.335469] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-29T18:15:49.335540] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-29T18:15:49.336361] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-29T18:15:49.336423] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-29T18:15:49.337677] [DEBUG] [LOCAL ] DE: Trimmed 69855 records to 47308 (keeping 200 days of data) [2025-10-29T18:15:49.629533] [DEBUG] [LOCAL ] DE: Primary data saved (47308 records). [2025-10-29T18:15:49.629703] [INFO ] [MAIN ] DE: Full history saved. [2025-10-29T18:15:49.629814] [INFO ] [MAIN ] Update Progress: 604/2367 symbols completed. DE took 29.6s. Estimated remaining: 3h 41m 13s. Rate: 8.0 symbols/min [2025-10-29T18:15:49.797800] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:15:49.842308] [DEBUG] [LOCAL ] DEI: Loaded 48147 existing records from primary storage. [2025-10-29T18:15:49.842634] [INFO ] [MAIN ] DEI: Loaded 48147 existing records. [2025-10-29T18:15:50.018761] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-29T18:15:50.024567] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:15:50.024803] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-29T18:15:50.025575] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-29T18:15:50.026023] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-29T18:15:50.026083] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-29T18:15:50.391469] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:15:50.534246] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T18:15:50.793611] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-29T18:15:51.593562] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-29T18:15:51.637357] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-29T18:15:51.948503] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T18:15:52.393603] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-29T18:15:52.754483] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T18:15:53.193583] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-29T18:15:53.480604] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T18:15:53.993586] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-29T18:15:54.535897] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T18:15:54.793559] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-29T18:15:55.218918] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:15:55.593556] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-29T18:15:56.263922] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T18:15:56.393562] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-29T18:15:56.797705] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T18:15:57.193565] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-29T18:15:57.905603] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T18:15:57.993596] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-29T18:15:58.739218] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T18:15:58.793602] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-29T18:15:59.117693] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-29T18:15:59.593615] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-29T18:15:59.772266] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T18:16:00.393569] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-29T18:16:01.198754] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-29T18:16:01.218597] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-29T18:16:01.660281] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-29T18:16:01.993598] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-29T18:16:02.334332] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T18:16:02.793630] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-29T18:16:03.042216] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T18:16:03.593569] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-29T18:16:03.936843] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T18:16:04.393564] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-29T18:16:05.080836] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-29T18:16:05.193556] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-29T18:16:05.301791] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-29T18:16:05.993603] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-29T18:16:06.793602] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-29T18:16:06.859518] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-29T18:16:06.899503] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T18:16:07.593624] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-29T18:16:07.853542] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-29T18:16:08.393686] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-29T18:16:09.096170] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-29T18:16:09.179971] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T18:16:09.193509] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-29T18:16:09.993590] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-29T18:16:10.164538] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-29T18:16:10.793554] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-29T18:16:11.227192] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T18:16:11.593578] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-29T18:16:12.133091] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T18:16:12.393561] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-29T18:16:13.042390] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-29T18:16:13.193638] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-29T18:16:13.232480] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-29T18:16:13.993699] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-29T18:16:14.352278] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:16:14.793600] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-29T18:16:15.072043] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T18:16:15.593584] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-29T18:16:15.710148] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-29T18:16:16.393594] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-29T18:16:16.782770] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T18:16:16.791343] [INFO ] [REMOTE ] DEA: Full fetch complete (61444 records). [2025-10-29T18:16:16.791491] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-29T18:16:17.183284] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-29T18:16:17.183409] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-29T18:16:17.184231] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-29T18:16:17.184305] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-29T18:16:17.186124] [DEBUG] [LOCAL ] DEA: Trimmed 61444 records to 39608 (keeping 200 days of data) [2025-10-29T18:16:17.237899] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-29T18:16:17.421081] [DEBUG] [LOCAL ] DEA: Primary data saved (39608 records). [2025-10-29T18:16:17.421222] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-29T18:16:17.421299] [INFO ] [MAIN ] Update Progress: 605/2367 symbols completed. DEA took 42.9s. Estimated remaining: 3h 42m 4s. Rate: 7.9 symbols/min [2025-10-29T18:16:17.603182] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:16:17.603365] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-10-29T18:16:17.603402] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-10-29T18:16:17.603512] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-29T18:16:17.603552] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-29T18:16:17.603591] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-29T18:16:17.603622] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-29T18:16:17.959214] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:16:17.993562] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-29T18:16:18.329567] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-29T18:16:18.341438] [INFO ] [REMOTE ] DECK: Full fetch complete (77252 records). [2025-10-29T18:16:18.341601] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-29T18:16:18.810039] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-29T18:16:18.849187] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-29T18:16:18.859170] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-29T18:16:18.861060] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-29T18:16:18.864071] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-29T18:16:18.866526] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-29T18:16:18.881222] [INFO ] [REMOTE ] DEI: Full fetch complete (69874 records). [2025-10-29T18:16:18.881572] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-29T18:16:18.882012] [DEBUG] [LOCAL ] DECK: Trimmed 77252 records to 53303 (keeping 200 days of data) [2025-10-29T18:16:19.595892] [DEBUG] [LOCAL ] DECK: Primary data saved (53303 records). [2025-10-29T18:16:19.599708] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-29T18:16:19.599530] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-29T18:16:19.599862] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-29T18:16:19.600807] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-29T18:16:19.601061] [INFO ] [MAIN ] Update Progress: 606/2367 symbols completed. DECK took 32.9s. Estimated remaining: 3h 41m 41s. Rate: 7.9 symbols/min [2025-10-29T18:16:19.601191] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-29T18:16:19.688028] [DEBUG] [LOCAL ] DEI: Trimmed 69874 records to 48138 (keeping 200 days of data) [2025-10-29T18:16:19.874853] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:16:20.021455] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T18:16:20.031223] [INFO ] [REMOTE ] DEC: Full fetch complete (44545 records). [2025-10-29T18:16:20.056162] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-29T18:16:20.062559] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:16:20.090866] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:16:20.096619] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:16:20.100034] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-29T18:16:20.119202] [DEBUG] [LOCAL ] DEO: Loaded 49131 existing records from primary storage. [2025-10-29T18:16:20.121375] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-29T18:16:20.119299] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-29T18:16:20.153249] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-29T18:16:20.152548] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-10-29T18:16:20.133224] [INFO ] [MAIN ] DEO: Loaded 49131 existing records. [2025-10-29T18:16:20.168931] [DEBUG] [LOCAL ] DEC: No derivative data file found to delete. [2025-10-29T18:16:20.175837] [INFO ] [MAIN ] Update Progress: 607/2367 symbols completed. DEC took 34.6s. Estimated remaining: 3h 41m 13s. Rate: 8.0 symbols/min [2025-10-29T18:16:20.216471] [DEBUG] [LOCAL ] DEI: Primary data saved (48138 records). [2025-10-29T18:16:20.251482] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-29T18:16:20.268264] [INFO ] [MAIN ] Update Progress: 608/2367 symbols completed. DEI took 30.6s. Estimated remaining: 3h 40m 44s. Rate: 8.0 symbols/min [2025-10-29T18:16:20.603049] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:16:20.687756] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-29T18:16:20.687669] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:16:20.707209] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-29T18:16:20.736617] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-29T18:16:20.736569] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:16:20.736876] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-29T18:16:20.737433] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-10-29T18:16:20.742801] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-10-29T18:16:20.814890] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-29T18:16:20.840845] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-29T18:16:20.903847] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-29T18:16:20.917749] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-29T18:16:21.041405] [DEBUG] [LOCAL ] DFH: Loaded 31085 existing records from primary storage. [2025-10-29T18:16:21.113071] [INFO ] [MAIN ] DFH: Loaded 31085 existing records. [2025-10-29T18:16:21.551735] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:16:21.558024] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-29T18:16:21.757672] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:16:21.797170] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-29T18:16:21.797058] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:16:21.797738] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-29T18:16:21.797634] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-29T18:16:21.798750] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-29T18:16:21.798833] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-29T18:16:22.176935] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:16:22.177308] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-29T18:16:22.206317] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-29T18:16:22.489288] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-29T18:16:22.793548] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-29T18:16:23.068133] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-29T18:16:23.352334] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T18:16:23.593613] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-29T18:16:24.288144] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T18:16:24.393530] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-29T18:16:24.626687] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-29T18:16:25.193609] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-29T18:16:25.840727] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T18:16:25.993541] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-29T18:16:26.089812] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T18:16:26.793595] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-29T18:16:27.300830] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T18:16:27.593527] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-29T18:16:28.281487] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T18:16:28.393552] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-29T18:16:28.586751] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-29T18:16:29.193585] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-29T18:16:29.784483] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T18:16:29.993596] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-29T18:16:30.793527] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-29T18:16:30.941491] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T18:16:31.061144] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-29T18:16:31.593559] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-29T18:16:32.074273] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T18:16:32.213072] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T18:16:32.393549] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-29T18:16:33.193557] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-29T18:16:34.001482] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-29T18:16:34.008671] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-29T18:16:34.230755] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T18:16:34.793546] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-29T18:16:34.824892] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T18:16:35.593557] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-29T18:16:36.393586] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-29T18:16:36.548264] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-29T18:16:36.885041] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T18:16:37.043173] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T18:16:37.193564] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-29T18:16:37.993601] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-29T18:16:38.678365] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T18:16:38.793519] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-29T18:16:39.019959] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-29T18:16:39.506551] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T18:16:39.593530] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-29T18:16:40.393568] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-29T18:16:40.548165] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T18:16:41.193569] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-29T18:16:41.993537] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-29T18:16:42.025889] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T18:16:42.030869] [INFO ] [REMOTE ] DFIN: Full fetch complete (33687 records). [2025-10-29T18:16:42.030951] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-29T18:16:42.423861] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-29T18:16:42.423970] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-29T18:16:42.424556] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-29T18:16:42.424629] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-29T18:16:42.426122] [DEBUG] [LOCAL ] DFIN: Trimmed 33687 records to 22019 (keeping 200 days of data) [2025-10-29T18:16:42.554435] [DEBUG] [LOCAL ] DFIN: Primary data saved (22019 records). [2025-10-29T18:16:42.554724] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-29T18:16:42.554827] [INFO ] [MAIN ] Update Progress: 609/2367 symbols completed. DFIN took 22.2s. Estimated remaining: 3h 41m 19s. Rate: 7.9 symbols/min [2025-10-29T18:16:42.704030] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-29T18:16:42.778329] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:16:42.791250] [DEBUG] [LOCAL ] DFP: Loaded 10701 existing records from primary storage. [2025-10-29T18:16:42.791472] [INFO ] [MAIN ] DFP: Loaded 10701 existing records. [2025-10-29T18:16:42.802666] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-29T18:16:42.971166] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:16:42.971412] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-29T18:16:42.971460] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-29T18:16:42.971616] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-29T18:16:42.971695] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-29T18:16:43.342098] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:16:43.599744] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-29T18:16:43.608008] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-29T18:16:44.393615] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-29T18:16:44.577443] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T18:16:45.080535] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-29T18:16:45.198985] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-29T18:16:45.225497] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-29T18:16:45.241490] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-29T18:16:45.241812] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-29T18:16:45.761821] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-29T18:16:45.761916] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-29T18:16:45.762975] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-29T18:16:45.763046] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-29T18:16:45.764823] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 53736 (keeping 200 days of data) [2025-10-29T18:16:45.993708] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-29T18:16:46.145675] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-29T18:16:46.145902] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-29T18:16:46.146027] [INFO ] [MAIN ] Update Progress: 610/2367 symbols completed. DELL took 28.7s. Estimated remaining: 3h 41m 0s. Rate: 8.0 symbols/min [2025-10-29T18:16:46.320481] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:16:46.368695] [DEBUG] [LOCAL ] DG: Loaded 53192 existing records from primary storage. [2025-10-29T18:16:46.369024] [INFO ] [MAIN ] DG: Loaded 53192 existing records. [2025-10-29T18:16:46.547699] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:16:46.548146] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-29T18:16:46.548340] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-29T18:16:46.549391] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-29T18:16:46.549451] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-29T18:16:46.689130] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-29T18:16:46.798682] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-29T18:16:46.837815] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-29T18:16:46.978505] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:16:47.261304] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T18:16:47.593563] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-29T18:16:48.393558] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-29T18:16:48.978798] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-29T18:16:49.124591] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-29T18:16:49.193519] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-29T18:16:49.993582] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-29T18:16:50.793552] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-29T18:16:50.858441] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-29T18:16:51.338581] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-29T18:16:51.593533] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-29T18:16:51.739812] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-29T18:16:51.751400] [INFO ] [REMOTE ] DEO: Full fetch complete (71725 records). [2025-10-29T18:16:51.751557] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-29T18:16:52.139935] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-29T18:16:52.165170] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-29T18:16:52.165688] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-29T18:16:52.166737] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-29T18:16:52.166804] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-29T18:16:52.168252] [DEBUG] [LOCAL ] DEO: Trimmed 71725 records to 49144 (keeping 200 days of data) [2025-10-29T18:16:52.399714] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-29T18:16:52.472937] [DEBUG] [LOCAL ] DEO: Primary data saved (49144 records). [2025-10-29T18:16:52.473070] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-29T18:16:52.473145] [INFO ] [MAIN ] Update Progress: 611/2367 symbols completed. DEO took 32.9s. Estimated remaining: 3h 40m 49s. Rate: 8.0 symbols/min [2025-10-29T18:16:52.645837] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:16:52.646115] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-29T18:16:52.646180] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-29T18:16:52.646330] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-29T18:16:52.646429] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-29T18:16:52.646495] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-29T18:16:52.646531] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-29T18:16:52.992379] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-29T18:16:53.040561] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:16:53.193596] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-29T18:16:53.993568] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-29T18:16:54.537246] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T18:16:54.793631] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-29T18:16:55.014027] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T18:16:55.593716] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-29T18:16:55.906904] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T18:16:56.393611] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-29T18:16:56.938536] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T18:16:57.032149] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T18:16:57.193563] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-29T18:16:57.993584] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-29T18:16:58.334221] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T18:16:58.790982] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-29T18:16:58.798289] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-29T18:16:59.593566] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-29T18:17:00.393689] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-29T18:17:00.406053] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-29T18:17:00.414537] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-29T18:17:01.193570] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-29T18:17:01.752132] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T18:17:01.753002] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-29T18:17:01.993610] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-29T18:17:02.793559] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-29T18:17:03.187137] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T18:17:03.593537] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-29T18:17:03.663175] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-29T18:17:04.061141] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-29T18:17:04.063672] [INFO ] [REMOTE ] DFP: Full fetch complete (15850 records). [2025-10-29T18:17:04.063746] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-29T18:17:04.403928] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-29T18:17:04.418872] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-29T18:17:04.418933] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-29T18:17:04.419248] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-29T18:17:04.419284] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-29T18:17:04.419801] [DEBUG] [LOCAL ] DFP: Trimmed 15850 records to 10707 (keeping 200 days of data) [2025-10-29T18:17:04.483187] [DEBUG] [LOCAL ] DFP: Primary data saved (10707 records). [2025-10-29T18:17:04.483297] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-29T18:17:04.483370] [INFO ] [MAIN ] Update Progress: 612/2367 symbols completed. DFP took 21.9s. Estimated remaining: 3h 40m 54s. Rate: 7.9 symbols/min [2025-10-29T18:17:04.650581] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:17:04.650780] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-29T18:17:04.650833] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-29T18:17:04.650937] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-29T18:17:04.650977] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-29T18:17:04.651016] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-29T18:17:04.651047] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-29T18:17:04.992916] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:17:05.193564] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-29T18:17:05.993701] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-29T18:17:06.076949] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T18:17:06.164346] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-29T18:17:06.793620] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-29T18:17:07.326162] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T18:17:07.470778] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-29T18:17:07.593600] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-29T18:17:08.225267] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-29T18:17:08.393621] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-29T18:17:09.193688] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-29T18:17:09.316524] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-29T18:17:09.993813] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-29T18:17:10.579152] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T18:17:10.793584] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-29T18:17:11.219802] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T18:17:11.582805] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-29T18:17:11.593510] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-29T18:17:12.303867] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-29T18:17:12.393543] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-29T18:17:13.055703] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T18:17:13.193571] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-29T18:17:13.904467] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T18:17:13.993570] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-29T18:17:14.793566] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-29T18:17:15.168569] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T18:17:15.593541] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-29T18:17:15.713352] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T18:17:16.393569] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-29T18:17:17.165927] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T18:17:17.193574] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-29T18:17:17.402679] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-29T18:17:17.993627] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-29T18:17:18.088440] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-29T18:17:18.095332] [INFO ] [REMOTE ] DFH: Full fetch complete (46960 records). [2025-10-29T18:17:18.095519] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-29T18:17:18.495330] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-29T18:17:18.495444] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-29T18:17:18.496421] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-29T18:17:18.496491] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-29T18:17:18.497911] [DEBUG] [LOCAL ] DFH: Trimmed 46960 records to 30988 (keeping 200 days of data) [2025-10-29T18:17:18.703844] [DEBUG] [LOCAL ] DFH: Primary data saved (30988 records). [2025-10-29T18:17:18.703990] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-29T18:17:18.704070] [INFO ] [MAIN ] Update Progress: 613/2367 symbols completed. DFH took 58.5s. Estimated remaining: 3h 41m 6s. Rate: 7.9 symbols/min [2025-10-29T18:17:18.799783] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-29T18:17:18.884033] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:17:18.940005] [DEBUG] [LOCAL ] DHI: Loaded 53348 existing records from primary storage. [2025-10-29T18:17:18.940360] [INFO ] [MAIN ] DHI: Loaded 53348 existing records. [2025-10-29T18:17:19.124979] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:17:19.125268] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-29T18:17:19.125426] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-29T18:17:19.126111] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-29T18:17:19.126172] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-29T18:17:19.324076] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T18:17:19.514541] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:17:19.593539] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-29T18:17:19.715323] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-29T18:17:19.721294] [INFO ] [REMOTE ] DHF: Full fetch complete (29811 records). [2025-10-29T18:17:19.721531] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-29T18:17:19.722449] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:17:19.722552] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:17:19.722607] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:17:19.722684] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-29T18:17:19.722771] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-29T18:17:19.722811] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-10-29T18:17:19.722857] [DEBUG] [LOCAL ] DHF: No derivative data file found to delete. [2025-10-29T18:17:19.722928] [INFO ] [MAIN ] Update Progress: 614/2367 symbols completed. DHF took 15.2s. Estimated remaining: 3h 40m 40s. Rate: 7.9 symbols/min [2025-10-29T18:17:19.924805] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:17:19.979278] [DEBUG] [LOCAL ] DHR: Loaded 53365 existing records from primary storage. [2025-10-29T18:17:19.979638] [INFO ] [MAIN ] DHR: Loaded 53365 existing records. [2025-10-29T18:17:20.158832] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:17:20.159046] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-29T18:17:20.159093] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-29T18:17:20.160025] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-29T18:17:20.160084] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-29T18:17:20.399561] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-29T18:17:20.535435] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:17:21.038037] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T18:17:21.193582] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-29T18:17:21.993543] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-29T18:17:22.156792] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-29T18:17:22.558961] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T18:17:22.568373] [INFO ] [REMOTE ] DGX: Full fetch complete (65383 records). [2025-10-29T18:17:22.568493] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-29T18:17:22.569303] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:17:22.569400] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:17:22.569481] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:17:22.569572] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-29T18:17:22.569706] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-29T18:17:22.569776] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-29T18:17:22.569822] [DEBUG] [LOCAL ] DGX: No derivative data file found to delete. [2025-10-29T18:17:22.569878] [INFO ] [MAIN ] Update Progress: 615/2367 symbols completed. DGX took 30.1s. Estimated remaining: 3h 40m 19s. Rate: 8.0 symbols/min [2025-10-29T18:17:22.739215] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:17:22.781891] [DEBUG] [LOCAL ] DHT: Loaded 47743 existing records from primary storage. [2025-10-29T18:17:22.782206] [INFO ] [MAIN ] DHT: Loaded 47743 existing records. [2025-10-29T18:17:22.803161] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-29T18:17:22.963692] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:17:22.963922] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-29T18:17:22.963975] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-29T18:17:22.964929] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-29T18:17:22.964988] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-29T18:17:23.328592] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:17:23.593545] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-29T18:17:23.679107] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-29T18:17:24.225137] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T18:17:24.393625] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-29T18:17:25.012078] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T18:17:25.193567] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-29T18:17:25.590704] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T18:17:25.993617] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-29T18:17:26.744562] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-29T18:17:26.793546] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-29T18:17:27.343102] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-29T18:17:27.593588] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-29T18:17:28.219370] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T18:17:28.393592] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-29T18:17:28.701801] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:17:29.193613] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-29T18:17:29.782799] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T18:17:29.993594] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-29T18:17:30.577145] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T18:17:30.793566] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-29T18:17:31.352687] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-29T18:17:31.593579] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-29T18:17:32.097874] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T18:17:32.393595] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-29T18:17:33.066081] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T18:17:33.193581] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-29T18:17:33.946821] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T18:17:33.993551] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-29T18:17:34.745691] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T18:17:34.793524] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-29T18:17:35.485939] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T18:17:35.593597] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-29T18:17:35.975467] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T18:17:36.210568] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T18:17:36.221618] [INFO ] [REMOTE ] DG: Full fetch complete (77268 records). [2025-10-29T18:17:36.221789] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-29T18:17:36.394827] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-29T18:17:36.619419] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-29T18:17:36.619532] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-29T18:17:36.620716] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-29T18:17:36.620797] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-29T18:17:36.622380] [DEBUG] [LOCAL ] DG: Trimmed 77268 records to 53186 (keeping 200 days of data) [2025-10-29T18:17:36.959940] [DEBUG] [LOCAL ] DG: Primary data saved (53186 records). [2025-10-29T18:17:36.960067] [INFO ] [MAIN ] DG: Full history saved. [2025-10-29T18:17:36.960145] [INFO ] [MAIN ] Update Progress: 616/2367 symbols completed. DG took 50.8s. Estimated remaining: 3h 40m 31s. Rate: 7.9 symbols/min [2025-10-29T18:17:37.128538] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:17:37.140590] [DEBUG] [LOCAL ] DHX: Loaded 13052 existing records from primary storage. [2025-10-29T18:17:37.140803] [INFO ] [MAIN ] DHX: Loaded 13052 existing records. [2025-10-29T18:17:37.202020] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-29T18:17:37.327554] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:17:37.327838] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-29T18:17:37.327893] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-29T18:17:37.328393] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-29T18:17:37.328451] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-29T18:17:37.696539] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:17:37.924553] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-29T18:17:37.993523] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-29T18:17:38.747746] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-29T18:17:38.793542] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-29T18:17:39.270345] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T18:17:39.593575] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-29T18:17:40.393872] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-29T18:17:40.572275] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-29T18:17:40.582969] [INFO ] [REMOTE ] DHI: Full fetch complete (77018 records). [2025-10-29T18:17:40.583130] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-29T18:17:40.583979] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:17:40.584070] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:17:40.584112] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:17:40.584155] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-29T18:17:40.584211] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-29T18:17:40.584246] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-29T18:17:40.584433] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-29T18:17:40.585265] [INFO ] [MAIN ] Update Progress: 617/2367 symbols completed. DHI took 21.9s. Estimated remaining: 3h 40m 12s. Rate: 7.9 symbols/min [2025-10-29T18:17:40.774551] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:17:40.789467] [DEBUG] [LOCAL ] DIAX: Loaded 12223 existing records from primary storage. [2025-10-29T18:17:40.789724] [INFO ] [MAIN ] DIAX: Loaded 12223 existing records. [2025-10-29T18:17:40.978886] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:17:40.979219] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-29T18:17:40.979421] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-29T18:17:40.979854] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-29T18:17:40.979913] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-29T18:17:41.196878] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-29T18:17:41.217749] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T18:17:41.372809] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:17:41.405880] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-29T18:17:41.993585] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-29T18:17:42.545353] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-29T18:17:42.794047] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-29T18:17:42.793883] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-29T18:17:43.321879] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T18:17:43.593553] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-29T18:17:44.136152] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T18:17:44.393567] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-29T18:17:45.193568] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-29T18:17:45.649696] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T18:17:45.857118] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-29T18:17:45.993577] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-29T18:17:46.793561] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-29T18:17:47.200303] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T18:17:47.410147] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T18:17:47.422943] [INFO ] [REMOTE ] DHR: Full fetch complete (77436 records). [2025-10-29T18:17:47.423178] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-29T18:17:47.595490] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-29T18:17:47.837948] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-29T18:17:47.838039] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-29T18:17:47.838955] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-29T18:17:47.839020] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-29T18:17:47.840517] [DEBUG] [LOCAL ] DHR: Trimmed 77436 records to 53363 (keeping 200 days of data) [2025-10-29T18:17:48.183342] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T18:17:48.186691] [DEBUG] [LOCAL ] DHR: Primary data saved (53363 records). [2025-10-29T18:17:48.186981] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-29T18:17:48.189990] [INFO ] [MAIN ] Update Progress: 618/2367 symbols completed. DHR took 28.5s. Estimated remaining: 3h 40m 5s. Rate: 7.9 symbols/min [2025-10-29T18:17:48.366289] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:17:48.402496] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-29T18:17:48.404492] [DEBUG] [LOCAL ] DIN: Loaded 36263 existing records from primary storage. [2025-10-29T18:17:48.405633] [INFO ] [MAIN ] DIN: Loaded 36263 existing records. [2025-10-29T18:17:48.588503] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:17:48.588721] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-29T18:17:48.588776] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-29T18:17:48.589351] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-29T18:17:48.589408] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-29T18:17:48.964577] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:17:49.193536] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-29T18:17:49.260160] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T18:17:49.993564] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-29T18:17:50.550920] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T18:17:50.793566] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-29T18:17:51.376140] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T18:17:51.593565] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-29T18:17:52.112590] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T18:17:52.393549] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-29T18:17:52.477197] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T18:17:53.193615] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-29T18:17:53.846852] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-29T18:17:53.983109] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T18:17:53.993513] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-29T18:17:54.592402] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-29T18:17:54.793573] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-29T18:17:55.593615] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-29T18:17:56.294968] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T18:17:56.305769] [INFO ] [REMOTE ] DHT: Full fetch complete (69939 records). [2025-10-29T18:17:56.305926] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-29T18:17:56.306813] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:17:56.306894] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:17:56.306959] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:17:56.307030] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-29T18:17:56.307095] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-29T18:17:56.307133] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-10-29T18:17:56.307282] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-10-29T18:17:56.307356] [INFO ] [MAIN ] Update Progress: 619/2367 symbols completed. DHT took 33.7s. Estimated remaining: 3h 39m 59s. Rate: 7.9 symbols/min [2025-10-29T18:17:56.399689] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-29T18:17:56.469127] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T18:17:56.501549] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:17:56.506635] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-29T18:17:56.507424] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-29T18:17:56.507572] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-29T18:17:56.507620] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-29T18:17:56.507706] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-29T18:17:56.507762] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-29T18:17:56.885947] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:17:57.122798] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T18:17:57.193544] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-29T18:17:57.812937] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T18:17:57.993553] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-29T18:17:58.793553] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-29T18:17:59.069636] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T18:17:59.593570] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-29T18:18:00.102609] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-29T18:18:00.209042] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-29T18:18:00.393569] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-29T18:18:01.078687] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T18:18:01.193572] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-29T18:18:01.993611] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-29T18:18:02.548671] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T18:18:02.585556] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T18:18:02.793528] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-29T18:18:03.560581] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T18:18:03.593511] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-29T18:18:04.255505] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T18:18:04.258674] [INFO ] [REMOTE ] DIAX: Full fetch complete (17687 records). [2025-10-29T18:18:04.258757] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-29T18:18:04.401315] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-29T18:18:04.624507] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-29T18:18:04.624578] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-29T18:18:04.624978] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-29T18:18:04.625037] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-29T18:18:04.625542] [DEBUG] [LOCAL ] DIAX: Trimmed 17687 records to 12157 (keeping 200 days of data) [2025-10-29T18:18:04.699558] [DEBUG] [LOCAL ] DIAX: Primary data saved (12157 records). [2025-10-29T18:18:04.699706] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-29T18:18:04.699802] [INFO ] [MAIN ] Update Progress: 620/2367 symbols completed. DIAX took 24.1s. Estimated remaining: 3h 39m 53s. Rate: 7.9 symbols/min [2025-10-29T18:18:04.867141] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:18:04.916992] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-29T18:18:04.917279] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-29T18:18:05.103121] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:18:05.103450] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-29T18:18:05.103591] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-29T18:18:05.104635] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-29T18:18:05.104723] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-29T18:18:05.198669] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-29T18:18:05.218688] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T18:18:05.481497] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:18:05.993606] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-29T18:18:06.442605] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:18:06.793569] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-29T18:18:07.593554] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-29T18:18:07.857280] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T18:18:08.002108] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-29T18:18:08.037704] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-29T18:18:08.393552] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-29T18:18:09.193581] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-29T18:18:09.708998] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T18:18:09.993529] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-29T18:18:10.026904] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-29T18:18:10.793595] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-29T18:18:11.593623] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-29T18:18:11.715358] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-29T18:18:12.347049] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T18:18:12.393608] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-29T18:18:12.773302] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T18:18:13.193634] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-29T18:18:13.994494] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-29T18:18:13.998666] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-29T18:18:14.003534] [INFO ] [REMOTE ] DHX: Full fetch complete (21460 records). [2025-10-29T18:18:14.003630] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-29T18:18:14.399804] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-29T18:18:14.400006] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-29T18:18:14.400688] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-29T18:18:14.400783] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-29T18:18:14.401942] [DEBUG] [LOCAL ] DHX: Trimmed 21460 records to 12981 (keeping 200 days of data) [2025-10-29T18:18:14.481462] [DEBUG] [LOCAL ] DHX: Primary data saved (12981 records). [2025-10-29T18:18:14.481713] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-29T18:18:14.481832] [INFO ] [MAIN ] Update Progress: 621/2367 symbols completed. DHX took 37.5s. Estimated remaining: 3h 39m 52s. Rate: 7.9 symbols/min [2025-10-29T18:18:14.668252] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-29T18:18:14.695709] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:18:14.706625] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-29T18:18:14.706975] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-29T18:18:14.707108] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-29T18:18:14.707162] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-29T18:18:14.707208] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-29T18:18:14.707241] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-29T18:18:14.798673] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-29T18:18:15.064788] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:18:15.093000] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T18:18:15.593562] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-29T18:18:15.964170] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-29T18:18:16.393608] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-29T18:18:16.648397] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-29T18:18:16.808290] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-29T18:18:17.193578] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-29T18:18:17.993616] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-29T18:18:18.536848] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T18:18:18.793618] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-29T18:18:19.029127] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T18:18:19.593600] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-29T18:18:20.393622] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-29T18:18:20.686691] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-29T18:18:20.725047] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-29T18:18:20.733776] [INFO ] [REMOTE ] DIN: Full fetch complete (54013 records). [2025-10-29T18:18:20.733916] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-29T18:18:20.734567] [FATAL] [VALIDATOR ] DIN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:18:20.734680] [FATAL] [MAIN ] DIN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:18:20.734736] [WARN ] [MAIN ] DIN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:18:20.734778] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-29T18:18:20.734855] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-29T18:18:20.734910] [INFO ] [LOCAL ] DIN: Starting deletion of derivative data. [2025-10-29T18:18:20.735061] [DEBUG] [LOCAL ] DIN: Deleted derivative data file. [2025-10-29T18:18:20.735134] [INFO ] [MAIN ] Update Progress: 622/2367 symbols completed. DIN took 32.5s. Estimated remaining: 3h 39m 41s. Rate: 7.9 symbols/min [2025-10-29T18:18:20.934876] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:18:20.967039] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-29T18:18:21.026298] [DEBUG] [LOCAL ] DK: Loaded 49049 existing records from primary storage. [2025-10-29T18:18:21.026639] [INFO ] [MAIN ] DK: Loaded 49049 existing records. [2025-10-29T18:18:21.201316] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-29T18:18:21.238224] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:18:21.238569] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-29T18:18:21.238637] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-29T18:18:21.239515] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-29T18:18:21.239579] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-29T18:18:21.619754] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:18:21.993590] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-29T18:18:22.301138] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-29T18:18:22.596441] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T18:18:22.793529] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-29T18:18:23.593716] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-29T18:18:24.050067] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T18:18:24.393632] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-29T18:18:25.193550] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-29T18:18:25.325543] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-29T18:18:25.993576] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-29T18:18:26.163425] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-29T18:18:26.440379] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T18:18:26.793558] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-29T18:18:27.593546] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-29T18:18:27.867234] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T18:18:27.989426] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-29T18:18:28.393547] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-29T18:18:28.947472] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T18:18:29.193564] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-29T18:18:29.615971] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T18:18:29.993574] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-29T18:18:30.321832] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T18:18:30.793594] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-29T18:18:31.036619] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-29T18:18:31.359220] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-29T18:18:31.593600] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-29T18:18:32.393557] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-29T18:18:32.903513] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T18:18:33.193611] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-29T18:18:33.993555] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-29T18:18:34.088887] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-29T18:18:34.296380] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-29T18:18:34.299114] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T18:18:34.793563] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-29T18:18:35.593561] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-29T18:18:35.801805] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-10-29T18:18:35.889235] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T18:18:36.393546] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-29T18:18:36.688242] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-29T18:18:37.193560] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-29T18:18:37.993555] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-29T18:18:38.630823] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:18:38.793558] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-29T18:18:39.138257] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-29T18:18:39.139051] [INFO ] [REMOTE ] DIVY: Full fetch complete (1656 records). [2025-10-29T18:18:39.139117] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-29T18:18:39.317501] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-29T18:18:39.317690] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:18:39.317745] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:18:39.317784] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-29T18:18:39.317842] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-29T18:18:39.317876] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-29T18:18:39.317913] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-29T18:18:39.317966] [INFO ] [MAIN ] Update Progress: 623/2367 symbols completed. DIVY took 24.8s. Estimated remaining: 3h 40m 4s. Rate: 7.9 symbols/min [2025-10-29T18:18:39.492323] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:18:39.523184] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T18:18:39.538251] [INFO ] [REMOTE ] DINO: Full fetch complete (76656 records). [2025-10-29T18:18:39.538399] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-29T18:18:39.595674] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-29T18:18:39.651074] [DEBUG] [LOCAL ] DKL: Loaded 15947 existing records from primary storage. [2025-10-29T18:18:39.651625] [INFO ] [MAIN ] DKL: Loaded 15947 existing records. [2025-10-29T18:18:40.043134] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:18:40.048316] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-29T18:18:40.048706] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-29T18:18:40.064845] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-29T18:18:40.075215] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-29T18:18:40.272841] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-29T18:18:40.278057] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-29T18:18:40.284087] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-29T18:18:40.289308] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-29T18:18:40.338454] [DEBUG] [LOCAL ] DINO: Trimmed 76656 records to 52750 (keeping 200 days of data) [2025-10-29T18:18:40.409382] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-29T18:18:40.645863] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:18:40.841165] [DEBUG] [LOCAL ] DINO: Primary data saved (52750 records). [2025-10-29T18:18:40.841300] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-29T18:18:40.841370] [INFO ] [MAIN ] Update Progress: 624/2367 symbols completed. DINO took 44.5s. Estimated remaining: 3h 39m 40s. Rate: 7.9 symbols/min [2025-10-29T18:18:41.013985] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:18:41.056820] [DEBUG] [LOCAL ] DKS: Loaded 48935 existing records from primary storage. [2025-10-29T18:18:41.057112] [INFO ] [MAIN ] DKS: Loaded 48935 existing records. [2025-10-29T18:18:41.198693] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-29T18:18:41.258544] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:18:41.258800] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-29T18:18:41.258870] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-29T18:18:41.259985] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-29T18:18:41.260050] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-29T18:18:41.642604] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:18:41.690776] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-29T18:18:41.702350] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-29T18:18:41.702492] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-29T18:18:42.010078] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-29T18:18:42.098796] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:18:42.172182] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-29T18:18:42.172337] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-29T18:18:42.173564] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-29T18:18:42.189530] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-29T18:18:42.208783] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-29T18:18:42.221161] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-29T18:18:42.700477] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-29T18:18:42.700727] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-29T18:18:42.701556] [INFO ] [MAIN ] Update Progress: 625/2367 symbols completed. DIS took 38.0s. Estimated remaining: 3h 39m 16s. Rate: 7.9 symbols/min [2025-10-29T18:18:42.799236] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-29T18:18:42.950245] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:18:42.950482] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-10-29T18:18:42.950540] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-10-29T18:18:42.950715] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-29T18:18:42.950805] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-29T18:18:42.950869] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-29T18:18:42.950918] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-29T18:18:43.383402] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:18:43.593575] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-29T18:18:43.687702] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-29T18:18:44.072714] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T18:18:44.393526] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-29T18:18:44.416455] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-29T18:18:45.193551] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-29T18:18:45.772300] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-29T18:18:45.993592] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-29T18:18:46.707632] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T18:18:46.717638] [INFO ] [REMOTE ] DK: Full fetch complete (70735 records). [2025-10-29T18:18:46.717831] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-29T18:18:46.798736] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-29T18:18:47.125829] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-29T18:18:47.125911] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-29T18:18:47.126850] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-29T18:18:47.126915] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-29T18:18:47.128281] [DEBUG] [LOCAL ] DK: Trimmed 70735 records to 49050 (keeping 200 days of data) [2025-10-29T18:18:47.436559] [DEBUG] [LOCAL ] DK: Primary data saved (49050 records). [2025-10-29T18:18:47.436735] [INFO ] [MAIN ] DK: Full history saved. [2025-10-29T18:18:47.437939] [INFO ] [MAIN ] Update Progress: 626/2367 symbols completed. DK took 26.7s. Estimated remaining: 3h 39m 1s. Rate: 7.9 symbols/min [2025-10-29T18:18:47.603127] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-29T18:18:47.606238] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:18:47.614769] [DEBUG] [LOCAL ] DLNG: Loaded 5867 existing records from primary storage. [2025-10-29T18:18:47.614983] [INFO ] [MAIN ] DLNG: Loaded 5867 existing records. [2025-10-29T18:18:47.796353] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:18:47.796610] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-29T18:18:47.796686] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-29T18:18:47.797005] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-29T18:18:47.797063] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-29T18:18:48.160467] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:18:48.190205] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T18:18:48.393967] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-29T18:18:48.393881] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-29T18:18:48.484753] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-29T18:18:49.197184] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-29T18:18:49.199375] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T18:18:49.993527] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-29T18:18:50.671006] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T18:18:50.793577] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-29T18:18:50.820562] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T18:18:51.593583] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-29T18:18:51.798789] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T18:18:52.393581] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-29T18:18:52.456527] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T18:18:53.193581] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-29T18:18:53.891489] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-29T18:18:53.993610] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-29T18:18:54.164908] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-29T18:18:54.712861] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T18:18:54.793524] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-29T18:18:55.465104] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T18:18:55.593529] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-29T18:18:56.393592] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-29T18:18:56.621731] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T18:18:56.897973] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T18:18:57.193551] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-29T18:18:57.590914] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T18:18:57.993563] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-29T18:18:58.578105] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-29T18:18:58.793591] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-29T18:18:59.382548] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T18:18:59.593711] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-29T18:19:00.393602] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-29T18:19:00.619543] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T18:19:01.030538] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-29T18:19:01.193553] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-29T18:19:01.846186] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-29T18:19:01.849329] [INFO ] [REMOTE ] DKL: Full fetch complete (27431 records). [2025-10-29T18:19:01.849478] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-29T18:19:01.994113] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-29T18:19:02.251852] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-29T18:19:02.251970] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-29T18:19:02.252621] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-29T18:19:02.252751] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-29T18:19:02.253744] [DEBUG] [LOCAL ] DKL: Trimmed 27431 records to 15808 (keeping 200 days of data) [2025-10-29T18:19:02.357692] [DEBUG] [LOCAL ] DKL: Primary data saved (15808 records). [2025-10-29T18:19:02.357864] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-29T18:19:02.357989] [INFO ] [MAIN ] Update Progress: 627/2367 symbols completed. DKL took 23.0s. Estimated remaining: 3h 39m 14s. Rate: 7.9 symbols/min [2025-10-29T18:19:02.552671] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:19:02.598803] [DEBUG] [LOCAL ] DLR: Loaded 50543 existing records from primary storage. [2025-10-29T18:19:02.599119] [INFO ] [MAIN ] DLR: Loaded 50543 existing records. [2025-10-29T18:19:02.773342] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:19:02.773559] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-29T18:19:02.773605] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-29T18:19:02.774490] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-29T18:19:02.774546] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-29T18:19:02.804483] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-29T18:19:03.122117] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:19:03.444493] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-29T18:19:03.593559] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-29T18:19:03.814272] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T18:19:04.393703] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-29T18:19:05.193555] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-29T18:19:05.342619] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-29T18:19:05.380395] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T18:19:05.788972] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-29T18:19:05.993611] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-29T18:19:06.793608] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-29T18:19:07.257250] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T18:19:07.593591] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-29T18:19:08.389937] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-29T18:19:08.399572] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-29T18:19:08.507582] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T18:19:09.193564] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-29T18:19:09.636325] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T18:19:09.993568] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-29T18:19:10.547199] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-29T18:19:10.793582] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-29T18:19:11.270283] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-29T18:19:11.514000] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T18:19:11.524539] [INFO ] [REMOTE ] DKS: Full fetch complete (71295 records). [2025-10-29T18:19:11.524769] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-29T18:19:11.598807] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-29T18:19:11.965524] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-29T18:19:11.965610] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-29T18:19:11.966678] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-29T18:19:11.966749] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-29T18:19:11.968203] [DEBUG] [LOCAL ] DKS: Trimmed 71295 records to 48879 (keeping 200 days of data) [2025-10-29T18:19:12.299553] [DEBUG] [LOCAL ] DKS: Primary data saved (48879 records). [2025-10-29T18:19:12.299721] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-29T18:19:12.299813] [INFO ] [MAIN ] Update Progress: 628/2367 symbols completed. DKS took 31.5s. Estimated remaining: 3h 39m 13s. Rate: 7.9 symbols/min [2025-10-29T18:19:12.402349] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-29T18:19:12.485342] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:19:12.511283] [DEBUG] [LOCAL ] DLX: Loaded 27575 existing records from primary storage. [2025-10-29T18:19:12.511545] [INFO ] [MAIN ] DLX: Loaded 27575 existing records. [2025-10-29T18:19:12.695388] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:19:12.695679] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-29T18:19:12.695771] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-29T18:19:12.696390] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-29T18:19:12.696449] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-29T18:19:12.906265] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-29T18:19:13.127454] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:19:13.198377] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-29T18:19:13.206384] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-29T18:19:13.993566] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-29T18:19:14.440766] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T18:19:14.448747] [INFO ] [REMOTE ] DLB: Full fetch complete (47492 records). [2025-10-29T18:19:14.448883] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-29T18:19:14.798758] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-29T18:19:14.886327] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-29T18:19:14.886409] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-29T18:19:14.887184] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-29T18:19:14.887247] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-29T18:19:14.888243] [DEBUG] [LOCAL ] DLB: Trimmed 47492 records to 32013 (keeping 200 days of data) [2025-10-29T18:19:15.081144] [DEBUG] [LOCAL ] DLB: Primary data saved (32013 records). [2025-10-29T18:19:15.081286] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-29T18:19:15.081358] [INFO ] [MAIN ] Update Progress: 629/2367 symbols completed. DLB took 32.4s. Estimated remaining: 3h 38m 52s. Rate: 7.9 symbols/min [2025-10-29T18:19:15.253131] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:19:15.253370] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-10-29T18:19:15.253425] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-10-29T18:19:15.253537] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-29T18:19:15.253690] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-29T18:19:15.253749] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-29T18:19:15.253783] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-29T18:19:15.595773] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-29T18:19:15.624299] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:19:15.656728] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-29T18:19:15.680145] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T18:19:16.225583] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-29T18:19:16.393561] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-29T18:19:17.193611] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-29T18:19:17.722719] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T18:19:17.951325] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T18:19:17.993558] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-29T18:19:18.633484] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T18:19:18.793598] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-29T18:19:19.184760] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T18:19:19.593559] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-29T18:19:19.941346] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-29T18:19:20.393566] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-29T18:19:20.943780] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-29T18:19:20.945614] [INFO ] [REMOTE ] DLNG: Full fetch complete (10894 records). [2025-10-29T18:19:20.945846] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-29T18:19:21.193543] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-29T18:19:21.335166] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-29T18:19:21.335239] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-29T18:19:21.335513] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-29T18:19:21.335552] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-29T18:19:21.336096] [DEBUG] [LOCAL ] DLNG: Trimmed 10894 records to 5850 (keeping 200 days of data) [2025-10-29T18:19:21.370062] [DEBUG] [LOCAL ] DLNG: Primary data saved (5850 records). [2025-10-29T18:19:21.370191] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-29T18:19:21.370269] [INFO ] [MAIN ] Update Progress: 630/2367 symbols completed. DLNG took 33.9s. Estimated remaining: 3h 38m 41s. Rate: 7.9 symbols/min [2025-10-29T18:19:21.540317] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:19:21.546317] [DEBUG] [LOCAL ] DMA: Loaded 4701 existing records from primary storage. [2025-10-29T18:19:21.546508] [INFO ] [MAIN ] DMA: Loaded 4701 existing records. [2025-10-29T18:19:21.730682] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:19:21.730912] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-29T18:19:21.730958] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-29T18:19:21.731132] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-29T18:19:21.731169] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-29T18:19:21.998667] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-29T18:19:22.086780] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:19:22.665549] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-29T18:19:22.793615] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-29T18:19:22.833236] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T18:19:23.226771] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-29T18:19:23.593611] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-29T18:19:23.883046] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-29T18:19:24.393613] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-29T18:19:25.193603] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-29T18:19:25.722054] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T18:19:25.875962] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-29T18:19:25.993582] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-29T18:19:26.667147] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T18:19:26.793574] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-29T18:19:27.593547] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-29T18:19:27.708907] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T18:19:27.896216] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-29T18:19:28.393595] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-29T18:19:29.193541] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-29T18:19:29.340579] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T18:19:29.993553] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-29T18:19:30.423836] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T18:19:30.716401] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T18:19:30.793526] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-29T18:19:31.466020] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T18:19:31.593566] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-29T18:19:32.393558] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-29T18:19:32.954099] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T18:19:33.110856] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T18:19:33.193585] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-29T18:19:33.517795] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-29T18:19:33.993561] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-29T18:19:34.573900] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-29T18:19:34.584603] [INFO ] [REMOTE ] DLR: Full fetch complete (74161 records). [2025-10-29T18:19:34.584790] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-29T18:19:34.799558] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-29T18:19:34.984723] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-29T18:19:34.984903] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-29T18:19:34.985830] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-29T18:19:34.985892] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-29T18:19:34.987344] [DEBUG] [LOCAL ] DLR: Trimmed 74161 records to 50528 (keeping 200 days of data) [2025-10-29T18:19:35.303973] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T18:19:35.323509] [DEBUG] [LOCAL ] DLR: Primary data saved (50528 records). [2025-10-29T18:19:35.323663] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-29T18:19:35.323761] [INFO ] [MAIN ] Update Progress: 631/2367 symbols completed. DLR took 33.0s. Estimated remaining: 3h 38m 51s. Rate: 7.9 symbols/min [2025-10-29T18:19:35.561734] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:19:35.561942] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-29T18:19:35.561980] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-29T18:19:35.562093] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-29T18:19:35.562134] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-29T18:19:35.562206] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-29T18:19:35.562267] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-29T18:19:35.598963] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-29T18:19:36.088555] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:19:36.324376] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-29T18:19:36.393578] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-29T18:19:37.015221] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-29T18:19:37.193563] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-29T18:19:37.441445] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-29T18:19:37.993598] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-29T18:19:38.337445] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-29T18:19:38.793556] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-29T18:19:39.134900] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-29T18:19:39.593552] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-29T18:19:40.393599] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-29T18:19:40.682950] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-29T18:19:40.760334] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T18:19:41.193561] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-29T18:19:41.977245] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T18:19:41.993524] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-29T18:19:42.793528] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-29T18:19:42.983870] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T18:19:42.990183] [INFO ] [REMOTE ] DLY: Full fetch complete (28915 records). [2025-10-29T18:19:42.990287] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-29T18:19:43.357042] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-29T18:19:43.369678] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-29T18:19:43.369776] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-29T18:19:43.371553] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-29T18:19:43.372053] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-29T18:19:43.372250] [INFO ] [REMOTE ] DMA: Full fetch complete (6529 records). [2025-10-29T18:19:43.372475] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-29T18:19:43.462557] [DEBUG] [LOCAL ] DLY: Trimmed 28915 records to 20562 (keeping 200 days of data) [2025-10-29T18:19:43.606968] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-29T18:19:43.872559] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-29T18:19:43.872938] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-29T18:19:43.873374] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-29T18:19:43.873743] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-29T18:19:43.879083] [DEBUG] [LOCAL ] DMA: Trimmed 6529 records to 4693 (keeping 200 days of data) [2025-10-29T18:19:43.882768] [DEBUG] [LOCAL ] DLY: Primary data saved (20562 records). [2025-10-29T18:19:43.882839] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-29T18:19:43.882930] [INFO ] [MAIN ] Update Progress: 632/2367 symbols completed. DLY took 28.8s. Estimated remaining: 3h 38m 46s. Rate: 7.9 symbols/min [2025-10-29T18:19:44.010555] [DEBUG] [LOCAL ] DMA: Primary data saved (4693 records). [2025-10-29T18:19:44.010715] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-29T18:19:44.011070] [INFO ] [MAIN ] Update Progress: 633/2367 symbols completed. DMA took 22.6s. Estimated remaining: 3h 38m 18s. Rate: 7.9 symbols/min [2025-10-29T18:19:44.181749] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:19:44.257450] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:19:44.261113] [DEBUG] [LOCAL ] DMO: Loaded 9429 existing records from primary storage. [2025-10-29T18:19:44.261586] [INFO ] [MAIN ] DMO: Loaded 9429 existing records. [2025-10-29T18:19:44.421816] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-29T18:19:44.466269] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:19:44.466671] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-29T18:19:44.466776] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-29T18:19:44.467351] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-29T18:19:44.467410] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-29T18:19:44.647311] [DEBUG] [LOCAL ] DNA: Loaded 48345 existing records from primary storage. [2025-10-29T18:19:44.690463] [INFO ] [MAIN ] DNA: Loaded 48345 existing records. [2025-10-29T18:19:45.059020] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:19:45.081987] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-29T18:19:45.083850] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-29T18:19:45.079950] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:19:45.093350] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-29T18:19:45.093459] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-29T18:19:45.094917] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-29T18:19:45.095035] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-29T18:19:45.200451] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-29T18:19:45.463893] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:19:45.993575] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-29T18:19:46.037322] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T18:19:46.537031] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T18:19:46.793569] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-29T18:19:47.398448] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T18:19:47.593562] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-29T18:19:48.259219] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T18:19:48.393544] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-29T18:19:49.193562] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-29T18:19:49.750554] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T18:19:49.869208] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T18:19:49.993576] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-29T18:19:50.793554] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-29T18:19:51.267247] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T18:19:51.417280] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T18:19:51.593581] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-29T18:19:52.118273] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T18:19:52.393678] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-29T18:19:53.193571] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-29T18:19:53.653633] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T18:19:53.851955] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-29T18:19:53.993577] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-29T18:19:54.793593] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-29T18:19:54.900255] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T18:19:54.906006] [INFO ] [REMOTE ] DLX: Full fetch complete (41418 records). [2025-10-29T18:19:54.906217] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-29T18:19:55.344297] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-29T18:19:55.389883] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-29T18:19:55.390027] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-29T18:19:55.391111] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-29T18:19:55.391190] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-29T18:19:55.392777] [DEBUG] [LOCAL ] DLX: Trimmed 41418 records to 27538 (keeping 200 days of data) [2025-10-29T18:19:55.599154] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-29T18:19:55.598999] [DEBUG] [LOCAL ] DLX: Primary data saved (27538 records). [2025-10-29T18:19:55.600624] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-29T18:19:55.600821] [INFO ] [MAIN ] Update Progress: 634/2367 symbols completed. DLX took 43.3s. Estimated remaining: 3h 38m 22s. Rate: 7.9 symbols/min [2025-10-29T18:19:55.809627] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:19:55.857269] [DEBUG] [LOCAL ] DNOW: Loaded 43622 existing records from primary storage. [2025-10-29T18:19:55.857744] [INFO ] [MAIN ] DNOW: Loaded 43622 existing records. [2025-10-29T18:19:56.069885] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:19:56.070199] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-29T18:19:56.070269] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-29T18:19:56.071262] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-29T18:19:56.071328] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-29T18:19:56.227739] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-29T18:19:56.398822] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-29T18:19:56.504166] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:19:56.946692] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-29T18:19:57.193604] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-29T18:19:57.682778] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-29T18:19:57.993732] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-29T18:19:58.793623] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-29T18:19:59.345752] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T18:19:59.363315] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-29T18:19:59.593566] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-29T18:20:00.393545] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-29T18:20:00.565186] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T18:20:01.193577] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-29T18:20:01.943295] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T18:20:01.993573] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-29T18:20:02.117986] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-29T18:20:02.708893] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T18:20:02.793570] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-29T18:20:03.386297] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-29T18:20:03.593593] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-29T18:20:04.393615] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-29T18:20:04.934622] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T18:20:05.037524] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T18:20:05.040954] [INFO ] [REMOTE ] DMB: Full fetch complete (14394 records). [2025-10-29T18:20:05.041211] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-29T18:20:05.041911] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:20:05.042021] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:20:05.042097] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:20:05.042193] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-29T18:20:05.042289] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-29T18:20:05.042345] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-29T18:20:05.042428] [DEBUG] [LOCAL ] DMB: No derivative data file found to delete. [2025-10-29T18:20:05.042523] [INFO ] [MAIN ] Update Progress: 635/2367 symbols completed. DMB took 29.7s. Estimated remaining: 3h 38m 19s. Rate: 7.9 symbols/min [2025-10-29T18:20:05.198790] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-29T18:20:05.255121] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:20:05.289518] [DEBUG] [LOCAL ] DNP: Loaded 32822 existing records from primary storage. [2025-10-29T18:20:05.289917] [INFO ] [MAIN ] DNP: Loaded 32822 existing records. [2025-10-29T18:20:05.489034] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:20:05.489432] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-29T18:20:05.489499] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-29T18:20:05.490511] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-29T18:20:05.490588] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-29T18:20:05.906494] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:20:05.993625] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-29T18:20:06.618280] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T18:20:06.793622] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-29T18:20:07.326993] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T18:20:07.593615] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-29T18:20:08.063543] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T18:20:08.308537] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T18:20:08.393602] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-29T18:20:09.193627] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-29T18:20:09.840078] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T18:20:09.993569] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-29T18:20:10.067211] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-29T18:20:10.793605] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-29T18:20:11.251720] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T18:20:11.480425] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-29T18:20:11.593543] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-29T18:20:12.373002] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T18:20:12.393522] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-29T18:20:13.193541] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-29T18:20:13.224974] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T18:20:13.822503] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T18:20:13.993573] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-29T18:20:14.793565] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-29T18:20:15.593612] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-29T18:20:15.863353] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-29T18:20:16.129827] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-29T18:20:16.140709] [INFO ] [REMOTE ] DNA: Full fetch complete (71010 records). [2025-10-29T18:20:16.140872] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-29T18:20:16.398710] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-29T18:20:16.557018] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-29T18:20:16.557095] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-29T18:20:16.557946] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-29T18:20:16.558009] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-29T18:20:16.559294] [DEBUG] [LOCAL ] DNA: Trimmed 71010 records to 48270 (keeping 200 days of data) [2025-10-29T18:20:16.829493] [DEBUG] [LOCAL ] DNA: Primary data saved (48270 records). [2025-10-29T18:20:16.829612] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-29T18:20:16.829714] [INFO ] [MAIN ] Update Progress: 636/2367 symbols completed. DNA took 32.8s. Estimated remaining: 3h 38m 23s. Rate: 7.9 symbols/min [2025-10-29T18:20:17.001661] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:20:17.051862] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-29T18:20:17.052154] [INFO ] [MAIN ] DOC: Loaded 53554 existing records. [2025-10-29T18:20:17.200850] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-29T18:20:17.231605] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:20:17.231827] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-29T18:20:17.231873] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-29T18:20:17.232796] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-29T18:20:17.232854] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-29T18:20:17.600349] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:20:17.633216] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-29T18:20:17.827402] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T18:20:17.829719] [INFO ] [REMOTE ] DMO: Full fetch complete (14271 records). [2025-10-29T18:20:17.829788] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-29T18:20:17.999039] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-29T18:20:18.187051] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-29T18:20:18.187200] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-29T18:20:18.187527] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-29T18:20:18.187568] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-29T18:20:18.188144] [DEBUG] [LOCAL ] DMO: Trimmed 14271 records to 9379 (keeping 200 days of data) [2025-10-29T18:20:18.244772] [DEBUG] [LOCAL ] DMO: Primary data saved (9379 records). [2025-10-29T18:20:18.244896] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-29T18:20:18.244973] [INFO ] [MAIN ] Update Progress: 637/2367 symbols completed. DMO took 34.4s. Estimated remaining: 3h 37m 59s. Rate: 7.9 symbols/min [2025-10-29T18:20:18.306834] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-29T18:20:18.793615] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-29T18:20:19.072142] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T18:20:19.593628] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-29T18:20:20.224844] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T18:20:20.399698] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-29T18:20:20.403952] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T18:20:21.193577] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-29T18:20:21.415511] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T18:20:21.993554] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-29T18:20:22.433792] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:20:22.793699] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-29T18:20:22.930745] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T18:20:23.593707] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-29T18:20:23.988745] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T18:20:24.393557] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-29T18:20:24.819725] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:20:25.193553] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-29T18:20:25.263615] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-29T18:20:25.993564] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-29T18:20:26.244081] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T18:20:26.799261] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-29T18:20:26.813173] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T18:20:27.593596] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-29T18:20:27.963131] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:20:28.393565] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-29T18:20:28.717055] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T18:20:28.725133] [INFO ] [REMOTE ] DNP: Full fetch complete (48140 records). [2025-10-29T18:20:28.725342] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-29T18:20:28.726185] [FATAL] [VALIDATOR ] DNP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:20:28.726274] [FATAL] [MAIN ] DNP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:20:28.726317] [WARN ] [MAIN ] DNP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:20:28.726356] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-29T18:20:28.726414] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-10-29T18:20:28.726450] [INFO ] [LOCAL ] DNP: Starting deletion of derivative data. [2025-10-29T18:20:28.726618] [DEBUG] [LOCAL ] DNP: Deleted derivative data file. [2025-10-29T18:20:28.726748] [INFO ] [MAIN ] Update Progress: 638/2367 symbols completed. DNP took 23.7s. Estimated remaining: 3h 37m 59s. Rate: 7.9 symbols/min [2025-10-29T18:20:29.193716] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-29T18:20:29.733708] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T18:20:29.743690] [INFO ] [REMOTE ] DNOW: Full fetch complete (63928 records). [2025-10-29T18:20:29.743805] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-29T18:20:30.122724] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-29T18:20:30.122803] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-29T18:20:30.123661] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-29T18:20:30.123726] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-29T18:20:30.125034] [DEBUG] [LOCAL ] DNOW: Trimmed 63928 records to 43614 (keeping 200 days of data) [2025-10-29T18:20:30.371930] [DEBUG] [LOCAL ] DNOW: Primary data saved (43614 records). [2025-10-29T18:20:30.372055] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-29T18:20:30.372150] [INFO ] [MAIN ] Update Progress: 639/2367 symbols completed. DNOW took 34.8s. Estimated remaining: 3h 37m 36s. Rate: 7.9 symbols/min [2025-10-29T18:20:30.691469] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-29T18:20:30.703155] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-29T18:20:32.039141] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T18:20:32.052300] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-29T18:20:33.469304] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T18:20:33.480094] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-29T18:20:34.979529] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T18:20:34.991379] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-29T18:20:36.508388] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-29T18:20:36.521379] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-29T18:20:37.851267] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T18:20:37.864000] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-29T18:20:39.649470] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-29T18:20:39.661445] [INFO ] [REMOTE ] DOC: Full fetch complete (77610 records). [2025-10-29T18:20:39.661582] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-29T18:20:40.067568] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-29T18:20:40.067681] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-29T18:20:40.068556] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-29T18:20:40.068599] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-29T18:20:40.070095] [DEBUG] [LOCAL ] DOC: Trimmed 77610 records to 53554 (keeping 200 days of data) [2025-10-29T18:20:40.403701] [DEBUG] [LOCAL ] DOC: Primary data saved (53554 records). [2025-10-29T18:20:40.403835] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-29T18:20:40.405047] [INFO ] [MAIN ] Update Progress: 640/2367 symbols completed. DOC took 23.6s. Estimated remaining: 3h 37m 35s. Rate: 7.9 symbols/min [2025-10-29T18:20:40.923626] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:20:41.134199] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:20:41.115330] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:20:41.183923] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:20:41.250330] [DEBUG] [LOCAL ] DOLE: Loaded 39074 existing records from primary storage. [2025-10-29T18:20:41.250836] [INFO ] [MAIN ] DOLE: Loaded 39074 existing records. [2025-10-29T18:20:41.348802] [DEBUG] [LOCAL ] DOUG: Loaded 33370 existing records from primary storage. [2025-10-29T18:20:41.383857] [DEBUG] [LOCAL ] DOCS: Loaded 50085 existing records from primary storage. [2025-10-29T18:20:41.390247] [DEBUG] [LOCAL ] DOCN: Loaded 51087 existing records from primary storage. [2025-10-29T18:20:41.399718] [INFO ] [MAIN ] DOUG: Loaded 33370 existing records. [2025-10-29T18:20:41.399992] [INFO ] [MAIN ] DOCS: Loaded 50085 existing records. [2025-10-29T18:20:41.401937] [INFO ] [MAIN ] DOCN: Loaded 51087 existing records. [2025-10-29T18:20:41.741940] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:20:41.833919] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-29T18:20:41.848976] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-29T18:20:41.920563] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-29T18:20:42.023489] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-29T18:20:42.051396] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:20:42.077915] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:20:42.104361] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-29T18:20:42.122736] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-29T18:20:42.128392] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:20:42.163306] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-29T18:20:42.194886] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-29T18:20:42.194747] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-29T18:20:42.195056] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-29T18:20:42.195208] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-29T18:20:42.201255] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-29T18:20:42.206478] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-29T18:20:42.195963] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-29T18:20:42.206510] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-29T18:20:42.252161] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-29T18:20:43.227901] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:20:43.267890] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-29T18:20:43.525885] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:20:43.598241] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-29T18:20:43.571606] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:20:43.598567] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-29T18:20:43.597912] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:20:43.600200] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-29T18:20:44.438751] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T18:20:44.448534] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-29T18:20:44.752418] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T18:20:44.760852] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-29T18:20:44.872483] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:20:44.882699] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-29T18:20:44.941787] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T18:20:44.952237] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-29T18:20:45.282509] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T18:20:45.289097] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-29T18:20:45.600772] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T18:20:45.607816] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-29T18:20:45.919400] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T18:20:45.929141] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-29T18:20:46.107575] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T18:20:46.115089] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-29T18:20:46.187609] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:20:46.197567] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-29T18:20:46.720382] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T18:20:46.728303] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-29T18:20:47.034492] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T18:20:47.043345] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-29T18:20:47.285707] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T18:20:47.298471] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-29T18:20:47.554892] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T18:20:47.593520] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-29T18:20:47.878351] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-29T18:20:48.242721] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T18:20:48.393741] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-29T18:20:48.525248] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T18:20:48.591494] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T18:20:49.193577] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-29T18:20:49.646491] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-29T18:20:49.993619] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-29T18:20:50.459867] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T18:20:50.793604] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-29T18:20:51.036319] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T18:20:51.536752] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T18:20:51.593556] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-29T18:20:52.393535] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-29T18:20:52.563129] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-29T18:20:53.193544] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-29T18:20:53.357246] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T18:20:53.993580] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-29T18:20:54.234467] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T18:20:54.793615] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-29T18:20:55.436838] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-29T18:20:55.593564] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-29T18:20:55.984895] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T18:20:56.393573] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-29T18:20:56.832055] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:20:57.193626] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-29T18:20:57.491593] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T18:20:57.993581] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-29T18:20:58.317787] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T18:20:58.793540] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-29T18:20:58.919002] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T18:20:59.593577] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-29T18:21:00.055902] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-29T18:21:00.065189] [INFO ] [REMOTE ] DOLE: Full fetch complete (54737 records). [2025-10-29T18:21:00.065328] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-29T18:21:00.400788] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-29T18:21:00.457457] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-29T18:21:00.457547] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-29T18:21:00.458435] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-29T18:21:00.458507] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-29T18:21:00.459996] [DEBUG] [LOCAL ] DOLE: Trimmed 54737 records to 39082 (keeping 200 days of data) [2025-10-29T18:21:00.697632] [DEBUG] [LOCAL ] DOLE: Primary data saved (39082 records). [2025-10-29T18:21:00.697793] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-29T18:21:00.697872] [INFO ] [MAIN ] Update Progress: 641/2367 symbols completed. DOLE took 20.3s. Estimated remaining: 3h 38m 2s. Rate: 7.9 symbols/min [2025-10-29T18:21:00.866915] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:21:00.910628] [DEBUG] [LOCAL ] DOV: Loaded 45528 existing records from primary storage. [2025-10-29T18:21:00.911037] [INFO ] [MAIN ] DOV: Loaded 45528 existing records. [2025-10-29T18:21:01.094807] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:21:01.095149] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-29T18:21:01.095410] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-29T18:21:01.096494] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-29T18:21:01.096702] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-29T18:21:01.196323] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-29T18:21:01.280717] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-29T18:21:01.566126] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:21:01.979786] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-29T18:21:01.993509] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-29T18:21:02.394558] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T18:21:02.401005] [INFO ] [REMOTE ] DOUG: Full fetch complete (49282 records). [2025-10-29T18:21:02.401161] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-29T18:21:02.795255] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-29T18:21:02.812682] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-29T18:21:02.812792] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-29T18:21:02.813568] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-29T18:21:02.813765] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-29T18:21:02.815065] [DEBUG] [LOCAL ] DOUG: Trimmed 49282 records to 33430 (keeping 200 days of data) [2025-10-29T18:21:03.010849] [DEBUG] [LOCAL ] DOUG: Primary data saved (33430 records). [2025-10-29T18:21:03.010984] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-29T18:21:03.011068] [INFO ] [MAIN ] Update Progress: 642/2367 symbols completed. DOUG took 22.6s. Estimated remaining: 3h 37m 40s. Rate: 7.9 symbols/min [2025-10-29T18:21:03.179799] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:21:03.230891] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-29T18:21:03.231305] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-29T18:21:03.431076] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:21:03.431497] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-29T18:21:03.431717] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-29T18:21:03.432702] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-29T18:21:03.432765] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-29T18:21:03.587986] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-29T18:21:03.633147] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-29T18:21:03.855313] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:21:04.159574] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T18:21:04.393576] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-29T18:21:05.034664] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T18:21:05.193565] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-29T18:21:05.969736] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-29T18:21:05.993527] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-29T18:21:06.223722] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-29T18:21:06.793588] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-29T18:21:07.422447] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-29T18:21:07.593598] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-29T18:21:08.030978] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T18:21:08.393589] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-29T18:21:08.974503] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T18:21:08.984599] [INFO ] [REMOTE ] DOCS: Full fetch complete (73539 records). [2025-10-29T18:21:08.984791] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-29T18:21:09.199068] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-29T18:21:09.394770] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-29T18:21:09.394879] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-29T18:21:09.396050] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-29T18:21:09.396133] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-29T18:21:09.397759] [DEBUG] [LOCAL ] DOCS: Trimmed 73539 records to 50043 (keeping 200 days of data) [2025-10-29T18:21:09.684737] [DEBUG] [LOCAL ] DOCS: Primary data saved (50043 records). [2025-10-29T18:21:09.684871] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-29T18:21:09.684947] [INFO ] [MAIN ] Update Progress: 643/2367 symbols completed. DOCS took 29.3s. Estimated remaining: 3h 37m 30s. Rate: 7.9 symbols/min [2025-10-29T18:21:09.854487] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:21:09.867523] [DEBUG] [LOCAL ] DPG: Loaded 13104 existing records from primary storage. [2025-10-29T18:21:09.867750] [INFO ] [MAIN ] DPG: Loaded 13104 existing records. [2025-10-29T18:21:09.994061] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-29T18:21:10.047672] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:21:10.063271] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-29T18:21:10.063843] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-29T18:21:10.074359] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-29T18:21:10.074825] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-29T18:21:10.076190] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-29T18:21:10.437492] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:21:10.793697] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-29T18:21:10.844486] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-29T18:21:11.412712] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T18:21:11.593551] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-29T18:21:11.696223] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:21:12.393555] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-29T18:21:12.838805] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T18:21:13.193606] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-29T18:21:13.864789] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T18:21:13.993545] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-29T18:21:14.460149] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-29T18:21:14.793594] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-29T18:21:15.593533] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-29T18:21:15.656538] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-29T18:21:16.393544] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-29T18:21:16.714196] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T18:21:16.757936] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-29T18:21:16.769051] [INFO ] [REMOTE ] DOCN: Full fetch complete (73213 records). [2025-10-29T18:21:16.769166] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-29T18:21:16.903352] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T18:21:17.192704] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-29T18:21:17.192788] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-29T18:21:17.193713] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-29T18:21:17.193825] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-29T18:21:17.193916] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-29T18:21:17.196351] [DEBUG] [LOCAL ] DOCN: Trimmed 73213 records to 51105 (keeping 200 days of data) [2025-10-29T18:21:17.489440] [DEBUG] [LOCAL ] DOCN: Primary data saved (51105 records). [2025-10-29T18:21:17.489577] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-29T18:21:17.489679] [INFO ] [MAIN ] Update Progress: 644/2367 symbols completed. DOCN took 37.1s. Estimated remaining: 3h 37m 23s. Rate: 7.9 symbols/min [2025-10-29T18:21:17.659699] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:21:17.696834] [DEBUG] [LOCAL ] DQ: Loaded 43647 existing records from primary storage. [2025-10-29T18:21:17.697106] [INFO ] [MAIN ] DQ: Loaded 43647 existing records. [2025-10-29T18:21:17.880163] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T18:21:17.884493] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:21:17.884770] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-29T18:21:17.887773] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-29T18:21:17.888540] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-29T18:21:17.888599] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-29T18:21:17.998682] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-29T18:21:18.245985] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:21:18.539555] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-29T18:21:18.793565] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-29T18:21:19.593612] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-29T18:21:19.849682] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T18:21:20.393752] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-29T18:21:21.193523] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-29T18:21:21.233202] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-29T18:21:21.523883] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:21:21.993575] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-29T18:21:22.425155] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T18:21:22.793563] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-29T18:21:23.222962] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:21:23.593573] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-29T18:21:23.982078] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T18:21:24.393556] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-29T18:21:25.115690] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-29T18:21:25.193528] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-29T18:21:25.274101] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T18:21:25.993766] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-29T18:21:26.793618] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-29T18:21:26.862189] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-29T18:21:27.364019] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-29T18:21:27.593578] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-29T18:21:27.991536] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-29T18:21:28.002961] [INFO ] [REMOTE ] DOV: Full fetch complete (66368 records). [2025-10-29T18:21:28.003125] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-29T18:21:28.332439] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-29T18:21:28.398710] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-29T18:21:28.420480] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-29T18:21:28.420560] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-29T18:21:28.421420] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-29T18:21:28.421483] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-29T18:21:28.422911] [DEBUG] [LOCAL ] DOV: Trimmed 66368 records to 45514 (keeping 200 days of data) [2025-10-29T18:21:28.707322] [DEBUG] [LOCAL ] DOV: Primary data saved (45514 records). [2025-10-29T18:21:28.707460] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-29T18:21:28.707541] [INFO ] [MAIN ] Update Progress: 645/2367 symbols completed. DOV took 28.0s. Estimated remaining: 3h 37m 25s. Rate: 7.9 symbols/min [2025-10-29T18:21:28.874904] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:21:28.909548] [DEBUG] [LOCAL ] DRD: Loaded 37883 existing records from primary storage. [2025-10-29T18:21:28.909854] [INFO ] [MAIN ] DRD: Loaded 37883 existing records. [2025-10-29T18:21:29.085885] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:21:29.086106] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-29T18:21:29.086155] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-29T18:21:29.086875] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-29T18:21:29.086934] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-29T18:21:29.198835] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-29T18:21:29.456064] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:21:29.601241] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T18:21:29.713299] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T18:21:29.993552] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-29T18:21:30.523633] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T18:21:30.793601] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-29T18:21:31.593633] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-29T18:21:32.393633] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-29T18:21:32.489833] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:21:32.562419] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-29T18:21:33.193548] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-29T18:21:33.423900] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T18:21:33.993634] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-29T18:21:34.083555] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T18:21:34.793595] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-29T18:21:35.593609] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-29T18:21:35.768098] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-29T18:21:35.771235] [INFO ] [REMOTE ] DPG: Full fetch complete (18900 records). [2025-10-29T18:21:35.771358] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-29T18:21:36.141271] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-29T18:21:36.234361] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-29T18:21:36.234437] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-29T18:21:36.234856] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-29T18:21:36.234917] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-29T18:21:36.235492] [DEBUG] [LOCAL ] DPG: Trimmed 18900 records to 13076 (keeping 200 days of data) [2025-10-29T18:21:36.315091] [DEBUG] [LOCAL ] DPG: Primary data saved (13076 records). [2025-10-29T18:21:36.315231] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-29T18:21:36.315308] [INFO ] [MAIN ] Update Progress: 646/2367 symbols completed. DPG took 26.6s. Estimated remaining: 3h 37m 18s. Rate: 7.9 symbols/min [2025-10-29T18:21:36.398756] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-29T18:21:36.496225] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:21:36.522796] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-29T18:21:36.567184] [DEBUG] [LOCAL ] DRH: Loaded 50049 existing records from primary storage. [2025-10-29T18:21:36.567505] [INFO ] [MAIN ] DRH: Loaded 50049 existing records. [2025-10-29T18:21:36.750491] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:21:36.750733] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-29T18:21:36.750802] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-29T18:21:36.751636] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-29T18:21:36.751730] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-29T18:21:37.110912] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:21:37.193550] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-29T18:21:37.566126] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T18:21:37.993613] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-29T18:21:38.568203] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T18:21:38.793579] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-29T18:21:39.236053] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T18:21:39.593549] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-29T18:21:40.393523] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-29T18:21:40.600267] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-29T18:21:40.611767] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-29T18:21:40.612094] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-29T18:21:41.044068] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-29T18:21:41.044395] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-29T18:21:41.045370] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-29T18:21:41.053361] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-29T18:21:41.068727] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T18:21:41.077588] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-29T18:21:41.193684] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-29T18:21:41.410229] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-29T18:21:41.410364] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-29T18:21:41.411847] [INFO ] [MAIN ] Update Progress: 647/2367 symbols completed. DOW took 38.4s. Estimated remaining: 3h 37m 4s. Rate: 7.9 symbols/min [2025-10-29T18:21:41.609191] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:21:41.645413] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-29T18:21:41.700217] [DEBUG] [LOCAL ] DRI: Loaded 47301 existing records from primary storage. [2025-10-29T18:21:41.700632] [INFO ] [MAIN ] DRI: Loaded 47301 existing records. [2025-10-29T18:21:41.930110] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:21:41.930344] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-29T18:21:41.930401] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-29T18:21:41.931532] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-29T18:21:41.931591] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-29T18:21:42.001433] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-29T18:21:42.339251] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:21:42.361793] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T18:21:42.793571] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-29T18:21:43.009222] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T18:21:43.593554] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-29T18:21:44.066786] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:21:44.393554] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-29T18:21:45.096089] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-29T18:21:45.193594] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-29T18:21:45.579887] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:21:45.993600] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-29T18:21:46.151929] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T18:21:46.793584] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-29T18:21:47.359693] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T18:21:47.593587] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-29T18:21:48.069977] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T18:21:48.393529] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-29T18:21:48.627202] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T18:21:49.193606] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-29T18:21:49.751976] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T18:21:49.763419] [INFO ] [REMOTE ] DQ: Full fetch complete (63844 records). [2025-10-29T18:21:49.763603] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-29T18:21:49.999990] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-29T18:21:50.180035] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-29T18:21:50.180123] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-29T18:21:50.180935] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-29T18:21:50.180998] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-29T18:21:50.182275] [DEBUG] [LOCAL ] DQ: Trimmed 63844 records to 43666 (keeping 200 days of data) [2025-10-29T18:21:50.436030] [DEBUG] [LOCAL ] DQ: Primary data saved (43666 records). [2025-10-29T18:21:50.436251] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-29T18:21:50.436449] [INFO ] [MAIN ] Update Progress: 648/2367 symbols completed. DQ took 32.9s. Estimated remaining: 3h 36m 60s. Rate: 7.9 symbols/min [2025-10-29T18:21:50.609993] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:21:50.642667] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T18:21:50.658129] [DEBUG] [LOCAL ] DRLL: Loaded 8432 existing records from primary storage. [2025-10-29T18:21:50.658899] [INFO ] [MAIN ] DRLL: Loaded 8432 existing records. [2025-10-29T18:21:50.799358] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-29T18:21:50.840916] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:21:50.841439] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-29T18:21:50.841508] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-29T18:21:50.841845] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-29T18:21:50.841910] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-29T18:21:51.310595] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:21:51.341299] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T18:21:51.593578] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-29T18:21:52.095066] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:21:52.393559] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-29T18:21:52.874943] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T18:21:53.193581] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-29T18:21:53.428860] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T18:21:53.993566] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-29T18:21:54.557773] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-29T18:21:54.591748] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T18:21:54.793621] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-29T18:21:55.593548] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-29T18:21:55.901947] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T18:21:56.043940] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-29T18:21:56.393599] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-29T18:21:57.085606] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T18:21:57.193582] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-29T18:21:57.764186] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-29T18:21:57.993590] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-29T18:21:58.793620] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-29T18:21:59.252954] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T18:21:59.593717] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-29T18:22:00.210886] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T18:22:00.393550] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-29T18:22:01.115290] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-29T18:22:01.193531] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-29T18:22:01.729064] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T18:22:01.993600] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-29T18:22:02.490014] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T18:22:02.793582] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-29T18:22:03.368235] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T18:22:03.532024] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-29T18:22:03.593563] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-29T18:22:04.393576] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-29T18:22:05.097985] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T18:22:05.193766] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-29T18:22:05.195360] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-29T18:22:05.206590] [INFO ] [REMOTE ] DRI: Full fetch complete (68997 records). [2025-10-29T18:22:05.206828] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-29T18:22:05.207616] [FATAL] [VALIDATOR ] DRI: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:22:05.207728] [FATAL] [MAIN ] DRI: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:22:05.207775] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:22:05.207845] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-29T18:22:05.207910] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-29T18:22:05.207948] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-29T18:22:05.208278] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-10-29T18:22:05.209198] [INFO ] [MAIN ] Update Progress: 649/2367 symbols completed. DRI took 23.8s. Estimated remaining: 3h 37m 11s. Rate: 7.9 symbols/min [2025-10-29T18:22:05.387584] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:05.387811] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-10-29T18:22:05.387855] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-10-29T18:22:05.387972] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-29T18:22:05.388013] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-29T18:22:05.388054] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-29T18:22:05.388086] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-29T18:22:05.754160] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:05.993555] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-29T18:22:06.619374] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-29T18:22:06.793548] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-29T18:22:07.030913] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T18:22:07.593599] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-29T18:22:08.077065] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T18:22:08.082828] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-29T18:22:08.095412] [INFO ] [REMOTE ] DRH: Full fetch complete (71947 records). [2025-10-29T18:22:08.095515] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-29T18:22:08.399300] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-29T18:22:08.497909] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-29T18:22:08.497992] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-29T18:22:08.498832] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-29T18:22:08.498895] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-29T18:22:08.500281] [DEBUG] [LOCAL ] DRH: Trimmed 71947 records to 50050 (keeping 200 days of data) [2025-10-29T18:22:08.785200] [DEBUG] [LOCAL ] DRH: Primary data saved (50050 records). [2025-10-29T18:22:08.785331] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-29T18:22:08.785416] [INFO ] [MAIN ] Update Progress: 650/2367 symbols completed. DRH took 32.5s. Estimated remaining: 3h 36m 53s. Rate: 7.9 symbols/min [2025-10-29T18:22:08.951051] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:08.964244] [DEBUG] [LOCAL ] DSM: Loaded 13784 existing records from primary storage. [2025-10-29T18:22:08.964473] [INFO ] [MAIN ] DSM: Loaded 13784 existing records. [2025-10-29T18:22:09.142996] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:22:09.143223] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-29T18:22:09.143277] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-29T18:22:09.143681] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-29T18:22:09.143738] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-29T18:22:09.198796] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-29T18:22:09.506555] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:22:09.541045] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:09.993561] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-29T18:22:10.757201] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T18:22:10.783783] [INFO ] [REMOTE ] DRD: Full fetch complete (52643 records). [2025-10-29T18:22:10.786238] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-29T18:22:10.800741] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-29T18:22:10.793911] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T18:22:11.210014] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-29T18:22:11.210181] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-29T18:22:11.211502] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-29T18:22:11.211574] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-29T18:22:11.213401] [DEBUG] [LOCAL ] DRD: Trimmed 52643 records to 37823 (keeping 200 days of data) [2025-10-29T18:22:11.349771] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-29T18:22:11.475765] [DEBUG] [LOCAL ] DRD: Primary data saved (37823 records). [2025-10-29T18:22:11.475984] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-29T18:22:11.476104] [INFO ] [MAIN ] Update Progress: 651/2367 symbols completed. DRD took 42.8s. Estimated remaining: 3h 36m 33s. Rate: 7.9 symbols/min [2025-10-29T18:22:11.598778] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-29T18:22:11.671202] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:11.671494] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-29T18:22:11.671718] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-29T18:22:11.671915] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-29T18:22:11.672021] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-29T18:22:11.672091] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-29T18:22:11.672152] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-29T18:22:12.064178] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:12.393635] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-29T18:22:12.654576] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T18:22:12.769486] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T18:22:13.193704] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-29T18:22:13.664313] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-29T18:22:13.993619] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-29T18:22:14.749471] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T18:22:14.793589] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-29T18:22:15.593541] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-29T18:22:15.660430] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-29T18:22:16.393555] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-29T18:22:16.423352] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T18:22:17.193617] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-29T18:22:17.436565] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T18:22:17.775267] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T18:22:17.993581] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-29T18:22:18.637022] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T18:22:18.638955] [INFO ] [REMOTE ] DRLL: Full fetch complete (14328 records). [2025-10-29T18:22:18.639027] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-29T18:22:18.639434] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:22:18.639518] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:22:18.639567] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:22:18.639637] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-29T18:22:18.639748] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-29T18:22:18.639788] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-29T18:22:18.639930] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-29T18:22:18.639998] [INFO ] [MAIN ] Update Progress: 652/2367 symbols completed. DRLL took 28.2s. Estimated remaining: 3h 36m 24s. Rate: 7.9 symbols/min [2025-10-29T18:22:18.805542] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-29T18:22:18.830307] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:18.852595] [DEBUG] [LOCAL ] DSU: Loaded 22359 existing records from primary storage. [2025-10-29T18:22:18.852874] [INFO ] [MAIN ] DSU: Loaded 22359 existing records. [2025-10-29T18:22:19.045673] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:22:19.046046] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-29T18:22:19.046113] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-29T18:22:19.046600] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-29T18:22:19.046693] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-29T18:22:19.180927] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-29T18:22:19.585777] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:19.593676] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-29T18:22:20.347619] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-29T18:22:20.393600] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-29T18:22:20.647884] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-29T18:22:21.193614] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-29T18:22:21.993585] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-29T18:22:22.125080] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T18:22:22.376105] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-29T18:22:22.793562] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-29T18:22:23.506368] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T18:22:23.593561] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-29T18:22:24.301483] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-29T18:22:24.393561] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-29T18:22:25.150724] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-29T18:22:25.193538] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-29T18:22:25.867321] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T18:22:25.993598] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-29T18:22:26.693252] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T18:22:26.793725] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-29T18:22:27.593574] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-29T18:22:27.783604] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T18:22:28.393615] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-29T18:22:28.462465] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T18:22:28.680991] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-29T18:22:29.193583] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-29T18:22:29.894892] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T18:22:29.993625] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-29T18:22:30.793624] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-29T18:22:30.891678] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T18:22:31.053018] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-29T18:22:31.593568] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-29T18:22:31.821462] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-29T18:22:32.393563] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-29T18:22:32.966329] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T18:22:33.193573] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-29T18:22:33.993559] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-29T18:22:34.307909] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T18:22:34.315938] [INFO ] [REMOTE ] DSL: Full fetch complete (42046 records). [2025-10-29T18:22:34.316108] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-29T18:22:34.714892] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T18:22:34.787703] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-29T18:22:34.787792] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-29T18:22:34.788634] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-29T18:22:34.788712] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-29T18:22:34.789803] [DEBUG] [LOCAL ] DSL: Trimmed 42046 records to 28586 (keeping 200 days of data) [2025-10-29T18:22:34.848759] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-29T18:22:34.992051] [DEBUG] [LOCAL ] DSL: Primary data saved (28586 records). [2025-10-29T18:22:34.992199] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-29T18:22:34.992284] [INFO ] [MAIN ] Update Progress: 653/2367 symbols completed. DSL took 29.8s. Estimated remaining: 3h 36m 39s. Rate: 7.9 symbols/min [2025-10-29T18:22:35.198427] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:35.204521] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T18:22:35.224119] [DEBUG] [LOCAL ] DSX: Loaded 23143 existing records from primary storage. [2025-10-29T18:22:35.224392] [INFO ] [MAIN ] DSX: Loaded 23143 existing records. [2025-10-29T18:22:35.406014] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:22:35.406231] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-29T18:22:35.406278] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-29T18:22:35.406848] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-29T18:22:35.406904] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-29T18:22:35.600213] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-29T18:22:35.761494] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:36.393569] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-29T18:22:36.429636] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T18:22:36.939101] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-29T18:22:37.193552] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-29T18:22:37.993591] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-29T18:22:38.090389] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T18:22:38.786902] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-29T18:22:38.793513] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-29T18:22:39.593573] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-29T18:22:39.640902] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T18:22:40.143294] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-29T18:22:40.393568] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-29T18:22:41.193527] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-29T18:22:41.254318] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T18:22:41.653470] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-29T18:22:41.993591] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-29T18:22:42.563486] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-29T18:22:42.793557] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-29T18:22:43.593572] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-29T18:22:43.823607] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-29T18:22:43.831384] [INFO ] [REMOTE ] DSU: Full fetch complete (32874 records). [2025-10-29T18:22:43.831552] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-29T18:22:44.122881] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T18:22:44.124086] [INFO ] [REMOTE ] DSMC: Full fetch complete (2908 records). [2025-10-29T18:22:44.129736] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-29T18:22:44.330002] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-29T18:22:44.335803] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-29T18:22:44.346727] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-29T18:22:44.346811] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-29T18:22:44.413109] [DEBUG] [LOCAL ] DSU: Trimmed 32874 records to 22385 (keeping 200 days of data) [2025-10-29T18:22:44.409761] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-29T18:22:44.745155] [DEBUG] [LOCAL ] DSU: Primary data saved (22385 records). [2025-10-29T18:22:44.766862] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-29T18:22:44.766996] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-29T18:22:44.767143] [INFO ] [MAIN ] Update Progress: 654/2367 symbols completed. DSU took 26.1s. Estimated remaining: 3h 36m 38s. Rate: 7.9 symbols/min [2025-10-29T18:22:44.767068] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-29T18:22:44.767400] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-29T18:22:44.798542] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-29T18:22:44.842307] [DEBUG] [LOCAL ] DSMC: Trimmed 2908 records to 1739 (keeping 200 days of data) [2025-10-29T18:22:44.879107] [DEBUG] [LOCAL ] DSMC: Primary data saved (1739 records). [2025-10-29T18:22:44.884514] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-29T18:22:44.889726] [INFO ] [MAIN ] Update Progress: 655/2367 symbols completed. DSMC took 33.4s. Estimated remaining: 3h 36m 11s. Rate: 7.9 symbols/min [2025-10-29T18:22:45.049314] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:45.120208] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:45.127607] [DEBUG] [LOCAL ] DTB: Loaded 4861 existing records from primary storage. [2025-10-29T18:22:45.128267] [INFO ] [MAIN ] DTB: Loaded 4861 existing records. [2025-10-29T18:22:45.196117] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-29T18:22:45.282266] [DEBUG] [LOCAL ] DT: Loaded 52899 existing records from primary storage. [2025-10-29T18:22:45.330834] [INFO ] [MAIN ] DT: Loaded 52899 existing records. [2025-10-29T18:22:45.359590] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:22:45.359983] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-29T18:22:45.360089] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-29T18:22:45.366798] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T18:22:45.410159] [INFO ] [REMOTE ] DSM: Full fetch complete (24286 records). [2025-10-29T18:22:45.423075] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-29T18:22:45.410042] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-29T18:22:45.445879] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-29T18:22:45.799456] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:22:45.824239] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-29T18:22:45.829486] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-29T18:22:45.855591] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-29T18:22:45.934839] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-29T18:22:46.401213] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-29T18:22:46.417193] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-29T18:22:46.456330] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-29T18:22:46.497620] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-29T18:22:46.604714] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:46.610278] [DEBUG] [LOCAL ] DSM: Trimmed 24286 records to 13872 (keeping 200 days of data) [2025-10-29T18:22:46.636737] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-29T18:22:46.729403] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T18:22:46.794613] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-29T18:22:46.854817] [DEBUG] [LOCAL ] DSM: Primary data saved (13872 records). [2025-10-29T18:22:46.875488] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-29T18:22:46.894622] [INFO ] [MAIN ] Update Progress: 656/2367 symbols completed. DSM took 38.1s. Estimated remaining: 3h 35m 48s. Rate: 7.9 symbols/min [2025-10-29T18:22:47.190788] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:47.240589] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:47.245861] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-29T18:22:47.246048] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-10-29T18:22:47.246292] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-10-29T18:22:47.248258] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-29T18:22:47.248314] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-29T18:22:47.248358] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-29T18:22:47.248393] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-29T18:22:47.593812] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-29T18:22:47.658315] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:47.673448] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T18:22:48.393561] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-29T18:22:48.952215] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T18:22:49.067439] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T18:22:49.193577] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-29T18:22:49.993567] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-29T18:22:50.456940] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-29T18:22:50.788461] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T18:22:50.794096] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-29T18:22:51.593580] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-29T18:22:52.105261] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T18:22:52.393545] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-29T18:22:52.711237] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-29T18:22:52.867264] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T18:22:53.193612] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-29T18:22:53.993552] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-29T18:22:54.015142] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T18:22:54.793539] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-29T18:22:55.227057] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:22:55.579461] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-29T18:22:55.593526] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-29T18:22:56.393559] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-29T18:22:56.586291] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T18:22:56.591116] [INFO ] [REMOTE ] DSX: Full fetch complete (35093 records). [2025-10-29T18:22:56.591239] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-29T18:22:56.960382] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-29T18:22:56.960471] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-29T18:22:56.961035] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-29T18:22:56.961095] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-29T18:22:56.961870] [DEBUG] [LOCAL ] DSX: Trimmed 35093 records to 23080 (keeping 200 days of data) [2025-10-29T18:22:57.088370] [DEBUG] [LOCAL ] DSX: Primary data saved (23080 records). [2025-10-29T18:22:57.088487] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-29T18:22:57.088559] [INFO ] [MAIN ] Update Progress: 657/2367 symbols completed. DSX took 22.1s. Estimated remaining: 3h 35m 48s. Rate: 7.9 symbols/min [2025-10-29T18:22:57.198695] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-29T18:22:57.256730] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:22:57.256905] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-29T18:22:57.256948] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-29T18:22:57.257053] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-29T18:22:57.257092] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-29T18:22:57.257135] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-29T18:22:57.257164] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-29T18:22:57.621162] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:22:57.694141] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-29T18:22:57.700782] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T18:22:57.993561] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-29T18:22:58.372263] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T18:22:58.793610] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-29T18:22:59.593599] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-29T18:23:00.211174] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-29T18:23:00.393562] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-29T18:23:01.193601] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-29T18:23:01.993599] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-29T18:23:04.093822] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (4.50 seconds). [2025-10-29T18:23:04.095378] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-29T18:23:04.824314] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-10-29T18:23:04.825262] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-29T18:23:05.799575] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T18:23:05.801027] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-29T18:23:05.835821] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-29T18:23:05.837431] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-29T18:23:06.192750] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-29T18:23:06.193973] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-29T18:23:06.237323] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T18:23:06.238862] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (5.05 seconds). [2025-10-29T18:23:06.460400] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-29T18:23:06.461825] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (6.07 seconds). [2025-10-29T18:23:06.793557] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-29T18:23:07.593585] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-29T18:23:08.248494] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T18:23:08.393556] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-29T18:23:08.778125] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T18:23:08.843780] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T18:23:09.193623] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-29T18:23:09.993602] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-29T18:23:10.238290] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-29T18:23:10.319351] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T18:23:10.793576] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-29T18:23:11.316538] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T18:23:11.593564] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-29T18:23:11.946297] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-29T18:23:12.393691] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-29T18:23:12.661319] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-29T18:23:13.193602] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-29T18:23:13.993557] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-29T18:23:14.382303] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T18:23:14.793555] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-29T18:23:15.085481] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-29T18:23:15.382074] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T18:23:15.593563] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-29T18:23:15.922806] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-29T18:23:15.923612] [INFO ] [REMOTE ] DTF: Full fetch complete (1707 records). [2025-10-29T18:23:15.923722] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-29T18:23:15.924102] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:23:15.924180] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:23:15.924222] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:23:15.924259] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-29T18:23:15.924314] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-29T18:23:15.924348] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-29T18:23:15.924386] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-29T18:23:15.924434] [INFO ] [MAIN ] Update Progress: 658/2367 symbols completed. DTF took 18.8s. Estimated remaining: 3h 36m 9s. Rate: 7.9 symbols/min [2025-10-29T18:23:16.094684] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:23:16.101485] [DEBUG] [LOCAL ] DTG: Loaded 5605 existing records from primary storage. [2025-10-29T18:23:16.101717] [INFO ] [MAIN ] DTG: Loaded 5605 existing records. [2025-10-29T18:23:16.276987] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:23:16.277161] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-29T18:23:16.277210] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-29T18:23:16.277373] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-29T18:23:16.277429] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-29T18:23:16.398727] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-29T18:23:16.630070] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:23:17.005195] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-29T18:23:17.193547] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-29T18:23:17.614330] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-29T18:23:17.993615] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-29T18:23:18.793615] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-29T18:23:19.116814] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-29T18:23:19.315769] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T18:23:19.593581] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-29T18:23:20.089256] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-29T18:23:20.090445] [INFO ] [REMOTE ] DTB: Full fetch complete (6464 records). [2025-10-29T18:23:20.090512] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-29T18:23:20.402484] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-29T18:23:20.443025] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-29T18:23:20.443091] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-29T18:23:20.443280] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-29T18:23:20.443317] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-29T18:23:20.443706] [DEBUG] [LOCAL ] DTB: Trimmed 6464 records to 4821 (keeping 200 days of data) [2025-10-29T18:23:20.473115] [DEBUG] [LOCAL ] DTB: Primary data saved (4821 records). [2025-10-29T18:23:20.473195] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-29T18:23:20.473265] [INFO ] [MAIN ] Update Progress: 659/2367 symbols completed. DTB took 35.6s. Estimated remaining: 3h 35m 54s. Rate: 7.9 symbols/min [2025-10-29T18:23:20.644314] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:23:20.644512] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-29T18:23:20.644566] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-29T18:23:20.644696] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-29T18:23:20.644748] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-29T18:23:20.644793] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-29T18:23:20.644825] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-29T18:23:20.991781] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:23:21.193544] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-29T18:23:21.363141] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T18:23:21.363404] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-29T18:23:21.363489] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:23:21.363534] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-29T18:23:21.363566] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:23:21.363629] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-29T18:23:21.363725] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-29T18:23:21.363767] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-29T18:23:21.363806] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-29T18:23:21.363852] [INFO ] [MAIN ] Update Progress: 660/2367 symbols completed. DTK took 0.9s. Estimated remaining: 3h 35m 29s. Rate: 7.9 symbols/min [2025-10-29T18:23:21.529243] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:23:21.573137] [DEBUG] [LOCAL ] DTM: Loaded 43576 existing records from primary storage. [2025-10-29T18:23:21.573408] [INFO ] [MAIN ] DTM: Loaded 43576 existing records. [2025-10-29T18:23:21.758202] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:23:21.758438] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-29T18:23:21.758549] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-29T18:23:21.759084] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-29T18:23:21.759141] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-29T18:23:22.000677] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-29T18:23:22.153598] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:23:22.155276] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-29T18:23:22.507631] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T18:23:22.793603] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-29T18:23:23.208990] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-29T18:23:23.593574] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-29T18:23:24.393559] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-29T18:23:24.845751] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T18:23:25.193555] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-29T18:23:25.457027] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-29T18:23:25.993557] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-29T18:23:26.286482] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T18:23:26.381283] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-29T18:23:26.793569] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-29T18:23:27.593592] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-29T18:23:28.074532] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-29T18:23:28.076069] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T18:23:28.393551] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-29T18:23:29.193559] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-29T18:23:29.566476] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-29T18:23:29.993530] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-29T18:23:30.193413] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-29T18:23:30.204760] [INFO ] [REMOTE ] DT: Full fetch complete (76865 records). [2025-10-29T18:23:30.204909] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-29T18:23:30.490898] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-29T18:23:30.629776] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-29T18:23:30.629870] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-29T18:23:30.630807] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-29T18:23:30.630874] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-29T18:23:30.632457] [DEBUG] [LOCAL ] DT: Trimmed 76865 records to 52897 (keeping 200 days of data) [2025-10-29T18:23:30.795449] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-29T18:23:30.945362] [DEBUG] [LOCAL ] DT: Primary data saved (52897 records). [2025-10-29T18:23:30.945509] [INFO ] [MAIN ] DT: Full history saved. [2025-10-29T18:23:30.945603] [INFO ] [MAIN ] Update Progress: 661/2367 symbols completed. DT took 46.2s. Estimated remaining: 3h 35m 27s. Rate: 7.9 symbols/min [2025-10-29T18:23:31.114067] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:23:31.114231] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-29T18:23:31.114268] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-29T18:23:31.114376] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-29T18:23:31.114416] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-29T18:23:31.114456] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-29T18:23:31.114488] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-29T18:23:31.460380] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:23:31.593524] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-29T18:23:32.013622] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-29T18:23:32.401415] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-29T18:23:32.408824] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-29T18:23:33.193615] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-29T18:23:33.566769] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T18:23:33.670139] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T18:23:33.993562] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-29T18:23:34.423485] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-29T18:23:34.793589] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-29T18:23:35.261980] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-29T18:23:35.593589] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-29T18:23:36.393545] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-29T18:23:36.841314] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T18:23:36.887754] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-29T18:23:36.889556] [INFO ] [REMOTE ] DTG: Full fetch complete (8342 records). [2025-10-29T18:23:36.889694] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-29T18:23:36.890156] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:23:36.890240] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:23:36.890284] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:23:36.890324] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-29T18:23:36.890380] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-29T18:23:36.890415] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-29T18:23:36.890906] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-10-29T18:23:36.891237] [INFO ] [MAIN ] Update Progress: 662/2367 symbols completed. DTG took 21.0s. Estimated remaining: 3h 35m 15s. Rate: 7.9 symbols/min [2025-10-29T18:23:37.062757] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:23:37.124478] [DEBUG] [LOCAL ] DUK: Loaded 53418 existing records from primary storage. [2025-10-29T18:23:37.124859] [INFO ] [MAIN ] DUK: Loaded 53418 existing records. [2025-10-29T18:23:37.198762] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-29T18:23:37.306279] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:23:37.306491] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-29T18:23:37.306540] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-29T18:23:37.307594] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-29T18:23:37.307914] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-29T18:23:37.680941] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:23:37.993558] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-29T18:23:38.549588] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T18:23:38.558953] [INFO ] [REMOTE ] DTE: Full fetch complete (68809 records). [2025-10-29T18:23:38.559066] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-29T18:23:38.798736] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-29T18:23:38.968685] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-29T18:23:38.968793] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-29T18:23:38.969614] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-29T18:23:38.969834] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-29T18:23:38.971166] [DEBUG] [LOCAL ] DTE: Trimmed 68809 records to 46871 (keeping 200 days of data) [2025-10-29T18:23:39.209406] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T18:23:39.240592] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-29T18:23:39.299401] [DEBUG] [LOCAL ] DTE: Primary data saved (46871 records). [2025-10-29T18:23:39.299525] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-29T18:23:39.299590] [INFO ] [MAIN ] Update Progress: 663/2367 symbols completed. DTE took 52.4s. Estimated remaining: 3h 34m 54s. Rate: 7.9 symbols/min [2025-10-29T18:23:39.466156] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:23:39.474149] [DEBUG] [LOCAL ] DUKB: Loaded 5882 existing records from primary storage. [2025-10-29T18:23:39.474332] [INFO ] [MAIN ] DUKB: Loaded 5882 existing records. [2025-10-29T18:23:39.598633] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-29T18:23:39.652213] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:23:39.652498] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-29T18:23:39.652552] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-29T18:23:39.652727] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-29T18:23:39.652782] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-29T18:23:40.003090] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:23:40.310567] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-29T18:23:40.393557] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-29T18:23:41.193595] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-29T18:23:41.652140] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-29T18:23:41.714830] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T18:23:41.993556] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-29T18:23:42.793601] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-29T18:23:43.071904] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T18:23:43.283006] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-29T18:23:43.593585] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-29T18:23:44.393558] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-29T18:23:44.840859] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-29T18:23:45.074909] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-29T18:23:45.193565] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-29T18:23:45.993590] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-29T18:23:46.487387] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T18:23:46.543816] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-29T18:23:46.793568] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-29T18:23:47.170442] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-29T18:23:47.593599] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-29T18:23:48.393557] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-29T18:23:48.983125] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T18:23:49.193572] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-29T18:23:49.994386] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-29T18:23:49.996995] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-29T18:23:50.383517] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T18:23:50.677561] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T18:23:50.793589] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-29T18:23:51.168909] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T18:23:51.593639] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-29T18:23:52.021318] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-29T18:23:52.393534] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-29T18:23:53.193699] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-29T18:23:53.771124] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T18:23:53.780879] [INFO ] [REMOTE ] DTM: Full fetch complete (65274 records). [2025-10-29T18:23:53.781027] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-29T18:23:53.999374] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-29T18:23:54.061551] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T18:23:54.091182] [INFO ] [REMOTE ] DTW: Full fetch complete (6855 records). [2025-10-29T18:23:54.091480] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-29T18:23:54.312120] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-29T18:23:54.317373] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-29T18:23:54.323403] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-29T18:23:54.328606] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-29T18:23:54.391803] [DEBUG] [LOCAL ] DTM: Trimmed 65274 records to 43541 (keeping 200 days of data) [2025-10-29T18:23:54.704385] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-29T18:23:54.710969] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-29T18:23:54.711341] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-29T18:23:54.711389] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-29T18:23:54.774109] [DEBUG] [LOCAL ] DTW: Trimmed 6855 records to 4575 (keeping 200 days of data) [2025-10-29T18:23:54.821727] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-29T18:23:54.847178] [DEBUG] [LOCAL ] DTW: Primary data saved (4575 records). [2025-10-29T18:23:54.848738] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-29T18:23:54.849546] [INFO ] [MAIN ] Update Progress: 664/2367 symbols completed. DTW took 23.9s. Estimated remaining: 3h 35m 7s. Rate: 7.9 symbols/min [2025-10-29T18:23:55.089131] [DEBUG] [LOCAL ] DTM: Primary data saved (43541 records). [2025-10-29T18:23:55.090924] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-29T18:23:55.091364] [INFO ] [MAIN ] Update Progress: 665/2367 symbols completed. DTM took 33.7s. Estimated remaining: 3h 34m 41s. Rate: 7.9 symbols/min [2025-10-29T18:23:55.110033] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:23:55.292057] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T18:23:55.312028] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:23:55.362014] [DEBUG] [LOCAL ] DV: Loaded 51217 existing records from primary storage. [2025-10-29T18:23:55.362436] [INFO ] [MAIN ] DV: Loaded 51217 existing records. [2025-10-29T18:23:55.481480] [DEBUG] [LOCAL ] DVA: Loaded 40399 existing records from primary storage. [2025-10-29T18:23:55.487556] [INFO ] [MAIN ] DVA: Loaded 40399 existing records. [2025-10-29T18:23:55.604423] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-29T18:23:55.669772] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:23:55.710888] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-29T18:23:55.721813] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-29T18:23:55.747206] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-29T18:23:55.753936] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-29T18:23:55.753773] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:23:55.765801] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-29T18:23:55.797388] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-29T18:23:55.824025] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-29T18:23:55.829854] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-29T18:23:56.347954] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T18:23:56.341797] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-29T18:23:56.404868] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-29T18:23:56.492914] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:23:56.566044] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:23:57.193559] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-29T18:23:57.648577] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-29T18:23:57.881418] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-29T18:23:57.993548] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-29T18:23:58.301911] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:23:58.793550] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-29T18:23:59.593639] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-29T18:24:00.002562] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-29T18:24:00.164056] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T18:24:00.393623] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-29T18:24:01.193576] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-29T18:24:01.636296] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-29T18:24:01.638099] [INFO ] [REMOTE ] DUKB: Full fetch complete (8861 records). [2025-10-29T18:24:01.638202] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-29T18:24:01.638884] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:24:01.638975] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:24:01.639020] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:24:01.639092] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-29T18:24:01.639163] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-29T18:24:01.639201] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-29T18:24:01.639473] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-29T18:24:01.639578] [INFO ] [MAIN ] Update Progress: 666/2367 symbols completed. DUKB took 22.3s. Estimated remaining: 3h 34m 30s. Rate: 7.9 symbols/min [2025-10-29T18:24:01.845361] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:24:01.897503] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-29T18:24:01.960851] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-29T18:24:01.961362] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-29T18:24:01.998763] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-29T18:24:02.166782] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:24:02.167161] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-29T18:24:02.167266] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-29T18:24:02.168233] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-29T18:24:02.168299] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-29T18:24:02.571337] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:24:02.793564] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-29T18:24:03.223134] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T18:24:03.593551] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-29T18:24:04.018014] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T18:24:04.393570] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-29T18:24:04.914750] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T18:24:05.193561] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-29T18:24:05.669182] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T18:24:05.993563] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-29T18:24:06.799050] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-29T18:24:06.805834] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-29T18:24:07.191159] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T18:24:07.593565] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-29T18:24:08.393560] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-29T18:24:08.554954] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-29T18:24:08.766548] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T18:24:09.193558] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-29T18:24:09.844147] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T18:24:09.993576] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-29T18:24:10.327096] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T18:24:10.793617] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-29T18:24:11.593548] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-29T18:24:11.639123] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-29T18:24:11.650293] [INFO ] [REMOTE ] DUK: Full fetch complete (77558 records). [2025-10-29T18:24:11.650432] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-29T18:24:12.066755] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-29T18:24:12.066857] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-29T18:24:12.067853] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-29T18:24:12.067919] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-29T18:24:12.069457] [DEBUG] [LOCAL ] DUK: Trimmed 77558 records to 53417 (keeping 200 days of data) [2025-10-29T18:24:12.397851] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-29T18:24:12.425149] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-29T18:24:12.448841] [DEBUG] [LOCAL ] DUK: Primary data saved (53417 records). [2025-10-29T18:24:12.449514] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-29T18:24:12.450469] [INFO ] [MAIN ] Update Progress: 667/2367 symbols completed. DUK took 35.6s. Estimated remaining: 3h 34m 31s. Rate: 7.9 symbols/min [2025-10-29T18:24:12.625558] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:24:12.680429] [DEBUG] [LOCAL ] DX: Loaded 52482 existing records from primary storage. [2025-10-29T18:24:12.680925] [INFO ] [MAIN ] DX: Loaded 52482 existing records. [2025-10-29T18:24:12.894921] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:24:12.895229] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-29T18:24:12.895290] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-29T18:24:12.898052] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-29T18:24:12.897970] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:24:12.898157] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-29T18:24:13.198766] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-29T18:24:13.262253] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:24:13.788858] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T18:24:13.993567] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-29T18:24:14.793548] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-29T18:24:14.946889] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-29T18:24:15.374348] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T18:24:15.593615] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-29T18:24:16.060255] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T18:24:16.393565] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-29T18:24:17.199683] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-29T18:24:17.213565] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-29T18:24:17.751174] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T18:24:17.993524] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-29T18:24:18.349002] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T18:24:18.793587] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-29T18:24:19.503084] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-29T18:24:19.593554] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-29T18:24:20.235345] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-29T18:24:20.393572] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-29T18:24:20.582988] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T18:24:21.193588] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-29T18:24:21.837637] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:24:21.993589] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-29T18:24:22.314819] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T18:24:22.793563] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-29T18:24:23.460899] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T18:24:23.593563] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-29T18:24:23.983146] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T18:24:24.393545] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-29T18:24:25.076711] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T18:24:25.193571] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-29T18:24:25.993530] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-29T18:24:26.038883] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-29T18:24:26.362059] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T18:24:26.793568] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-29T18:24:27.181889] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T18:24:27.593602] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-29T18:24:28.393589] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-29T18:24:28.839730] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-29T18:24:28.851220] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-29T18:24:28.851363] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-29T18:24:29.125535] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-29T18:24:29.194135] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-29T18:24:29.337103] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-29T18:24:29.337217] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-29T18:24:29.338269] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-29T18:24:29.338352] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-29T18:24:29.340013] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 53699 (keeping 200 days of data) [2025-10-29T18:24:29.586281] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T18:24:29.707488] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-10-29T18:24:29.707630] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-29T18:24:29.707748] [INFO ] [MAIN ] Update Progress: 668/2367 symbols completed. DVN took 28.1s. Estimated remaining: 3h 34m 48s. Rate: 7.9 symbols/min [2025-10-29T18:24:29.881512] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:24:29.926330] [DEBUG] [LOCAL ] DXC: Loaded 49802 existing records from primary storage. [2025-10-29T18:24:29.926629] [INFO ] [MAIN ] DXC: Loaded 49802 existing records. [2025-10-29T18:24:30.001131] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-29T18:24:30.109228] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:24:30.109444] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-29T18:24:30.109493] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-29T18:24:30.110055] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-29T18:24:30.110113] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-29T18:24:30.472889] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:24:30.655686] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T18:24:30.793557] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-29T18:24:31.423043] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-29T18:24:31.434285] [INFO ] [REMOTE ] DV: Full fetch complete (73898 records). [2025-10-29T18:24:31.434430] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-29T18:24:31.598635] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-29T18:24:31.862602] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-29T18:24:31.862724] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-29T18:24:31.863621] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-29T18:24:31.863713] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-29T18:24:31.865348] [DEBUG] [LOCAL ] DV: Trimmed 73898 records to 51192 (keeping 200 days of data) [2025-10-29T18:24:32.185591] [DEBUG] [LOCAL ] DV: Primary data saved (51192 records). [2025-10-29T18:24:32.198479] [INFO ] [MAIN ] DV: Full history saved. [2025-10-29T18:24:32.198577] [INFO ] [MAIN ] Update Progress: 669/2367 symbols completed. DV took 37.3s. Estimated remaining: 3h 34m 28s. Rate: 7.9 symbols/min [2025-10-29T18:24:32.261348] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-29T18:24:32.391537] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:24:32.393578] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-29T18:24:32.425442] [DEBUG] [LOCAL ] DXYZ: Loaded 36619 existing records from primary storage. [2025-10-29T18:24:32.425761] [INFO ] [MAIN ] DXYZ: Loaded 36619 existing records. [2025-10-29T18:24:32.621236] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:24:32.621505] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-29T18:24:32.621603] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-29T18:24:32.622393] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-29T18:24:32.622459] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-29T18:24:32.762815] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T18:24:33.021095] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:24:33.193548] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-29T18:24:33.807591] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T18:24:33.993582] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-29T18:24:34.793533] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-29T18:24:34.898178] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-29T18:24:34.960906] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T18:24:35.593604] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-29T18:24:35.998034] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T18:24:36.005925] [INFO ] [REMOTE ] DVA: Full fetch complete (59303 records). [2025-10-29T18:24:36.006075] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-29T18:24:36.006742] [FATAL] [VALIDATOR ] DVA: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:24:36.006835] [FATAL] [MAIN ] DVA: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:24:36.006877] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:24:36.006916] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-29T18:24:36.006970] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-29T18:24:36.007004] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-10-29T18:24:36.007180] [DEBUG] [LOCAL ] DVA: Deleted derivative data file. [2025-10-29T18:24:36.007271] [INFO ] [MAIN ] Update Progress: 670/2367 symbols completed. DVA took 40.9s. Estimated remaining: 3h 34m 11s. Rate: 7.9 symbols/min [2025-10-29T18:24:36.176796] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:24:36.203384] [DEBUG] [LOCAL ] DY: Loaded 27594 existing records from primary storage. [2025-10-29T18:24:36.203638] [INFO ] [MAIN ] DY: Loaded 27594 existing records. [2025-10-29T18:24:36.384525] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:24:36.384761] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-29T18:24:36.384820] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-29T18:24:36.385297] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-29T18:24:36.385353] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-29T18:24:36.398796] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-29T18:24:36.749755] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:24:37.132287] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-29T18:24:37.193521] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-29T18:24:37.783487] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T18:24:37.993562] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-29T18:24:38.561277] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T18:24:38.793547] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-29T18:24:39.409011] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T18:24:39.593547] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-29T18:24:40.159332] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T18:24:40.393545] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-29T18:24:40.581084] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T18:24:41.193571] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-29T18:24:41.641214] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T18:24:41.993563] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-29T18:24:42.741912] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-29T18:24:42.753062] [INFO ] [REMOTE ] DX: Full fetch complete (75934 records). [2025-10-29T18:24:42.753216] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-29T18:24:42.798767] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-29T18:24:43.159319] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-29T18:24:43.159397] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-29T18:24:43.160261] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-29T18:24:43.160333] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-29T18:24:43.161748] [DEBUG] [LOCAL ] DX: Trimmed 75934 records to 52472 (keeping 200 days of data) [2025-10-29T18:24:43.503634] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-29T18:24:43.516260] [DEBUG] [LOCAL ] DX: Primary data saved (52472 records). [2025-10-29T18:24:43.516916] [INFO ] [MAIN ] DX: Full history saved. [2025-10-29T18:24:43.518097] [INFO ] [MAIN ] Update Progress: 671/2367 symbols completed. DX took 31.1s. Estimated remaining: 3h 34m 3s. Rate: 7.9 symbols/min [2025-10-29T18:24:43.598686] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-29T18:24:43.701157] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:24:43.737234] [DEBUG] [LOCAL ] E: Loaded 32661 existing records from primary storage. [2025-10-29T18:24:43.737536] [INFO ] [MAIN ] E: Loaded 32661 existing records. [2025-10-29T18:24:43.923909] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:24:43.924107] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-29T18:24:43.924233] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-29T18:24:43.924991] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-29T18:24:43.925049] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-29T18:24:44.334427] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:24:44.330008] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T18:24:44.393508] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-29T18:24:45.150452] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-29T18:24:45.193546] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-29T18:24:45.571824] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T18:24:45.993614] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-29T18:24:46.793533] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-29T18:24:46.910662] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-29T18:24:46.939322] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T18:24:47.593611] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-29T18:24:47.721561] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T18:24:48.393558] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-29T18:24:48.650287] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T18:24:49.139517] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T18:24:49.193533] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-29T18:24:49.993681] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-29T18:24:50.369329] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T18:24:50.793541] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-29T18:24:51.076529] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T18:24:51.593632] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-29T18:24:52.107345] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T18:24:52.393569] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-29T18:24:52.994421] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-29T18:24:53.193687] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-29T18:24:53.449356] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T18:24:53.993590] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-29T18:24:54.498920] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T18:24:54.793567] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-29T18:24:54.961418] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-29T18:24:55.593612] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-29T18:24:55.912706] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-29T18:24:56.393556] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-29T18:24:56.696589] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T18:24:57.193602] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-29T18:24:57.842523] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T18:24:57.853086] [INFO ] [REMOTE ] DXC: Full fetch complete (70486 records). [2025-10-29T18:24:57.853250] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-29T18:24:57.998778] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-29T18:24:58.255546] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-29T18:24:58.255720] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-29T18:24:58.256712] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-29T18:24:58.256795] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-29T18:24:58.258715] [DEBUG] [LOCAL ] DXC: Trimmed 70486 records to 49814 (keeping 200 days of data) [2025-10-29T18:24:58.281283] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T18:24:58.576793] [DEBUG] [LOCAL ] DXC: Primary data saved (49814 records). [2025-10-29T18:24:58.576925] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-29T18:24:58.577003] [INFO ] [MAIN ] Update Progress: 672/2367 symbols completed. DXC took 28.9s. Estimated remaining: 3h 34m 14s. Rate: 7.9 symbols/min [2025-10-29T18:24:58.757328] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:24:58.796675] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-29T18:24:58.797508] [DEBUG] [LOCAL ] EAF: Loaded 40560 existing records from primary storage. [2025-10-29T18:24:58.798766] [INFO ] [MAIN ] EAF: Loaded 40560 existing records. [2025-10-29T18:24:58.990882] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:24:59.000108] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-29T18:24:59.000218] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-29T18:24:59.001282] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T18:24:59.001337] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-29T18:24:59.006782] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-29T18:24:59.354613] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:24:59.593560] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-29T18:25:00.283464] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T18:25:00.393542] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-29T18:25:00.867163] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:25:01.193556] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-29T18:25:01.993623] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-29T18:25:02.193077] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-29T18:25:02.307975] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-29T18:25:02.316428] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56095 records). [2025-10-29T18:25:02.316575] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-29T18:25:02.700067] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-29T18:25:02.700155] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-29T18:25:02.700890] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-29T18:25:02.700953] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-29T18:25:02.702149] [DEBUG] [LOCAL ] DXYZ: Trimmed 56095 records to 36608 (keeping 200 days of data) [2025-10-29T18:25:02.798773] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-29T18:25:02.910992] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36608 records). [2025-10-29T18:25:02.911104] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-29T18:25:02.911175] [INFO ] [MAIN ] Update Progress: 673/2367 symbols completed. DXYZ took 30.7s. Estimated remaining: 3h 33m 58s. Rate: 7.9 symbols/min [2025-10-29T18:25:03.090778] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:25:03.091060] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-29T18:25:03.091131] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-29T18:25:03.091348] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-29T18:25:03.091563] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-29T18:25:03.091808] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-29T18:25:03.091878] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-29T18:25:03.237087] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:25:03.481836] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:25:03.593553] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-29T18:25:04.042775] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T18:25:04.245453] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T18:25:04.393554] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-29T18:25:04.789241] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-29T18:25:05.193558] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-29T18:25:05.993572] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-29T18:25:06.226149] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T18:25:06.366757] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-29T18:25:06.793566] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-29T18:25:07.593575] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-29T18:25:07.959984] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T18:25:08.393690] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-29T18:25:08.784385] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T18:25:09.200462] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-29T18:25:09.208817] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T18:25:09.534316] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-29T18:25:09.993634] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-29T18:25:10.793544] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-29T18:25:10.892304] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T18:25:11.593534] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-29T18:25:11.738696] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-29T18:25:12.393556] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-29T18:25:12.705680] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T18:25:12.716500] [INFO ] [REMOTE ] E: Full fetch complete (47560 records). [2025-10-29T18:25:12.716631] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-29T18:25:12.804834] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-29T18:25:13.112331] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-29T18:25:13.112478] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-29T18:25:13.113148] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-29T18:25:13.113208] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-29T18:25:13.114153] [DEBUG] [LOCAL ] E: Trimmed 47560 records to 32570 (keeping 200 days of data) [2025-10-29T18:25:13.200923] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-29T18:25:13.311232] [DEBUG] [LOCAL ] E: Primary data saved (32570 records). [2025-10-29T18:25:13.311363] [INFO ] [MAIN ] E: Full history saved. [2025-10-29T18:25:13.311441] [INFO ] [MAIN ] Update Progress: 674/2367 symbols completed. E took 29.8s. Estimated remaining: 3h 33m 58s. Rate: 7.9 symbols/min [2025-10-29T18:25:13.492189] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:25:13.492353] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-10-29T18:25:13.492389] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-10-29T18:25:13.492502] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-29T18:25:13.492542] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-29T18:25:13.492584] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-29T18:25:13.492617] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-29T18:25:13.601584] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T18:25:13.860065] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:25:13.993568] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-29T18:25:14.793547] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-29T18:25:14.905330] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T18:25:14.910108] [INFO ] [REMOTE ] DY: Full fetch complete (43027 records). [2025-10-29T18:25:14.910206] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-29T18:25:14.910746] [FATAL] [VALIDATOR ] DY: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:25:14.910833] [FATAL] [MAIN ] DY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:25:14.910877] [WARN ] [MAIN ] DY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:25:14.910915] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-29T18:25:14.910969] [DEBUG] [LOCAL ] DY: No primary data file found to delete. [2025-10-29T18:25:14.911003] [INFO ] [LOCAL ] DY: Starting deletion of derivative data. [2025-10-29T18:25:14.911229] [DEBUG] [LOCAL ] DY: Deleted derivative data file. [2025-10-29T18:25:14.911318] [INFO ] [MAIN ] Update Progress: 675/2367 symbols completed. DY took 38.9s. Estimated remaining: 3h 33m 35s. Rate: 7.9 symbols/min [2025-10-29T18:25:15.088432] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:25:15.134076] [DEBUG] [LOCAL ] EAT: Loaded 49680 existing records from primary storage. [2025-10-29T18:25:15.134377] [INFO ] [MAIN ] EAT: Loaded 49680 existing records. [2025-10-29T18:25:15.320883] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:25:15.321162] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-29T18:25:15.321238] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-29T18:25:15.322251] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-29T18:25:15.322309] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-29T18:25:15.598672] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-29T18:25:15.696113] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:25:16.045318] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-29T18:25:16.393566] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-29T18:25:16.674538] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-29T18:25:17.193565] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-29T18:25:17.563314] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T18:25:17.993560] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-29T18:25:18.303851] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:25:18.793561] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-29T18:25:19.395063] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-29T18:25:19.593556] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-29T18:25:19.758932] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-29T18:25:20.393572] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-29T18:25:20.672123] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T18:25:21.193565] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-29T18:25:21.826476] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-29T18:25:21.993548] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-29T18:25:22.378365] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T18:25:22.793618] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-29T18:25:23.107804] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T18:25:23.593531] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-29T18:25:23.670398] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T18:25:23.965348] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-29T18:25:24.393577] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-29T18:25:25.193615] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-29T18:25:25.659735] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T18:25:25.993524] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-29T18:25:26.418184] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T18:25:26.793550] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-29T18:25:26.886317] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T18:25:27.593713] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-29T18:25:27.949313] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T18:25:28.117421] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T18:25:28.393556] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-29T18:25:28.770984] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-29T18:25:29.193563] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-29T18:25:29.787683] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T18:25:29.789033] [INFO ] [REMOTE ] EAI: Full fetch complete (5642 records). [2025-10-29T18:25:29.789102] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-29T18:25:29.999637] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-29T18:25:30.154241] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-29T18:25:30.154316] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-29T18:25:30.154492] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-29T18:25:30.154554] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-29T18:25:30.154974] [DEBUG] [LOCAL ] EAI: Trimmed 5642 records to 3759 (keeping 200 days of data) [2025-10-29T18:25:30.177303] [DEBUG] [LOCAL ] EAI: Primary data saved (3759 records). [2025-10-29T18:25:30.177398] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-29T18:25:30.177461] [INFO ] [MAIN ] Update Progress: 676/2367 symbols completed. EAI took 27.3s. Estimated remaining: 3h 33m 47s. Rate: 7.9 symbols/min [2025-10-29T18:25:30.348833] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:25:30.379399] [DEBUG] [LOCAL ] EB: Loaded 35675 existing records from primary storage. [2025-10-29T18:25:30.379717] [INFO ] [MAIN ] EB: Loaded 35675 existing records. [2025-10-29T18:25:30.558764] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:25:30.558970] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-29T18:25:30.559016] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-29T18:25:30.559550] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-29T18:25:30.559609] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-29T18:25:30.804568] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-29T18:25:30.919088] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:25:31.084094] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-29T18:25:31.090252] [INFO ] [REMOTE ] EAF: Full fetch complete (61246 records). [2025-10-29T18:25:31.090375] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-29T18:25:31.090986] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:25:31.091066] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:25:31.091109] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:25:31.091151] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-29T18:25:31.091220] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-29T18:25:31.091273] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-10-29T18:25:31.091431] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-10-29T18:25:31.091515] [INFO ] [MAIN ] Update Progress: 677/2367 symbols completed. EAF took 32.5s. Estimated remaining: 3h 33m 23s. Rate: 7.9 symbols/min [2025-10-29T18:25:31.593555] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-29T18:25:31.670873] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T18:25:32.393548] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-29T18:25:32.810797] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T18:25:33.174343] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T18:25:33.193520] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-29T18:25:33.993607] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-29T18:25:34.312759] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-29T18:25:34.793577] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-29T18:25:35.327217] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T18:25:35.388898] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T18:25:35.593579] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-29T18:25:36.393562] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-29T18:25:36.531383] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T18:25:36.537345] [INFO ] [REMOTE ] EARN: Full fetch complete (44893 records). [2025-10-29T18:25:36.537434] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-29T18:25:36.929135] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-29T18:25:36.929212] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-29T18:25:36.929921] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-29T18:25:36.929986] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-29T18:25:36.930961] [DEBUG] [LOCAL ] EARN: Trimmed 44893 records to 26981 (keeping 200 days of data) [2025-10-29T18:25:37.086013] [DEBUG] [LOCAL ] EARN: Primary data saved (26981 records). [2025-10-29T18:25:37.086137] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-29T18:25:37.086208] [INFO ] [MAIN ] Update Progress: 678/2367 symbols completed. EARN took 23.8s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-29T18:25:37.193550] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-29T18:25:37.644158] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T18:25:37.993523] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-29T18:25:38.041358] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T18:25:38.793585] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-29T18:25:39.310180] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T18:25:39.593592] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-29T18:25:39.851979] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T18:25:40.393627] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-29T18:25:40.849833] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T18:25:41.193576] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-29T18:25:41.448621] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-29T18:25:41.993700] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-29T18:25:42.649092] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-29T18:25:42.793550] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-29T18:25:43.128872] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T18:25:43.593616] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-29T18:25:44.372435] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T18:25:44.385370] [INFO ] [REMOTE ] EAT: Full fetch complete (72520 records). [2025-10-29T18:25:44.385556] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-29T18:25:44.856569] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-29T18:25:44.856725] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-29T18:25:44.858342] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-29T18:25:44.858445] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-29T18:25:44.884999] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T18:25:44.883608] [DEBUG] [LOCAL ] EAT: Trimmed 72520 records to 49713 (keeping 200 days of data) [2025-10-29T18:25:44.893531] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-29T18:25:45.188700] [DEBUG] [LOCAL ] EAT: Primary data saved (49713 records). [2025-10-29T18:25:45.188855] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-29T18:25:45.188947] [INFO ] [MAIN ] Update Progress: 679/2367 symbols completed. EAT took 30.3s. Estimated remaining: 3h 33m 5s. Rate: 7.9 symbols/min [2025-10-29T18:25:45.954046] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-29T18:25:45.962771] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-29T18:25:47.179012] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T18:25:47.187199] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-29T18:25:48.138959] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-29T18:25:48.149464] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-29T18:25:49.199524] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-29T18:25:49.208456] [INFO ] [REMOTE ] EB: Full fetch complete (54475 records). [2025-10-29T18:25:49.208590] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-29T18:25:49.593496] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-29T18:25:49.593569] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-29T18:25:49.594269] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-29T18:25:49.594328] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-29T18:25:49.595323] [DEBUG] [LOCAL ] EB: Trimmed 54475 records to 35576 (keeping 200 days of data) [2025-10-29T18:25:49.794194] [DEBUG] [LOCAL ] EB: Primary data saved (35576 records). [2025-10-29T18:25:49.794347] [INFO ] [MAIN ] EB: Full history saved. [2025-10-29T18:25:49.794447] [INFO ] [MAIN ] Update Progress: 680/2367 symbols completed. EB took 19.6s. Estimated remaining: 3h 32m 50s. Rate: 7.9 symbols/min [2025-10-29T18:25:50.415680] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:25:50.424742] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:25:50.512194] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:25:50.520889] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-29T18:25:50.536365] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-29T18:25:50.540330] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:25:50.541044] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-29T18:25:50.540986] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-29T18:25:50.541225] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-29T18:25:50.541608] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-29T18:25:50.541534] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-29T18:25:50.541870] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-29T18:25:50.553280] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-29T18:25:50.577919] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-29T18:25:50.583307] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-29T18:25:50.588769] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-29T18:25:51.056132] [DEBUG] [LOCAL ] EBR: Loaded 43196 existing records from primary storage. [2025-10-29T18:25:51.076250] [INFO ] [MAIN ] EBR: Loaded 43196 existing records. [2025-10-29T18:25:51.055024] [DEBUG] [LOCAL ] EBS: Loaded 46486 existing records from primary storage. [2025-10-29T18:25:51.153762] [INFO ] [MAIN ] EBS: Loaded 46486 existing records. [2025-10-29T18:25:51.592029] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:25:51.639233] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:25:51.633825] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-29T18:25:51.673107] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:25:51.688061] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-29T18:25:51.688452] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-29T18:25:51.693764] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-29T18:25:51.719749] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-29T18:25:51.733820] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:25:51.734159] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-29T18:25:51.734220] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-29T18:25:51.734323] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-29T18:25:51.746734] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-29T18:25:51.782366] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-29T18:25:52.473911] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:25:52.519584] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-29T18:25:52.519275] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:25:52.519933] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-29T18:25:52.555287] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T18:25:52.559039] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-29T18:25:53.272350] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T18:25:53.277257] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-29T18:25:53.372314] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-29T18:25:53.382358] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-29T18:25:53.711600] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T18:25:53.720677] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-29T18:25:53.744989] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T18:25:53.993592] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-29T18:25:54.104370] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T18:25:54.641502] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-29T18:25:54.793635] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-29T18:25:54.911589] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-29T18:25:54.965416] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:25:55.593624] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-29T18:25:56.260016] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T18:25:56.393637] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-29T18:25:56.875352] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T18:25:57.193556] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-29T18:25:57.928506] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T18:25:57.993575] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-29T18:25:58.793566] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-29T18:25:58.856381] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-29T18:25:58.919071] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-29T18:25:59.593554] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-29T18:26:00.293827] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-29T18:26:00.393541] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-29T18:26:00.448049] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-29T18:26:01.193575] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-29T18:26:01.811278] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T18:26:01.993579] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-29T18:26:02.183244] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T18:26:02.793610] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-29T18:26:03.490379] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T18:26:03.593544] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-29T18:26:04.072421] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T18:26:04.393614] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-29T18:26:04.938187] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T18:26:05.193581] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-29T18:26:05.642204] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T18:26:05.993598] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-29T18:26:06.446129] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-29T18:26:06.793618] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-29T18:26:07.578266] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-29T18:26:07.593635] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-29T18:26:07.595134] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T18:26:08.393578] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-29T18:26:08.954392] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T18:26:09.193570] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-29T18:26:09.484122] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T18:26:09.993585] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-29T18:26:10.387528] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T18:26:10.793685] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-29T18:26:10.807923] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T18:26:11.593568] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-29T18:26:11.934678] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T18:26:12.215201] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-29T18:26:12.393570] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-29T18:26:13.193688] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-29T18:26:13.444356] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T18:26:13.879693] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T18:26:13.993578] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-29T18:26:14.793571] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-29T18:26:15.593535] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-29T18:26:15.831743] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-29T18:26:15.841753] [INFO ] [REMOTE ] EC: Full fetch complete (71828 records). [2025-10-29T18:26:15.841899] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-29T18:26:16.229507] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-29T18:26:16.229831] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-29T18:26:16.230692] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-29T18:26:16.230754] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-29T18:26:16.232109] [DEBUG] [LOCAL ] EC: Trimmed 71828 records to 48692 (keeping 200 days of data) [2025-10-29T18:26:16.396954] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-29T18:26:16.471948] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-29T18:26:16.490340] [INFO ] [REMOTE ] EBS: Full fetch complete (67379 records). [2025-10-29T18:26:16.491038] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-29T18:26:16.806806] [DEBUG] [LOCAL ] EC: Primary data saved (48692 records). [2025-10-29T18:26:16.814723] [INFO ] [MAIN ] EC: Full history saved. [2025-10-29T18:26:16.828340] [INFO ] [MAIN ] Update Progress: 681/2367 symbols completed. EC took 27.0s. Estimated remaining: 3h 33m 31s. Rate: 7.9 symbols/min [2025-10-29T18:26:17.089830] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-29T18:26:17.100255] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-29T18:26:17.119060] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-29T18:26:17.119264] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-29T18:26:17.152130] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:26:17.152756] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-10-29T18:26:17.153004] [DEBUG] [LOCAL ] EBS: Trimmed 67379 records to 46494 (keeping 200 days of data) [2025-10-29T18:26:17.152831] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-10-29T18:26:17.161947] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-29T18:26:17.168095] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-29T18:26:17.168495] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-29T18:26:17.177763] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-29T18:26:17.306734] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-29T18:26:17.356852] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-29T18:26:17.744754] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T18:26:17.776723] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:26:17.797495] [INFO ] [REMOTE ] EBF: Full fetch complete (28567 records). [2025-10-29T18:26:17.811684] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-29T18:26:17.961626] [DEBUG] [LOCAL ] EBS: Primary data saved (46494 records). [2025-10-29T18:26:17.967483] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-29T18:26:17.972767] [INFO ] [MAIN ] Update Progress: 682/2367 symbols completed. EBS took 28.2s. Estimated remaining: 3h 33m 7s. Rate: 7.9 symbols/min [2025-10-29T18:26:17.999163] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-29T18:26:18.358218] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:26:18.447938] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-29T18:26:18.448051] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-29T18:26:18.448610] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-29T18:26:18.449126] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-29T18:26:18.450779] [DEBUG] [LOCAL ] EBF: Trimmed 28567 records to 19290 (keeping 200 days of data) [2025-10-29T18:26:18.568852] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T18:26:18.621081] [DEBUG] [LOCAL ] EBF: Primary data saved (19290 records). [2025-10-29T18:26:18.621255] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-29T18:26:18.622016] [INFO ] [MAIN ] Update Progress: 683/2367 symbols completed. EBF took 28.8s. Estimated remaining: 3h 32m 42s. Rate: 7.9 symbols/min [2025-10-29T18:26:18.621878] [DEBUG] [LOCAL ] ECC: Loaded 43047 existing records from primary storage. [2025-10-29T18:26:18.643184] [INFO ] [MAIN ] ECC: Loaded 43047 existing records. [2025-10-29T18:26:18.809267] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-29T18:26:18.960569] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:26:18.960989] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-29T18:26:18.961119] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-29T18:26:18.961274] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-29T18:26:18.961343] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-29T18:26:18.976120] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-29T18:26:18.984020] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-29T18:26:18.994001] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:26:18.994400] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-29T18:26:19.003437] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-29T18:26:19.032814] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-29T18:26:19.059375] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-29T18:26:19.612906] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-29T18:26:19.684874] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:26:19.677035] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-29T18:26:19.764634] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:26:19.900806] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T18:26:20.393535] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-29T18:26:20.569466] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T18:26:20.721116] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-29T18:26:21.193562] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-29T18:26:21.993576] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-29T18:26:22.682532] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T18:26:22.692126] [INFO ] [REMOTE ] EBR: Full fetch complete (62360 records). [2025-10-29T18:26:22.692230] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-29T18:26:22.798623] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-29T18:26:23.086256] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-29T18:26:23.089636] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-29T18:26:23.089970] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-29T18:26:23.109951] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-29T18:26:23.110091] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-29T18:26:23.111989] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-29T18:26:23.119699] [DEBUG] [LOCAL ] EBR: Trimmed 62360 records to 43166 (keeping 200 days of data) [2025-10-29T18:26:23.362745] [DEBUG] [LOCAL ] EBR: Primary data saved (43166 records). [2025-10-29T18:26:23.362897] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-29T18:26:23.362993] [INFO ] [MAIN ] Update Progress: 684/2367 symbols completed. EBR took 33.6s. Estimated remaining: 3h 32m 28s. Rate: 7.9 symbols/min [2025-10-29T18:26:23.529022] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:26:23.532440] [DEBUG] [LOCAL ] ECCU: Loaded 2068 existing records from primary storage. [2025-10-29T18:26:23.532575] [INFO ] [MAIN ] ECCU: Loaded 2068 existing records. [2025-10-29T18:26:23.598696] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-29T18:26:23.707964] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:26:23.708145] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-29T18:26:23.708191] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-29T18:26:23.708358] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-29T18:26:23.708415] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-29T18:26:24.056903] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:26:24.393525] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-29T18:26:24.526707] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-29T18:26:24.623812] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-29T18:26:25.193570] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-29T18:26:25.450478] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-29T18:26:25.993552] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-29T18:26:26.288531] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-29T18:26:26.793569] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-29T18:26:27.017915] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-29T18:26:27.593562] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-29T18:26:28.393554] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-29T18:26:28.765046] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T18:26:29.193552] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-29T18:26:29.217859] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T18:26:29.401072] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-29T18:26:29.993570] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-29T18:26:30.793566] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-29T18:26:31.222300] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:26:31.593549] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-29T18:26:31.611739] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T18:26:31.904662] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:26:32.393572] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-29T18:26:32.802120] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-29T18:26:33.193559] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-29T18:26:33.993553] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-29T18:26:34.515062] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T18:26:34.793539] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-29T18:26:34.924929] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T18:26:35.593588] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-29T18:26:35.967992] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T18:26:36.393618] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-29T18:26:36.481024] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:26:36.725001] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-29T18:26:37.193571] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-29T18:26:37.572211] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T18:26:37.993604] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-29T18:26:38.793571] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-29T18:26:39.458696] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-29T18:26:39.593569] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-29T18:26:39.761859] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T18:26:39.971272] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-29T18:26:40.393561] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-29T18:26:41.193540] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-29T18:26:41.286866] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-29T18:26:41.293844] [INFO ] [REMOTE ] ECAT: Full fetch complete (42796 records). [2025-10-29T18:26:41.293968] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-29T18:26:41.617274] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-29T18:26:41.740555] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-29T18:26:41.740676] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-29T18:26:41.741357] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-29T18:26:41.741421] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-29T18:26:41.742338] [DEBUG] [LOCAL ] ECAT: Trimmed 42796 records to 28853 (keeping 200 days of data) [2025-10-29T18:26:41.930001] [DEBUG] [LOCAL ] ECAT: Primary data saved (28853 records). [2025-10-29T18:26:41.930136] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-29T18:26:41.930207] [INFO ] [MAIN ] Update Progress: 685/2367 symbols completed. ECAT took 25.1s. Estimated remaining: 3h 32m 47s. Rate: 7.9 symbols/min [2025-10-29T18:26:41.998701] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-29T18:26:42.104162] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:26:42.104329] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-29T18:26:42.104367] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-29T18:26:42.104478] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-29T18:26:42.104518] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-29T18:26:42.104580] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-29T18:26:42.104613] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-29T18:26:42.383596] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T18:26:42.463264] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:26:42.793560] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-29T18:26:43.593578] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-29T18:26:43.911572] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-29T18:26:44.036241] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:26:44.393588] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-29T18:26:44.661131] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-29T18:26:45.193589] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-29T18:26:45.578045] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-29T18:26:45.578878] [INFO ] [REMOTE ] ECCC: Full fetch complete (1313 records). [2025-10-29T18:26:45.578946] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-29T18:26:45.763331] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-29T18:26:45.763526] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:26:45.763599] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:26:45.763690] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-29T18:26:45.763762] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-29T18:26:45.763804] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-29T18:26:45.763843] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-29T18:26:45.763898] [INFO ] [MAIN ] Update Progress: 686/2367 symbols completed. ECCC took 27.1s. Estimated remaining: 3h 32m 30s. Rate: 7.9 symbols/min [2025-10-29T18:26:45.935836] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:26:45.936000] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-29T18:26:45.936035] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-29T18:26:45.936138] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-29T18:26:45.936177] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-29T18:26:45.936219] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-29T18:26:45.936249] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-29T18:26:45.998747] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-29T18:26:46.305524] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:26:46.300102] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T18:26:46.793586] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-29T18:26:47.026718] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-29T18:26:47.593535] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-29T18:26:48.393610] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-29T18:26:48.683194] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-29T18:26:48.952555] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T18:26:49.193597] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-29T18:26:49.526017] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-29T18:26:49.993577] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-29T18:26:50.277837] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-29T18:26:50.793580] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-29T18:26:50.999032] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-29T18:26:51.593563] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-29T18:26:51.852605] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-29T18:26:52.393603] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-29T18:26:52.783826] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T18:26:53.193576] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-29T18:26:53.993575] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-29T18:26:54.252388] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-29T18:26:54.471162] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T18:26:54.793573] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-29T18:26:55.593554] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-29T18:26:55.841399] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-29T18:26:56.030545] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T18:26:56.393563] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-29T18:26:57.193626] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-29T18:26:57.565809] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-29T18:26:57.655789] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-29T18:26:57.665072] [INFO ] [REMOTE ] ECC: Full fetch complete (61630 records). [2025-10-29T18:26:57.665190] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-29T18:26:58.001284] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-29T18:26:58.046266] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-29T18:26:58.046340] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-29T18:26:58.047175] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-29T18:26:58.047238] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-29T18:26:58.048492] [DEBUG] [LOCAL ] ECC: Trimmed 61630 records to 43003 (keeping 200 days of data) [2025-10-29T18:26:58.308424] [DEBUG] [LOCAL ] ECC: Primary data saved (43003 records). [2025-10-29T18:26:58.308581] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-29T18:26:58.308714] [INFO ] [MAIN ] Update Progress: 687/2367 symbols completed. ECC took 40.3s. Estimated remaining: 3h 32m 35s. Rate: 7.9 symbols/min [2025-10-29T18:26:58.483503] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T18:26:58.485240] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:26:58.516874] [DEBUG] [LOCAL ] ECG: Loaded 32342 existing records from primary storage. [2025-10-29T18:26:58.517152] [INFO ] [MAIN ] ECG: Loaded 32342 existing records. [2025-10-29T18:26:58.709817] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:26:58.710074] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-29T18:26:58.710125] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-29T18:26:58.710717] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-29T18:26:58.710805] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-29T18:26:58.798767] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-29T18:26:59.099332] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-29T18:26:59.104468] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:26:59.593554] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-29T18:26:59.942045] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-29T18:27:00.393744] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-29T18:27:00.843772] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-29T18:27:01.193555] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-29T18:27:01.399969] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-10-29T18:27:01.993597] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-29T18:27:02.300051] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:27:02.793577] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-29T18:27:03.081127] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-29T18:27:03.593616] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-29T18:27:04.393559] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-29T18:27:04.697547] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T18:27:04.808329] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-29T18:27:04.809213] [INFO ] [REMOTE ] ECCW: Full fetch complete (1415 records). [2025-10-29T18:27:04.809283] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-29T18:27:04.809671] [FATAL] [VALIDATOR ] ECCW: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:27:04.809752] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:27:04.809792] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:27:04.809857] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-29T18:27:04.809928] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-29T18:27:04.809981] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-29T18:27:04.810060] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-29T18:27:04.810118] [INFO ] [MAIN ] Update Progress: 688/2367 symbols completed. ECCW took 22.9s. Estimated remaining: 3h 32m 25s. Rate: 7.9 symbols/min [2025-10-29T18:27:04.978787] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:27:05.018209] [DEBUG] [LOCAL ] ECL: Loaded 46659 existing records from primary storage. [2025-10-29T18:27:05.018562] [INFO ] [MAIN ] ECL: Loaded 46659 existing records. [2025-10-29T18:27:05.193702] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-29T18:27:05.197572] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:27:05.198449] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-29T18:27:05.198532] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-29T18:27:05.200441] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-29T18:27:05.200505] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-29T18:27:05.557518] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:27:05.561376] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-29T18:27:05.993551] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-29T18:27:06.793557] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-29T18:27:07.123962] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-29T18:27:07.125120] [INFO ] [REMOTE ] ECCU: Full fetch complete (3921 records). [2025-10-29T18:27:07.125275] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-29T18:27:07.125809] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:27:07.125924] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:27:07.125997] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:27:07.126187] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-29T18:27:07.126357] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-29T18:27:07.126426] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-29T18:27:07.126638] [DEBUG] [LOCAL ] ECCU: Deleted derivative data file. [2025-10-29T18:27:07.126746] [INFO ] [MAIN ] Update Progress: 689/2367 symbols completed. ECCU took 43.8s. Estimated remaining: 3h 32m 4s. Rate: 7.9 symbols/min [2025-10-29T18:27:07.297971] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:27:07.330211] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T18:27:07.345940] [DEBUG] [LOCAL ] ECO: Loaded 17871 existing records from primary storage. [2025-10-29T18:27:07.346149] [INFO ] [MAIN ] ECO: Loaded 17871 existing records. [2025-10-29T18:27:07.525070] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:27:07.525290] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-29T18:27:07.525339] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-29T18:27:07.525749] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-29T18:27:07.525809] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-29T18:27:07.598744] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-29T18:27:07.884591] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:27:08.393580] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-29T18:27:08.696447] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T18:27:09.193565] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-29T18:27:09.438634] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-29T18:27:09.648821] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-29T18:27:09.993555] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-29T18:27:10.325621] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-29T18:27:10.326429] [INFO ] [REMOTE ] ECCX: Full fetch complete (1432 records). [2025-10-29T18:27:10.326499] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-29T18:27:10.508631] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-29T18:27:10.508842] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:27:10.508924] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:27:10.509026] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-29T18:27:10.509104] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-29T18:27:10.509153] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-29T18:27:10.509209] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-29T18:27:10.509280] [INFO ] [MAIN ] Update Progress: 690/2367 symbols completed. ECCX took 24.7s. Estimated remaining: 3h 31m 46s. Rate: 7.9 symbols/min [2025-10-29T18:27:10.681824] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:27:10.682003] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-29T18:27:10.682040] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-29T18:27:10.682163] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-29T18:27:10.682220] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-29T18:27:10.682265] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-29T18:27:10.682296] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-29T18:27:10.798721] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-29T18:27:11.041549] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:27:11.593569] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-29T18:27:12.063528] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T18:27:12.393525] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-29T18:27:12.579474] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T18:27:13.193548] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-29T18:27:13.484859] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T18:27:13.993536] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-29T18:27:14.074496] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T18:27:14.793543] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-29T18:27:15.034844] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T18:27:15.593581] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-29T18:27:15.778903] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T18:27:16.398745] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-29T18:27:16.408551] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T18:27:17.193570] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-29T18:27:17.998696] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-29T18:27:18.016813] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-29T18:27:18.040256] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T18:27:18.793558] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-29T18:27:19.148235] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T18:27:19.593559] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-29T18:27:20.192457] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T18:27:20.284317] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-29T18:27:20.393559] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-29T18:27:21.006900] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-29T18:27:21.193616] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-29T18:27:21.987229] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T18:27:21.993520] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-29T18:27:22.793581] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-29T18:27:23.144999] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T18:27:23.593628] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-29T18:27:23.998207] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T18:27:24.210845] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-29T18:27:24.393587] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-29T18:27:25.193559] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-29T18:27:25.358575] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T18:27:25.993551] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-29T18:27:26.254909] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T18:27:26.793606] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-29T18:27:27.346116] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T18:27:27.593544] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-29T18:27:27.684166] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T18:27:28.393551] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-29T18:27:28.812060] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T18:27:29.193524] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-29T18:27:29.335981] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T18:27:29.903609] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T18:27:29.993520] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-29T18:27:30.793532] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-29T18:27:30.923335] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T18:27:31.548338] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T18:27:31.593515] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-29T18:27:32.393536] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-29T18:27:32.514461] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-29T18:27:32.518841] [INFO ] [REMOTE ] ECO: Full fetch complete (28141 records). [2025-10-29T18:27:32.518916] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-29T18:27:32.882922] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-29T18:27:32.882990] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-29T18:27:32.883537] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-29T18:27:32.883577] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-29T18:27:32.884351] [DEBUG] [LOCAL ] ECO: Trimmed 28141 records to 17965 (keeping 200 days of data) [2025-10-29T18:27:32.988162] [DEBUG] [LOCAL ] ECO: Primary data saved (17965 records). [2025-10-29T18:27:32.988293] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-29T18:27:32.988371] [INFO ] [MAIN ] Update Progress: 691/2367 symbols completed. ECO took 25.9s. Estimated remaining: 3h 32m 15s. Rate: 7.9 symbols/min [2025-10-29T18:27:33.152936] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:27:33.198895] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-29T18:27:33.201954] [DEBUG] [LOCAL ] ED: Loaded 52473 existing records from primary storage. [2025-10-29T18:27:33.202430] [INFO ] [MAIN ] ED: Loaded 52473 existing records. [2025-10-29T18:27:33.380373] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:27:33.380634] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-29T18:27:33.380727] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-29T18:27:33.381608] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-29T18:27:33.381697] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-29T18:27:33.702308] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T18:27:33.795876] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:27:33.993532] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-29T18:27:34.055163] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-29T18:27:34.793581] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-29T18:27:35.357483] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T18:27:35.593568] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-29T18:27:35.838579] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-29T18:27:35.845913] [INFO ] [REMOTE ] ECG: Full fetch complete (50574 records). [2025-10-29T18:27:35.846061] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-29T18:27:35.846870] [FATAL] [VALIDATOR ] ECG: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:27:35.846955] [FATAL] [MAIN ] ECG: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:27:35.847023] [WARN ] [MAIN ] ECG: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:27:35.847108] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-29T18:27:35.847184] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-29T18:27:35.847242] [INFO ] [LOCAL ] ECG: Starting deletion of derivative data. [2025-10-29T18:27:35.847450] [DEBUG] [LOCAL ] ECG: Deleted derivative data file. [2025-10-29T18:27:35.847554] [INFO ] [MAIN ] Update Progress: 692/2367 symbols completed. ECG took 37.5s. Estimated remaining: 3h 31m 56s. Rate: 7.9 symbols/min [2025-10-29T18:27:36.074243] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:27:36.102974] [DEBUG] [LOCAL ] EDD: Loaded 26837 existing records from primary storage. [2025-10-29T18:27:36.103363] [INFO ] [MAIN ] EDD: Loaded 26837 existing records. [2025-10-29T18:27:36.386251] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:27:36.386618] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-29T18:27:36.386724] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-29T18:27:36.387466] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-29T18:27:36.387526] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-29T18:27:36.396620] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-29T18:27:36.892630] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:27:36.979502] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T18:27:37.193560] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-29T18:27:37.706687] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T18:27:37.993598] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-29T18:27:38.252187] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T18:27:38.260495] [INFO ] [REMOTE ] ECVT: Full fetch complete (60191 records). [2025-10-29T18:27:38.260699] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-29T18:27:38.261336] [FATAL] [VALIDATOR ] ECVT: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:27:38.261422] [FATAL] [MAIN ] ECVT: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:27:38.261469] [WARN ] [MAIN ] ECVT: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:27:38.261506] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-29T18:27:38.261560] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-29T18:27:38.261595] [INFO ] [LOCAL ] ECVT: Starting deletion of derivative data. [2025-10-29T18:27:38.261632] [DEBUG] [LOCAL ] ECVT: No derivative data file found to delete. [2025-10-29T18:27:38.261732] [INFO ] [MAIN ] Update Progress: 693/2367 symbols completed. ECVT took 27.8s. Estimated remaining: 3h 31m 36s. Rate: 7.9 symbols/min [2025-10-29T18:27:38.431094] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:27:38.431342] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-10-29T18:27:38.431386] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-10-29T18:27:38.431497] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-29T18:27:38.431538] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-29T18:27:38.431580] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-29T18:27:38.431612] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-29T18:27:38.796087] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:27:38.796164] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-29T18:27:38.847470] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-29T18:27:39.593565] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-29T18:27:40.172019] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T18:27:40.342854] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-29T18:27:40.393537] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-29T18:27:41.039405] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-29T18:27:41.193580] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-29T18:27:41.993546] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-29T18:27:42.700338] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T18:27:42.793560] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-29T18:27:43.324425] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T18:27:43.593563] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-29T18:27:44.175136] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T18:27:44.251986] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T18:27:44.393613] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-29T18:27:45.193586] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-29T18:27:45.793415] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T18:27:45.993557] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-29T18:27:46.196864] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-29T18:27:46.793573] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-29T18:27:47.349601] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T18:27:47.510497] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T18:27:47.593538] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-29T18:27:48.182479] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T18:27:48.393567] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-29T18:27:48.918949] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-29T18:27:49.193583] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-29T18:27:49.992662] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-29T18:27:49.997958] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-29T18:27:50.793559] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-29T18:27:51.375523] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T18:27:51.513354] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T18:27:51.593515] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-29T18:27:52.393533] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-29T18:27:52.412461] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T18:27:53.193628] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-29T18:27:53.697592] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T18:27:53.993545] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-29T18:27:54.409917] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T18:27:54.793548] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-29T18:27:55.372834] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T18:27:55.383886] [INFO ] [REMOTE ] ECL: Full fetch complete (68452 records). [2025-10-29T18:27:55.384064] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-29T18:27:55.598778] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-29T18:27:55.770889] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-29T18:27:55.770963] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-29T18:27:55.771777] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-29T18:27:55.771841] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-29T18:27:55.773062] [DEBUG] [LOCAL ] ECL: Trimmed 68452 records to 46668 (keeping 200 days of data) [2025-10-29T18:27:56.061071] [DEBUG] [LOCAL ] ECL: Primary data saved (46668 records). [2025-10-29T18:27:56.061190] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-29T18:27:56.061840] [INFO ] [MAIN ] Update Progress: 694/2367 symbols completed. ECL took 51.3s. Estimated remaining: 3h 31m 53s. Rate: 7.9 symbols/min [2025-10-29T18:27:56.237776] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:27:56.256851] [DEBUG] [LOCAL ] EDN: Loaded 19707 existing records from primary storage. [2025-10-29T18:27:56.257081] [INFO ] [MAIN ] EDN: Loaded 19707 existing records. [2025-10-29T18:27:56.423910] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-29T18:27:56.448991] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:27:56.463313] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-29T18:27:56.463474] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-29T18:27:56.464920] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-29T18:27:56.471092] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-29T18:27:56.472275] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-29T18:27:56.858836] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-29T18:27:56.863152] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:27:56.874362] [INFO ] [REMOTE ] ED: Full fetch complete (76300 records). [2025-10-29T18:27:56.874451] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-29T18:27:57.203015] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-29T18:27:57.205016] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T18:27:57.301843] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-29T18:27:57.301916] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-29T18:27:57.302784] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-29T18:27:57.302846] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-29T18:27:57.304230] [DEBUG] [LOCAL ] ED: Trimmed 76300 records to 52469 (keeping 200 days of data) [2025-10-29T18:27:57.615291] [DEBUG] [LOCAL ] ED: Primary data saved (52469 records). [2025-10-29T18:27:57.615412] [INFO ] [MAIN ] ED: Full history saved. [2025-10-29T18:27:57.616379] [INFO ] [MAIN ] Update Progress: 695/2367 symbols completed. ED took 24.6s. Estimated remaining: 3h 31m 31s. Rate: 7.9 symbols/min [2025-10-29T18:27:57.781395] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:27:57.823577] [DEBUG] [LOCAL ] EDU: Loaded 44599 existing records from primary storage. [2025-10-29T18:27:57.823877] [INFO ] [MAIN ] EDU: Loaded 44599 existing records. [2025-10-29T18:27:58.000436] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-29T18:27:58.000375] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:27:58.001493] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-29T18:27:58.001547] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-29T18:27:58.002182] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-29T18:27:58.002238] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-29T18:27:58.359769] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:27:58.378530] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T18:27:58.798679] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-29T18:27:58.809490] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T18:27:59.593567] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-29T18:28:00.066199] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-29T18:28:00.158764] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T18:28:00.393562] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-29T18:28:01.134151] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-29T18:28:01.193538] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-29T18:28:01.928904] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-29T18:28:01.932271] [INFO ] [REMOTE ] EDF: Full fetch complete (19770 records). [2025-10-29T18:28:01.932422] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-29T18:28:02.003047] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-29T18:28:02.313105] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-29T18:28:02.313180] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-29T18:28:02.313587] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-29T18:28:02.313628] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-29T18:28:02.314185] [DEBUG] [LOCAL ] EDF: Trimmed 19770 records to 12631 (keeping 200 days of data) [2025-10-29T18:28:02.384182] [DEBUG] [LOCAL ] EDF: Primary data saved (12631 records). [2025-10-29T18:28:02.384308] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-29T18:28:02.384376] [INFO ] [MAIN ] Update Progress: 696/2367 symbols completed. EDF took 24.1s. Estimated remaining: 3h 31m 16s. Rate: 7.9 symbols/min [2025-10-29T18:28:02.550347] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:28:02.579981] [DEBUG] [LOCAL ] EE: Loaded 32418 existing records from primary storage. [2025-10-29T18:28:02.580247] [INFO ] [MAIN ] EE: Loaded 32418 existing records. [2025-10-29T18:28:02.758024] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:28:02.758228] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-29T18:28:02.758275] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-29T18:28:02.758500] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-29T18:28:02.758543] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-29T18:28:02.801860] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-29T18:28:03.120513] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:28:03.179926] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T18:28:03.593620] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-29T18:28:04.036947] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:28:04.393550] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-29T18:28:04.461231] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T18:28:05.133516] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T18:28:05.193525] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-29T18:28:05.999234] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-29T18:28:06.014716] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T18:28:06.653375] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-29T18:28:06.793572] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-29T18:28:07.593568] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-29T18:28:07.992385] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T18:28:08.402892] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-29T18:28:08.405188] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T18:28:09.193543] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-29T18:28:09.297904] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T18:28:09.304174] [INFO ] [REMOTE ] EDD: Full fetch complete (38852 records). [2025-10-29T18:28:09.304274] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-29T18:28:09.714259] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-29T18:28:09.714338] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-29T18:28:09.714936] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-29T18:28:09.715019] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-29T18:28:09.715915] [DEBUG] [LOCAL ] EDD: Trimmed 38852 records to 26792 (keeping 200 days of data) [2025-10-29T18:28:09.870159] [DEBUG] [LOCAL ] EDD: Primary data saved (26792 records). [2025-10-29T18:28:09.870313] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-29T18:28:09.870400] [INFO ] [MAIN ] Update Progress: 697/2367 symbols completed. EDD took 34.0s. Estimated remaining: 3h 31m 9s. Rate: 7.9 symbols/min [2025-10-29T18:28:09.995430] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-29T18:28:10.047334] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:28:10.047618] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-29T18:28:10.047698] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-29T18:28:10.047825] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-29T18:28:10.047876] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-29T18:28:10.047925] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-29T18:28:10.047964] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-29T18:28:10.372892] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T18:28:10.431807] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:28:10.793627] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-29T18:28:11.417368] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T18:28:11.536024] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T18:28:11.593535] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-29T18:28:12.248557] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-29T18:28:12.393545] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-29T18:28:13.017520] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T18:28:13.193611] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-29T18:28:13.993552] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-29T18:28:14.283690] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T18:28:14.609934] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T18:28:14.793574] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-29T18:28:15.593614] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-29T18:28:15.834378] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T18:28:16.042045] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T18:28:16.393590] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-29T18:28:17.193548] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-29T18:28:17.602520] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T18:28:17.993616] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-29T18:28:18.295666] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T18:28:18.457867] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T18:28:18.793557] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-29T18:28:19.151438] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-29T18:28:19.593569] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-29T18:28:20.393584] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-29T18:28:20.672512] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T18:28:21.193534] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-29T18:28:21.313174] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-29T18:28:21.548863] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-29T18:28:21.993567] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-29T18:28:22.793541] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-29T18:28:22.841163] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-29T18:28:23.171373] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-29T18:28:23.593557] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-29T18:28:24.393536] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-29T18:28:24.519895] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-29T18:28:25.193559] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-29T18:28:25.503072] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-29T18:28:25.617491] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T18:28:25.993587] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-29T18:28:26.793540] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-29T18:28:26.982726] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T18:28:27.593579] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-29T18:28:27.963427] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-29T18:28:27.973251] [INFO ] [REMOTE ] EDU: Full fetch complete (67126 records). [2025-10-29T18:28:27.973386] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-29T18:28:28.306448] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T18:28:28.403770] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-29T18:28:28.430933] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-29T18:28:28.431012] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-29T18:28:28.431908] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-29T18:28:28.432052] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-29T18:28:28.433364] [DEBUG] [LOCAL ] EDU: Trimmed 67126 records to 44586 (keeping 200 days of data) [2025-10-29T18:28:28.700500] [DEBUG] [LOCAL ] EDU: Primary data saved (44586 records). [2025-10-29T18:28:28.700661] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-29T18:28:28.701810] [INFO ] [MAIN ] Update Progress: 698/2367 symbols completed. EDU took 31.1s. Estimated remaining: 3h 31m 28s. Rate: 7.9 symbols/min [2025-10-29T18:28:28.873610] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:28:28.885871] [DEBUG] [LOCAL ] EEX: Loaded 9325 existing records from primary storage. [2025-10-29T18:28:28.886171] [INFO ] [MAIN ] EEX: Loaded 9325 existing records. [2025-10-29T18:28:29.071685] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:28:29.071915] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-29T18:28:29.071962] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-29T18:28:29.072154] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-29T18:28:29.072210] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-29T18:28:29.198711] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-29T18:28:29.470674] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:28:29.486185] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T18:28:29.993554] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-29T18:28:30.634405] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T18:28:30.793573] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-29T18:28:30.825044] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-29T18:28:31.593566] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-29T18:28:31.721028] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T18:28:31.726559] [INFO ] [REMOTE ] EDN: Full fetch complete (29424 records). [2025-10-29T18:28:31.726692] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-29T18:28:31.727211] [FATAL] [VALIDATOR ] EDN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:28:31.727294] [FATAL] [MAIN ] EDN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:28:31.727335] [WARN ] [MAIN ] EDN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:28:31.727372] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-29T18:28:31.727425] [DEBUG] [LOCAL ] EDN: No primary data file found to delete. [2025-10-29T18:28:31.727459] [INFO ] [LOCAL ] EDN: Starting deletion of derivative data. [2025-10-29T18:28:31.727632] [DEBUG] [LOCAL ] EDN: Deleted derivative data file. [2025-10-29T18:28:31.727745] [INFO ] [MAIN ] Update Progress: 699/2367 symbols completed. EDN took 35.7s. Estimated remaining: 3h 31m 9s. Rate: 7.9 symbols/min [2025-10-29T18:28:31.896314] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:28:31.940151] [DEBUG] [LOCAL ] EFC: Loaded 46143 existing records from primary storage. [2025-10-29T18:28:31.940446] [INFO ] [MAIN ] EFC: Loaded 46143 existing records. [2025-10-29T18:28:32.118622] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:28:32.118846] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-29T18:28:32.118892] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-29T18:28:32.119205] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-29T18:28:32.119243] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-29T18:28:32.394414] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-29T18:28:32.500978] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:28:32.520317] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T18:28:33.085249] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T18:28:33.193558] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-29T18:28:33.651253] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-29T18:28:33.993556] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-29T18:28:34.322537] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-29T18:28:34.793559] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-29T18:28:35.118228] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-29T18:28:35.593586] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-29T18:28:36.040843] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-29T18:28:36.041813] [INFO ] [REMOTE ] EEA: Full fetch complete (3735 records). [2025-10-29T18:28:36.041897] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-29T18:28:36.218622] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-29T18:28:36.218864] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:28:36.218933] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:28:36.218980] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-29T18:28:36.219032] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-29T18:28:36.219067] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-29T18:28:36.219104] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-29T18:28:36.219161] [INFO ] [MAIN ] Update Progress: 700/2367 symbols completed. EEA took 26.3s. Estimated remaining: 3h 30m 54s. Rate: 7.9 symbols/min [2025-10-29T18:28:36.404175] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:28:36.400552] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-29T18:28:36.421187] [DEBUG] [LOCAL ] EFR: Loaded 14666 existing records from primary storage. [2025-10-29T18:28:36.421452] [INFO ] [MAIN ] EFR: Loaded 14666 existing records. [2025-10-29T18:28:36.600501] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:28:36.600727] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-29T18:28:36.600782] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-29T18:28:36.600967] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-29T18:28:36.601023] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-29T18:28:36.963574] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:28:37.193524] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-29T18:28:37.721064] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T18:28:37.769973] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T18:28:37.993627] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-29T18:28:38.456310] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-29T18:28:38.793561] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-29T18:28:39.593585] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-29T18:28:40.023229] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:28:40.393703] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-29T18:28:40.699214] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T18:28:40.707486] [INFO ] [REMOTE ] EE: Full fetch complete (44710 records). [2025-10-29T18:28:40.707676] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-29T18:28:41.088414] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-29T18:28:41.088516] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-29T18:28:41.089243] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-29T18:28:41.089306] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-29T18:28:41.090280] [DEBUG] [LOCAL ] EE: Trimmed 44710 records to 32404 (keeping 200 days of data) [2025-10-29T18:28:41.200938] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-29T18:28:41.281056] [DEBUG] [LOCAL ] EE: Primary data saved (32404 records). [2025-10-29T18:28:41.281188] [INFO ] [MAIN ] EE: Full history saved. [2025-10-29T18:28:41.281313] [INFO ] [MAIN ] Update Progress: 701/2367 symbols completed. EE took 38.9s. Estimated remaining: 3h 30m 41s. Rate: 7.9 symbols/min [2025-10-29T18:28:41.447559] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:28:41.460872] [DEBUG] [LOCAL ] EFT: Loaded 12569 existing records from primary storage. [2025-10-29T18:28:41.461074] [INFO ] [MAIN ] EFT: Loaded 12569 existing records. [2025-10-29T18:28:41.637798] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:28:41.638271] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-29T18:28:41.638448] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-29T18:28:41.638744] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-29T18:28:41.638807] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-29T18:28:41.849748] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-29T18:28:42.004168] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-29T18:28:42.045143] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:28:42.071535] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-29T18:28:42.454935] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T18:28:42.793587] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-29T18:28:43.593556] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-29T18:28:44.026497] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T18:28:44.259489] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T18:28:44.393602] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-29T18:28:45.044531] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-29T18:28:45.193636] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-29T18:28:45.721067] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-29T18:28:45.993630] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-29T18:28:46.610470] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T18:28:46.793602] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-29T18:28:47.319808] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-29T18:28:47.593573] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-29T18:28:48.393545] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-29T18:28:48.403554] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T18:28:48.983328] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T18:28:49.193635] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-29T18:28:49.820238] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-29T18:28:49.993625] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-29T18:28:50.470087] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-29T18:28:50.793594] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-29T18:28:51.363820] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-29T18:28:51.593535] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-29T18:28:52.112485] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-29T18:28:52.393619] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-29T18:28:53.193586] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-29T18:28:53.770113] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-29T18:28:53.850631] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T18:28:53.993564] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-29T18:28:54.793577] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-29T18:28:55.164714] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-29T18:28:55.169844] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T18:28:55.593604] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-29T18:28:56.044896] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T18:28:56.393690] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-29T18:28:57.056000] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T18:28:57.193598] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-29T18:28:57.725978] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T18:28:57.728125] [INFO ] [REMOTE ] EEX: Full fetch complete (18024 records). [2025-10-29T18:28:57.728206] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-29T18:28:57.998635] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-29T18:28:58.114519] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-29T18:28:58.114588] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-29T18:28:58.114981] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-29T18:28:58.115040] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-29T18:28:58.115507] [DEBUG] [LOCAL ] EEX: Trimmed 18024 records to 9289 (keeping 200 days of data) [2025-10-29T18:28:58.168117] [DEBUG] [LOCAL ] EEX: Primary data saved (9289 records). [2025-10-29T18:28:58.168246] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-29T18:28:58.168331] [INFO ] [MAIN ] Update Progress: 702/2367 symbols completed. EEX took 29.5s. Estimated remaining: 3h 30m 55s. Rate: 7.9 symbols/min [2025-10-29T18:28:58.340031] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:28:58.383280] [DEBUG] [LOCAL ] EFX: Loaded 44475 existing records from primary storage. [2025-10-29T18:28:58.383582] [INFO ] [MAIN ] EFX: Loaded 44475 existing records. [2025-10-29T18:28:58.567571] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:28:58.567799] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-29T18:28:58.567846] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-29T18:28:58.568329] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-29T18:28:58.568384] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-29T18:28:58.803814] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-29T18:28:58.925010] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:28:58.948308] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T18:28:58.952141] [INFO ] [REMOTE ] EFR: Full fetch complete (19743 records). [2025-10-29T18:28:58.952209] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-29T18:28:59.318316] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-29T18:28:59.318423] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-29T18:28:59.318852] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-29T18:28:59.318911] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-29T18:28:59.319450] [DEBUG] [LOCAL ] EFR: Trimmed 19743 records to 14592 (keeping 200 days of data) [2025-10-29T18:28:59.403968] [DEBUG] [LOCAL ] EFR: Primary data saved (14592 records). [2025-10-29T18:28:59.404091] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-29T18:28:59.404164] [INFO ] [MAIN ] Update Progress: 703/2367 symbols completed. EFR took 23.2s. Estimated remaining: 3h 30m 33s. Rate: 7.9 symbols/min [2025-10-29T18:28:59.569476] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:28:59.594283] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-29T18:28:59.595578] [DEBUG] [LOCAL ] EFXT: Loaded 29387 existing records from primary storage. [2025-10-29T18:28:59.595853] [INFO ] [MAIN ] EFXT: Loaded 29387 existing records. [2025-10-29T18:28:59.774615] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:28:59.774819] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-29T18:28:59.774886] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-29T18:28:59.775118] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-29T18:28:59.775171] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-29T18:29:00.128610] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:29:00.154975] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T18:29:00.323091] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-29T18:29:00.393559] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-29T18:29:01.193590] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-29T18:29:01.573809] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T18:29:01.993612] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-29T18:29:02.296168] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T18:29:02.793607] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-29T18:29:02.981921] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T18:29:03.250320] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-29T18:29:03.593563] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-29T18:29:04.393579] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-29T18:29:04.745561] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T18:29:05.127438] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-29T18:29:05.193535] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-29T18:29:05.993534] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-29T18:29:06.073173] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T18:29:06.620674] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T18:29:06.793570] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-29T18:29:07.313953] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T18:29:07.593556] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-29T18:29:08.393585] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-29T18:29:08.916477] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T18:29:09.193531] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-29T18:29:09.382544] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T18:29:09.993567] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-29T18:29:10.399680] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T18:29:10.793575] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-29T18:29:10.850153] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-29T18:29:11.397683] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T18:29:11.593553] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-29T18:29:12.393592] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-29T18:29:12.965110] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T18:29:13.193558] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-29T18:29:13.238919] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T18:29:13.993595] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-29T18:29:14.492533] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:29:14.570593] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-29T18:29:14.793564] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-29T18:29:15.449044] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T18:29:15.452401] [INFO ] [REMOTE ] EFT: Full fetch complete (17830 records). [2025-10-29T18:29:15.452479] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-29T18:29:15.598741] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-29T18:29:15.855804] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-29T18:29:15.855889] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-29T18:29:15.856388] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-29T18:29:15.856437] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-29T18:29:15.857019] [DEBUG] [LOCAL ] EFT: Trimmed 17830 records to 12550 (keeping 200 days of data) [2025-10-29T18:29:15.932139] [DEBUG] [LOCAL ] EFT: Primary data saved (12550 records). [2025-10-29T18:29:15.932276] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-29T18:29:15.932355] [INFO ] [MAIN ] Update Progress: 704/2367 symbols completed. EFT took 34.7s. Estimated remaining: 3h 30m 46s. Rate: 7.9 symbols/min [2025-10-29T18:29:16.159255] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:29:16.159488] [DEBUG] [LOCAL ] EG: No existing data file found in primary storage. [2025-10-29T18:29:16.159557] [WARN ] [MAIN ] EG: No existing data found, performing full refresh instead. [2025-10-29T18:29:16.159715] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-29T18:29:16.159779] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-29T18:29:16.159849] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-10-29T18:29:16.159906] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-29T18:29:16.404030] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-29T18:29:16.541249] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:29:16.560047] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T18:29:17.193640] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-29T18:29:17.891373] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T18:29:17.902537] [INFO ] [REMOTE ] EFC: Full fetch complete (66825 records). [2025-10-29T18:29:17.902812] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-29T18:29:17.998703] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-29T18:29:18.336598] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-29T18:29:18.368757] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-29T18:29:18.368892] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-29T18:29:18.370133] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-29T18:29:18.370220] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-29T18:29:18.372342] [DEBUG] [LOCAL ] EFC: Trimmed 66825 records to 46106 (keeping 200 days of data) [2025-10-29T18:29:18.671243] [DEBUG] [LOCAL ] EFC: Primary data saved (46106 records). [2025-10-29T18:29:18.671470] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-29T18:29:18.671599] [INFO ] [MAIN ] Update Progress: 705/2367 symbols completed. EFC took 46.9s. Estimated remaining: 3h 30m 27s. Rate: 7.9 symbols/min [2025-10-29T18:29:18.798750] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-29T18:29:18.859464] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:29:18.921508] [DEBUG] [LOCAL ] EGO: Loaded 51705 existing records from primary storage. [2025-10-29T18:29:18.922066] [INFO ] [MAIN ] EGO: Loaded 51705 existing records. [2025-10-29T18:29:19.123594] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:29:19.124089] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-29T18:29:19.124157] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-29T18:29:19.124628] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-29T18:29:19.124717] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-29T18:29:19.498902] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-29T18:29:19.551370] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:29:19.593565] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-29T18:29:20.026585] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T18:29:20.393597] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-29T18:29:20.798190] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T18:29:21.193555] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-29T18:29:21.581107] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T18:29:21.993551] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-29T18:29:22.316023] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T18:29:22.793566] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-29T18:29:23.053269] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T18:29:23.593583] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-29T18:29:24.009358] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T18:29:24.393540] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-29T18:29:24.590072] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-29T18:29:25.193552] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-29T18:29:25.986198] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T18:29:25.995635] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-29T18:29:25.997310] [INFO ] [REMOTE ] EFX: Full fetch complete (65074 records). [2025-10-29T18:29:25.997404] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-29T18:29:26.391754] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-29T18:29:26.391889] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-29T18:29:26.393115] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-29T18:29:26.393202] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-29T18:29:26.416402] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T18:29:26.424077] [DEBUG] [LOCAL ] EFX: Trimmed 65074 records to 44457 (keeping 200 days of data) [2025-10-29T18:29:26.703932] [DEBUG] [LOCAL ] EFX: Primary data saved (44457 records). [2025-10-29T18:29:26.704066] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-29T18:29:26.704968] [INFO ] [MAIN ] Update Progress: 706/2367 symbols completed. EFX took 28.5s. Estimated remaining: 3h 30m 20s. Rate: 7.9 symbols/min [2025-10-29T18:29:26.800069] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-29T18:29:26.872527] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:29:26.872783] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-10-29T18:29:26.872827] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-10-29T18:29:26.872935] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-29T18:29:26.873064] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-29T18:29:26.873113] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-29T18:29:26.873145] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-29T18:29:27.224141] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:29:27.262794] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T18:29:27.593622] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-29T18:29:27.842693] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T18:29:28.393615] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-29T18:29:28.756904] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T18:29:28.764274] [INFO ] [REMOTE ] EFXT: Full fetch complete (44344 records). [2025-10-29T18:29:28.764391] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-29T18:29:29.128468] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-29T18:29:29.128546] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-29T18:29:29.129178] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-29T18:29:29.129241] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-29T18:29:29.130154] [DEBUG] [LOCAL ] EFXT: Trimmed 44344 records to 29467 (keeping 200 days of data) [2025-10-29T18:29:29.210508] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-29T18:29:29.298576] [DEBUG] [LOCAL ] EFXT: Primary data saved (29467 records). [2025-10-29T18:29:29.298738] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-29T18:29:29.298868] [INFO ] [MAIN ] Update Progress: 707/2367 symbols completed. EFXT took 29.9s. Estimated remaining: 3h 30m 1s. Rate: 7.9 symbols/min [2025-10-29T18:29:29.464308] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:29:29.465028] [DEBUG] [LOCAL ] EGY: No existing data file found in primary storage. [2025-10-29T18:29:29.465075] [WARN ] [MAIN ] EGY: No existing data found, performing full refresh instead. [2025-10-29T18:29:29.465187] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-29T18:29:29.465228] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-29T18:29:29.465270] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-29T18:29:29.465301] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-29T18:29:29.828763] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:29:29.877567] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T18:29:29.993558] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-29T18:29:30.371514] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T18:29:30.793587] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-29T18:29:31.124881] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T18:29:31.593586] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-29T18:29:31.947086] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T18:29:32.393620] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-29T18:29:32.531017] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-29T18:29:33.193718] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-29T18:29:33.626868] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T18:29:33.993584] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-29T18:29:34.212802] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-29T18:29:34.793535] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-29T18:29:34.816893] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T18:29:35.593596] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-29T18:29:35.739184] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T18:29:36.357493] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T18:29:36.393525] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-29T18:29:37.126729] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-29T18:29:37.193593] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-29T18:29:37.993580] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-29T18:29:38.265892] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T18:29:38.793615] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-29T18:29:39.067043] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T18:29:39.593568] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-29T18:29:39.918971] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T18:29:40.393565] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-29T18:29:40.783988] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T18:29:41.193594] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-29T18:29:41.355227] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-29T18:29:41.993574] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-29T18:29:42.363918] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T18:29:42.793578] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-29T18:29:43.076220] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-29T18:29:43.593613] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-29T18:29:43.630687] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T18:29:44.393579] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-29T18:29:45.153078] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-29T18:29:45.193545] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-29T18:29:45.342945] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T18:29:45.348336] [INFO ] [REMOTE ] EG: Full fetch complete (42670 records). [2025-10-29T18:29:45.348424] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-29T18:29:45.710753] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-29T18:29:45.710827] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-29T18:29:45.711392] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-29T18:29:45.711440] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-29T18:29:45.712330] [DEBUG] [LOCAL ] EG: Trimmed 42670 records to 27336 (keeping 200 days of data) [2025-10-29T18:29:45.876268] [DEBUG] [LOCAL ] EG: Primary data saved (27336 records). [2025-10-29T18:29:45.876389] [INFO ] [MAIN ] EG: Full history saved. [2025-10-29T18:29:45.876455] [INFO ] [MAIN ] Update Progress: 708/2367 symbols completed. EG took 29.9s. Estimated remaining: 3h 30m 15s. Rate: 7.9 symbols/min [2025-10-29T18:29:45.998731] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-29T18:29:46.055714] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:29:46.055885] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-10-29T18:29:46.055921] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-10-29T18:29:46.056052] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-29T18:29:46.056094] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-29T18:29:46.056137] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-29T18:29:46.056169] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-29T18:29:46.423580] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:29:46.497638] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T18:29:46.793573] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-29T18:29:47.055856] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T18:29:47.593612] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-29T18:29:47.873230] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T18:29:48.393536] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-29T18:29:48.496874] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:29:49.195867] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-29T18:29:49.202133] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T18:29:49.914152] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T18:29:49.993595] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-29T18:29:50.793527] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-29T18:29:50.975971] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T18:29:51.593579] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-29T18:29:51.756929] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T18:29:52.393537] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-29T18:29:52.463692] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-29T18:29:53.193619] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-29T18:29:54.001675] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-29T18:29:54.004152] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T18:29:54.109717] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-29T18:29:54.121038] [INFO ] [REMOTE ] EGO: Full fetch complete (74789 records). [2025-10-29T18:29:54.121165] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-29T18:29:54.502091] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-29T18:29:54.502170] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-29T18:29:54.503059] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-29T18:29:54.503124] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-29T18:29:54.504481] [DEBUG] [LOCAL ] EGO: Trimmed 74789 records to 51692 (keeping 200 days of data) [2025-10-29T18:29:54.794416] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-29T18:29:54.824883] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T18:29:54.824030] [DEBUG] [LOCAL ] EGO: Primary data saved (51692 records). [2025-10-29T18:29:54.831569] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-29T18:29:54.832143] [INFO ] [MAIN ] Update Progress: 709/2367 symbols completed. EGO took 36.2s. Estimated remaining: 3h 30m 10s. Rate: 7.9 symbols/min [2025-10-29T18:29:55.016800] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:29:55.057577] [DEBUG] [LOCAL ] EHC: Loaded 40562 existing records from primary storage. [2025-10-29T18:29:55.057898] [INFO ] [MAIN ] EHC: Loaded 40562 existing records. [2025-10-29T18:29:55.230061] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:29:55.230324] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-29T18:29:55.230384] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-29T18:29:55.230722] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-29T18:29:55.230793] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-29T18:29:55.581107] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:29:55.593514] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-29T18:29:55.615572] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T18:29:56.393623] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-29T18:29:56.697729] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T18:29:57.193584] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-29T18:29:57.556003] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T18:29:57.993572] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-29T18:29:58.252096] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T18:29:58.258466] [INFO ] [REMOTE ] EGP: Full fetch complete (45501 records). [2025-10-29T18:29:58.258618] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-29T18:29:58.259324] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:29:58.259434] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:29:58.259503] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:29:58.259601] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-29T18:29:58.259711] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-29T18:29:58.259761] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-10-29T18:29:58.259804] [DEBUG] [LOCAL ] EGP: No derivative data file found to delete. [2025-10-29T18:29:58.259867] [INFO ] [MAIN ] Update Progress: 710/2367 symbols completed. EGP took 31.6s. Estimated remaining: 3h 29m 53s. Rate: 7.9 symbols/min [2025-10-29T18:29:58.432018] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:29:58.443016] [DEBUG] [LOCAL ] EHI: Loaded 10489 existing records from primary storage. [2025-10-29T18:29:58.443234] [INFO ] [MAIN ] EHI: Loaded 10489 existing records. [2025-10-29T18:29:58.616968] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:29:58.617213] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-29T18:29:58.617265] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-29T18:29:58.617446] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-29T18:29:58.617501] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-29T18:29:58.802117] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-29T18:29:58.977181] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:29:59.050966] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T18:29:59.593607] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-29T18:29:59.959759] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:30:00.393569] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-29T18:30:00.629196] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T18:30:01.160985] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T18:30:01.193519] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-29T18:30:01.993581] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-29T18:30:02.580166] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T18:30:02.596893] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-29T18:30:02.793554] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-29T18:30:03.336925] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T18:30:03.593584] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-29T18:30:04.083145] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-29T18:30:04.393603] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-29T18:30:05.193572] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-29T18:30:05.713167] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:30:05.730672] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-29T18:30:05.993574] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-29T18:30:06.793581] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-29T18:30:07.476064] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T18:30:07.507623] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T18:30:07.516432] [INFO ] [REMOTE ] EGY: Full fetch complete (60215 records). [2025-10-29T18:30:07.516589] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-29T18:30:07.517353] [FATAL] [VALIDATOR ] EGY: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:30:07.517439] [FATAL] [MAIN ] EGY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:30:07.517487] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:30:07.517537] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-29T18:30:07.517603] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-29T18:30:07.517701] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-10-29T18:30:07.517765] [DEBUG] [LOCAL ] EGY: No derivative data file found to delete. [2025-10-29T18:30:07.517824] [INFO ] [MAIN ] Update Progress: 711/2367 symbols completed. EGY took 38.2s. Estimated remaining: 3h 29m 49s. Rate: 7.9 symbols/min [2025-10-29T18:30:07.598777] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-29T18:30:07.715467] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:30:07.715632] [DEBUG] [LOCAL ] EIC: No existing data file found in primary storage. [2025-10-29T18:30:07.715738] [WARN ] [MAIN ] EIC: No existing data found, performing full refresh instead. [2025-10-29T18:30:07.715849] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-29T18:30:07.715890] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-29T18:30:07.715929] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-29T18:30:07.715960] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-29T18:30:08.110127] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:30:08.251666] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T18:30:08.393592] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-29T18:30:09.193579] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-29T18:30:09.507084] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T18:30:09.993560] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-29T18:30:10.041470] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-29T18:30:10.767820] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T18:30:10.793524] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-29T18:30:11.371101] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-29T18:30:11.593561] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-29T18:30:12.393556] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-29T18:30:12.662848] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T18:30:13.193565] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-29T18:30:13.993540] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-29T18:30:14.110231] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T18:30:14.491388] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-29T18:30:14.793550] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-29T18:30:14.829205] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T18:30:15.517885] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-29T18:30:15.593562] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-29T18:30:16.393562] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-29T18:30:16.982005] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-29T18:30:17.193554] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-29T18:30:17.787119] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T18:30:17.790118] [INFO ] [REMOTE ] EHI: Full fetch complete (15699 records). [2025-10-29T18:30:17.790235] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-29T18:30:18.001322] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-29T18:30:18.173519] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-29T18:30:18.173615] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-29T18:30:18.173976] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-29T18:30:18.174031] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-29T18:30:18.174493] [DEBUG] [LOCAL ] EHI: Trimmed 15699 records to 10560 (keeping 200 days of data) [2025-10-29T18:30:18.233871] [DEBUG] [LOCAL ] EHI: Primary data saved (10560 records). [2025-10-29T18:30:18.233991] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-29T18:30:18.234070] [INFO ] [MAIN ] Update Progress: 712/2367 symbols completed. EHI took 20.0s. Estimated remaining: 3h 29m 49s. Rate: 7.9 symbols/min [2025-10-29T18:30:18.402425] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:30:18.402589] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-29T18:30:18.402632] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-29T18:30:18.402796] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-29T18:30:18.402859] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-29T18:30:18.402905] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-29T18:30:18.402937] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-29T18:30:18.771891] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:30:18.793519] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-29T18:30:18.877788] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (3.28 seconds). [2025-10-29T18:30:18.885212] [INFO ] [REMOTE ] EHAB: Full fetch complete (41101 records). [2025-10-29T18:30:18.885491] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-29T18:30:19.164167] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-29T18:30:19.336973] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-29T18:30:19.337178] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-29T18:30:19.338595] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-29T18:30:19.338718] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-29T18:30:19.340276] [DEBUG] [LOCAL ] EHAB: Trimmed 41101 records to 28998 (keeping 200 days of data) [2025-10-29T18:30:19.493909] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T18:30:19.571259] [DEBUG] [LOCAL ] EHAB: Primary data saved (28998 records). [2025-10-29T18:30:19.571483] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-29T18:30:19.571671] [INFO ] [MAIN ] Update Progress: 713/2367 symbols completed. EHAB took 33.7s. Estimated remaining: 3h 29m 27s. Rate: 7.9 symbols/min [2025-10-29T18:30:19.598751] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-29T18:30:19.756740] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:30:19.756950] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-29T18:30:19.756990] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-29T18:30:19.757104] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-29T18:30:19.757146] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-29T18:30:19.757186] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-29T18:30:19.757218] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-29T18:30:20.100278] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:30:20.393601] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-29T18:30:20.713369] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T18:30:21.193585] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-29T18:30:21.337606] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T18:30:21.993608] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-29T18:30:22.243566] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T18:30:22.746425] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-29T18:30:22.793575] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-29T18:30:23.593586] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-29T18:30:23.821676] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-29T18:30:24.040572] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T18:30:24.050495] [INFO ] [REMOTE ] EHC: Full fetch complete (58790 records). [2025-10-29T18:30:24.050732] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-29T18:30:24.401607] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-29T18:30:24.640495] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-29T18:30:24.640586] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-29T18:30:24.641388] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-29T18:30:24.641455] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-29T18:30:24.642787] [DEBUG] [LOCAL ] EHC: Trimmed 58790 records to 40558 (keeping 200 days of data) [2025-10-29T18:30:24.759701] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-29T18:30:24.934247] [DEBUG] [LOCAL ] EHC: Primary data saved (40558 records). [2025-10-29T18:30:24.934371] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-29T18:30:24.935304] [INFO ] [MAIN ] Update Progress: 714/2367 symbols completed. EHC took 30.1s. Estimated remaining: 3h 29m 14s. Rate: 7.9 symbols/min [2025-10-29T18:30:25.100360] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:30:25.100504] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-29T18:30:25.100540] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-29T18:30:25.100663] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-29T18:30:25.100719] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-29T18:30:25.100764] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-29T18:30:25.100796] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-29T18:30:25.198796] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-29T18:30:25.458526] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:30:25.993524] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-29T18:30:26.119768] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-29T18:30:26.419701] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-29T18:30:26.793580] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-29T18:30:27.084843] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-29T18:30:27.593558] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-29T18:30:28.342272] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-29T18:30:28.393528] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-29T18:30:28.832671] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-29T18:30:29.193562] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-29T18:30:29.508178] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-29T18:30:29.993617] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-29T18:30:30.793591] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-29T18:30:30.893036] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-29T18:30:31.075723] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-29T18:30:31.593609] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-29T18:30:31.812898] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-29T18:30:32.393582] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-29T18:30:33.193582] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-29T18:30:33.215723] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T18:30:33.654604] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T18:30:33.993569] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-29T18:30:34.464880] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-29T18:30:34.793609] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-29T18:30:35.085139] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-29T18:30:35.593573] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-29T18:30:35.875490] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-29T18:30:36.393559] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-29T18:30:36.745904] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-29T18:30:37.193565] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-29T18:30:37.763246] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-29T18:30:37.993557] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-29T18:30:38.418835] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-29T18:30:38.793567] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-29T18:30:39.032800] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-29T18:30:39.593587] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-29T18:30:40.020587] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-29T18:30:40.393690] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-29T18:30:41.193544] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-29T18:30:41.256208] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-29T18:30:41.261675] [INFO ] [REMOTE ] EIC: Full fetch complete (33672 records). [2025-10-29T18:30:41.261815] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-29T18:30:41.622238] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-29T18:30:41.717121] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-29T18:30:41.717199] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-29T18:30:41.717753] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-29T18:30:41.717814] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-29T18:30:41.718596] [DEBUG] [LOCAL ] EIC: Trimmed 33672 records to 21817 (keeping 200 days of data) [2025-10-29T18:30:41.855500] [DEBUG] [LOCAL ] EIC: Primary data saved (21817 records). [2025-10-29T18:30:41.855618] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-29T18:30:41.855735] [INFO ] [MAIN ] Update Progress: 715/2367 symbols completed. EIC took 34.3s. Estimated remaining: 3h 29m 28s. Rate: 7.9 symbols/min [2025-10-29T18:30:42.007444] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-29T18:30:42.038635] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:30:42.038803] [DEBUG] [LOCAL ] EIG: No existing data file found in primary storage. [2025-10-29T18:30:42.038848] [WARN ] [MAIN ] EIG: No existing data found, performing full refresh instead. [2025-10-29T18:30:42.038951] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-29T18:30:42.038998] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-29T18:30:42.039037] [DEBUG] [LOCAL ] EIG: No primary data file found to delete. [2025-10-29T18:30:42.039068] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-29T18:30:42.399418] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T18:30:42.430837] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:30:42.793567] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-29T18:30:43.513903] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T18:30:43.593523] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-29T18:30:44.261964] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-29T18:30:44.393545] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-29T18:30:44.695169] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-29T18:30:45.193565] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-29T18:30:45.439882] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-29T18:30:45.993590] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-29T18:30:46.425283] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-29T18:30:46.793562] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-29T18:30:47.019761] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-29T18:30:47.593585] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-29T18:30:48.233336] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-29T18:30:48.393603] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-29T18:30:49.098355] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T18:30:49.193554] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-29T18:30:49.924248] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-29T18:30:49.993579] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-29T18:30:50.327954] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-29T18:30:50.793567] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-29T18:30:51.178237] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-29T18:30:51.593560] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-29T18:30:51.880098] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-29T18:30:52.393580] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-29T18:30:52.759019] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-29T18:30:52.760088] [INFO ] [REMOTE ] EICB: Full fetch complete (2636 records). [2025-10-29T18:30:52.760159] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-29T18:30:52.974161] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-29T18:30:52.974359] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:30:52.974442] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:30:52.974513] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-29T18:30:52.974580] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-29T18:30:52.974630] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-29T18:30:52.974729] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-29T18:30:52.974796] [INFO ] [MAIN ] Update Progress: 716/2367 symbols completed. EICB took 33.4s. Estimated remaining: 3h 29m 28s. Rate: 7.9 symbols/min [2025-10-29T18:30:53.138892] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:30:53.186896] [DEBUG] [LOCAL ] EIX: Loaded 53339 existing records from primary storage. [2025-10-29T18:30:53.187222] [INFO ] [MAIN ] EIX: Loaded 53339 existing records. [2025-10-29T18:30:53.198825] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-29T18:30:53.366058] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:30:53.366230] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-29T18:30:53.366276] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-29T18:30:53.366704] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-29T18:30:53.366765] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-29T18:30:53.715558] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:30:53.717743] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-29T18:30:53.718370] [INFO ] [REMOTE ] EICA: Full fetch complete (1162 records). [2025-10-29T18:30:53.718434] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-29T18:30:53.891825] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-29T18:30:53.891970] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:30:53.892035] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:30:53.892104] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-29T18:30:53.892164] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-29T18:30:53.892199] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-29T18:30:53.892237] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-29T18:30:53.892329] [INFO ] [MAIN ] Update Progress: 717/2367 symbols completed. EICA took 35.7s. Estimated remaining: 3h 29m 5s. Rate: 7.9 symbols/min [2025-10-29T18:30:53.993522] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-29T18:30:54.435427] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-29T18:30:54.793555] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-29T18:30:55.584405] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T18:30:55.593510] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-29T18:30:56.356826] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T18:30:56.393524] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-29T18:30:57.193701] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-29T18:30:57.224506] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T18:30:57.993629] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-29T18:30:58.514736] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-29T18:30:58.516851] [INFO ] [REMOTE ] EICC: Full fetch complete (8448 records). [2025-10-29T18:30:58.516928] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-29T18:30:58.517431] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:30:58.517521] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:30:58.517566] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:30:58.517618] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-29T18:30:58.517747] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-29T18:30:58.517804] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-29T18:30:58.517849] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-29T18:30:58.517910] [INFO ] [MAIN ] Update Progress: 718/2367 symbols completed. EICC took 33.6s. Estimated remaining: 3h 28m 51s. Rate: 7.9 symbols/min [2025-10-29T18:30:58.775009] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-29T18:30:58.793584] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-29T18:30:59.593632] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-29T18:31:00.041783] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T18:31:00.360058] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T18:31:00.393516] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-29T18:31:01.193682] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-29T18:31:01.475244] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-29T18:31:01.478942] [INFO ] [REMOTE ] EIG: Full fetch complete (27341 records). [2025-10-29T18:31:01.479013] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-29T18:31:01.847672] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-29T18:31:01.847756] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-29T18:31:01.848174] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-29T18:31:01.848210] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-29T18:31:01.848851] [DEBUG] [LOCAL ] EIG: Trimmed 27341 records to 19707 (keeping 200 days of data) [2025-10-29T18:31:01.964551] [DEBUG] [LOCAL ] EIG: Primary data saved (19707 records). [2025-10-29T18:31:01.964739] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-29T18:31:01.964822] [INFO ] [MAIN ] Update Progress: 719/2367 symbols completed. EIG took 20.1s. Estimated remaining: 3h 28m 34s. Rate: 7.9 symbols/min [2025-10-29T18:31:02.809537] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-29T18:31:02.820918] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-29T18:31:04.322162] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-29T18:31:04.333287] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-29T18:31:05.884060] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T18:31:05.895398] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-29T18:31:07.359296] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-29T18:31:07.370224] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-29T18:31:08.958410] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-29T18:31:08.973565] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-29T18:31:10.423342] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T18:31:10.435229] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-29T18:31:11.941071] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-29T18:31:11.960033] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-29T18:31:12.663865] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-29T18:31:12.674845] [INFO ] [REMOTE ] EIX: Full fetch complete (77447 records). [2025-10-29T18:31:12.674975] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-29T18:31:13.092387] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-29T18:31:13.092487] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-29T18:31:13.093382] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-29T18:31:13.093446] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-29T18:31:13.094894] [DEBUG] [LOCAL ] EIX: Trimmed 77447 records to 53336 (keeping 200 days of data) [2025-10-29T18:31:13.409263] [DEBUG] [LOCAL ] EIX: Primary data saved (53336 records). [2025-10-29T18:31:13.409396] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-29T18:31:13.409473] [INFO ] [MAIN ] Update Progress: 720/2367 symbols completed. EIX took 20.4s. Estimated remaining: 3h 28m 35s. Rate: 7.9 symbols/min [2025-10-29T18:31:14.175057] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:14.174166] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:14.152320] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:14.192234] [DEBUG] [LOCAL ] ELF: No existing data file found in primary storage. [2025-10-29T18:31:14.194559] [WARN ] [MAIN ] ELF: No existing data found, performing full refresh instead. [2025-10-29T18:31:14.194757] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-29T18:31:14.195163] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-29T18:31:14.194360] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:14.195345] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-29T18:31:14.195593] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-29T18:31:14.269173] [DEBUG] [LOCAL ] ELC: Loaded 3405 existing records from primary storage. [2025-10-29T18:31:14.291389] [INFO ] [MAIN ] ELC: Loaded 3405 existing records. [2025-10-29T18:31:14.752424] [DEBUG] [LOCAL ] ELAN: Loaded 53301 existing records from primary storage. [2025-10-29T18:31:14.791700] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:31:14.763462] [DEBUG] [LOCAL ] EL: Loaded 53368 existing records from primary storage. [2025-10-29T18:31:14.792138] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-29T18:31:14.792293] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-29T18:31:14.825483] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-29T18:31:14.831198] [INFO ] [MAIN ] ELAN: Loaded 53301 existing records. [2025-10-29T18:31:14.853475] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-29T18:31:14.853393] [INFO ] [MAIN ] EL: Loaded 53368 existing records. [2025-10-29T18:31:14.859806] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:14.910381] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-29T18:31:15.362134] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:31:15.464781] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:31:15.470260] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-29T18:31:15.464902] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-29T18:31:15.488838] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-29T18:31:15.497460] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-29T18:31:15.524922] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-29T18:31:15.535340] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-29T18:31:15.535284] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-29T18:31:15.535493] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-29T18:31:15.842852] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:15.873227] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-29T18:31:16.361117] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:16.362958] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-29T18:31:16.383731] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:16.384195] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-29T18:31:16.536749] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-29T18:31:16.540236] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-29T18:31:16.539075] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-29T18:31:16.551401] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-29T18:31:16.847692] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-29T18:31:16.848996] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-29T18:31:17.177921] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-29T18:31:17.179315] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-29T18:31:17.515240] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-29T18:31:17.516805] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-29T18:31:17.580397] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T18:31:17.591197] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-29T18:31:17.813784] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T18:31:17.824297] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-29T18:31:17.870574] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-29T18:31:17.872048] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-29T18:31:18.226726] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-29T18:31:18.228912] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-29T18:31:18.240353] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-29T18:31:18.242055] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-29T18:31:18.570981] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-29T18:31:18.793526] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-29T18:31:18.883988] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T18:31:19.054552] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-29T18:31:19.089264] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-29T18:31:19.593526] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-29T18:31:19.815760] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-29T18:31:19.846163] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-29T18:31:20.393553] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-29T18:31:21.193565] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-29T18:31:21.616473] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T18:31:21.709520] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-29T18:31:21.711042] [INFO ] [REMOTE ] ELC: Full fetch complete (4904 records). [2025-10-29T18:31:21.711108] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-29T18:31:21.998761] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-29T18:31:22.092076] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-29T18:31:22.092153] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-29T18:31:22.092314] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-29T18:31:22.092374] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-29T18:31:22.092793] [DEBUG] [LOCAL ] ELC: Trimmed 4904 records to 3421 (keeping 200 days of data) [2025-10-29T18:31:22.113689] [DEBUG] [LOCAL ] ELC: Primary data saved (3421 records). [2025-10-29T18:31:22.113814] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-29T18:31:22.113903] [INFO ] [MAIN ] Update Progress: 721/2367 symbols completed. ELC took 8.7s. Estimated remaining: 3h 28m 30s. Rate: 7.9 symbols/min [2025-10-29T18:31:22.297614] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:22.297819] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-29T18:31:22.297862] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-29T18:31:22.298015] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-29T18:31:22.298071] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-29T18:31:22.298114] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-29T18:31:22.298146] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-29T18:31:22.670467] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:22.793531] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-29T18:31:23.593618] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-29T18:31:23.905967] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-29T18:31:24.393542] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-29T18:31:24.530549] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-29T18:31:24.635179] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T18:31:25.193618] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-29T18:31:25.993540] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-29T18:31:26.171801] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-29T18:31:26.793554] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-29T18:31:26.860537] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-29T18:31:27.239431] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T18:31:27.593625] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-29T18:31:28.312566] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-29T18:31:28.393600] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-29T18:31:28.476867] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T18:31:29.193631] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-29T18:31:29.993550] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-29T18:31:30.078426] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-29T18:31:30.390101] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T18:31:30.793571] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-29T18:31:30.924569] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-29T18:31:31.593561] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-29T18:31:32.021955] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T18:31:32.393577] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-29T18:31:33.101158] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-29T18:31:33.193525] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-29T18:31:33.924334] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T18:31:33.993567] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-29T18:31:34.650069] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T18:31:34.793562] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-29T18:31:35.587016] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-29T18:31:35.598095] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-29T18:31:35.913471] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T18:31:36.393562] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-29T18:31:37.200688] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-29T18:31:37.207212] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-29T18:31:37.560418] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T18:31:37.993549] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-29T18:31:38.382542] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T18:31:38.793551] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-29T18:31:39.142990] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T18:31:39.593561] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-29T18:31:40.229362] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T18:31:40.393528] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-29T18:31:40.482052] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T18:31:41.193554] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-29T18:31:41.747195] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T18:31:41.993573] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-29T18:31:42.621339] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T18:31:42.634385] [INFO ] [REMOTE ] EL: Full fetch complete (77433 records). [2025-10-29T18:31:42.634557] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-29T18:31:42.799524] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-29T18:31:42.867270] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-29T18:31:43.093248] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-29T18:31:43.093328] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-29T18:31:43.094235] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-29T18:31:43.094296] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-29T18:31:43.095831] [DEBUG] [LOCAL ] EL: Trimmed 77433 records to 53368 (keeping 200 days of data) [2025-10-29T18:31:43.420302] [DEBUG] [LOCAL ] EL: Primary data saved (53368 records). [2025-10-29T18:31:43.420449] [INFO ] [MAIN ] EL: Full history saved. [2025-10-29T18:31:43.420527] [INFO ] [MAIN ] Update Progress: 722/2367 symbols completed. EL took 30.0s. Estimated remaining: 3h 28m 53s. Rate: 7.9 symbols/min [2025-10-29T18:31:43.585364] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:43.598353] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-29T18:31:43.609632] [DEBUG] [LOCAL ] ELP: Loaded 25193 existing records from primary storage. [2025-10-29T18:31:43.609907] [INFO ] [MAIN ] ELP: Loaded 25193 existing records. [2025-10-29T18:31:43.783504] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:31:43.783729] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-29T18:31:43.783781] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-29T18:31:43.783979] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-29T18:31:43.784018] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-29T18:31:44.131906] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:44.393621] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-29T18:31:44.548474] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-29T18:31:44.560021] [INFO ] [REMOTE ] ELAN: Full fetch complete (77092 records). [2025-10-29T18:31:44.560197] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-29T18:31:44.958695] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-29T18:31:44.958786] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-29T18:31:44.959689] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-29T18:31:44.959784] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-29T18:31:44.961268] [DEBUG] [LOCAL ] ELAN: Trimmed 77092 records to 53299 (keeping 200 days of data) [2025-10-29T18:31:45.196553] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-29T18:31:45.302702] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-29T18:31:45.317388] [DEBUG] [LOCAL ] ELAN: Primary data saved (53299 records). [2025-10-29T18:31:45.317849] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-29T18:31:45.318121] [INFO ] [MAIN ] Update Progress: 723/2367 symbols completed. ELAN took 31.9s. Estimated remaining: 3h 28m 33s. Rate: 7.9 symbols/min [2025-10-29T18:31:45.339678] [INFO ] [REMOTE ] ELF: Full fetch complete (75107 records). [2025-10-29T18:31:45.368141] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-29T18:31:45.404757] [FATAL] [VALIDATOR ] ELF: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:31:45.430412] [FATAL] [MAIN ] ELF: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:31:45.430704] [WARN ] [MAIN ] ELF: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:31:45.446901] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-29T18:31:45.452174] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-29T18:31:45.452400] [INFO ] [LOCAL ] ELF: Starting deletion of derivative data. [2025-10-29T18:31:45.470993] [DEBUG] [LOCAL ] ELF: No derivative data file found to delete. [2025-10-29T18:31:45.477520] [INFO ] [MAIN ] Update Progress: 724/2367 symbols completed. ELF took 32.1s. Estimated remaining: 3h 28m 8s. Rate: 7.9 symbols/min [2025-10-29T18:31:45.562282] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:45.571140] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T18:31:45.584203] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-29T18:31:45.599159] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-29T18:31:45.624185] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-29T18:31:45.641040] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-29T18:31:45.644150] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-29T18:31:45.644502] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-29T18:31:45.832308] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:45.997324] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-29T18:31:46.122089] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:46.140922] [DEBUG] [LOCAL ] ELS: Loaded 49824 existing records from primary storage. [2025-10-29T18:31:46.141353] [INFO ] [MAIN ] ELS: Loaded 49824 existing records. [2025-10-29T18:31:46.371337] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:31:46.371552] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-29T18:31:46.371667] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-29T18:31:46.382982] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-29T18:31:46.398544] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-29T18:31:46.433255] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T18:31:46.798575] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:46.795278] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-29T18:31:46.801402] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-29T18:31:47.175624] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T18:31:47.593554] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-29T18:31:47.823394] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-29T18:31:48.393612] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-29T18:31:49.193599] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-29T18:31:49.531359] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-29T18:31:49.561036] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T18:31:49.993563] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-29T18:31:50.793551] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-29T18:31:51.086976] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-29T18:31:51.281269] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T18:31:51.593598] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-29T18:31:52.393591] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-29T18:31:52.655845] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T18:31:53.193583] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-29T18:31:53.447581] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T18:31:53.993570] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-29T18:31:54.275925] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-29T18:31:54.314143] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-29T18:31:54.793595] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-29T18:31:55.007510] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-29T18:31:55.593568] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-29T18:31:56.393534] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-29T18:31:56.561411] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T18:31:57.193606] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-29T18:31:57.636761] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T18:31:57.645365] [INFO ] [REMOTE ] ELME: Full fetch complete (56181 records). [2025-10-29T18:31:57.645511] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-29T18:31:58.008935] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-29T18:31:58.052677] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-29T18:31:58.052774] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-29T18:31:58.053553] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-29T18:31:58.053667] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-29T18:31:58.070032] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T18:31:58.075851] [DEBUG] [LOCAL ] ELME: Trimmed 56181 records to 39268 (keeping 200 days of data) [2025-10-29T18:31:58.306096] [DEBUG] [LOCAL ] ELME: Primary data saved (39268 records). [2025-10-29T18:31:58.306229] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-29T18:31:58.306299] [INFO ] [MAIN ] Update Progress: 725/2367 symbols completed. ELME took 36.2s. Estimated remaining: 3h 28m 12s. Rate: 7.9 symbols/min [2025-10-29T18:31:58.404732] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-29T18:31:58.496442] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:31:58.543012] [DEBUG] [LOCAL ] ELV: Loaded 50655 existing records from primary storage. [2025-10-29T18:31:58.543332] [INFO ] [MAIN ] ELV: Loaded 50655 existing records. [2025-10-29T18:31:58.745987] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:31:58.746248] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-29T18:31:58.746297] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-29T18:31:58.746857] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-29T18:31:58.746916] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-29T18:31:58.801185] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-29T18:31:59.105540] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:31:59.593553] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-29T18:31:59.649025] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-29T18:31:59.812396] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-29T18:32:00.393587] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-29T18:32:01.193550] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-29T18:32:01.282634] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T18:32:01.993528] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-29T18:32:02.591915] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T18:32:02.794374] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-29T18:32:03.003713] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T18:32:03.593604] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-29T18:32:03.797160] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-10-29T18:32:04.038995] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T18:32:04.393622] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-29T18:32:05.193575] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-29T18:32:05.523259] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T18:32:05.993597] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-29T18:32:06.465259] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:32:06.793591] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-29T18:32:07.170740] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-29T18:32:07.171488] [INFO ] [REMOTE ] ELPC: Full fetch complete (1234 records). [2025-10-29T18:32:07.171556] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-29T18:32:07.171917] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:32:07.171996] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:32:07.172037] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:32:07.172097] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-29T18:32:07.172156] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-29T18:32:07.172191] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-29T18:32:07.172229] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-29T18:32:07.172277] [INFO ] [MAIN ] Update Progress: 726/2367 symbols completed. ELPC took 21.9s. Estimated remaining: 3h 28m 8s. Rate: 7.9 symbols/min [2025-10-29T18:32:07.375265] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:32:07.372096] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T18:32:07.375505] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-29T18:32:07.385961] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-29T18:32:07.386308] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-29T18:32:07.386371] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-29T18:32:07.386541] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-29T18:32:07.386586] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-29T18:32:07.598797] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-29T18:32:07.743935] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:32:08.393563] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-29T18:32:08.655359] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-29T18:32:09.193565] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-29T18:32:09.622838] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:32:09.962439] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T18:32:09.993532] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-29T18:32:10.793565] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-29T18:32:10.853581] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-29T18:32:10.858955] [INFO ] [REMOTE ] ELP: Full fetch complete (36490 records). [2025-10-29T18:32:10.859099] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-29T18:32:10.859809] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:32:10.859899] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:32:10.859943] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:32:10.860006] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-29T18:32:10.860070] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-29T18:32:10.860107] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-10-29T18:32:10.860272] [DEBUG] [LOCAL ] ELP: Deleted derivative data file. [2025-10-29T18:32:10.860368] [INFO ] [MAIN ] Update Progress: 727/2367 symbols completed. ELP took 27.4s. Estimated remaining: 3h 27m 51s. Rate: 7.9 symbols/min [2025-10-29T18:32:11.045374] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:32:11.064253] [DEBUG] [LOCAL ] EMD: Loaded 20344 existing records from primary storage. [2025-10-29T18:32:11.064565] [INFO ] [MAIN ] EMD: Loaded 20344 existing records. [2025-10-29T18:32:11.259670] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:32:11.259917] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-29T18:32:11.259965] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-29T18:32:11.260157] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-29T18:32:11.260210] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-29T18:32:11.598694] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-29T18:32:11.637841] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:32:11.793950] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T18:32:11.794306] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-29T18:32:11.794419] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:32:11.794478] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-29T18:32:11.794551] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:32:11.794633] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-29T18:32:11.794753] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-29T18:32:11.794803] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-29T18:32:11.794858] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-29T18:32:11.794965] [INFO ] [MAIN ] Update Progress: 728/2367 symbols completed. EMA took 4.6s. Estimated remaining: 3h 27m 29s. Rate: 7.9 symbols/min [2025-10-29T18:32:11.984161] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:32:12.027482] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T18:32:12.049573] [DEBUG] [LOCAL ] EME: Loaded 30406 existing records from primary storage. [2025-10-29T18:32:12.049871] [INFO ] [MAIN ] EME: Loaded 30406 existing records. [2025-10-29T18:32:12.230621] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:32:12.230873] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-29T18:32:12.230920] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-29T18:32:12.231301] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-29T18:32:12.231342] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-29T18:32:12.393542] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-29T18:32:12.596565] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:32:13.132170] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-29T18:32:13.193540] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-29T18:32:13.993581] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-29T18:32:14.623538] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-29T18:32:14.671276] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-29T18:32:14.793552] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-29T18:32:15.585561] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-29T18:32:15.593509] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-29T18:32:16.393549] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-29T18:32:16.440502] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-29T18:32:17.193556] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-29T18:32:17.622535] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-29T18:32:17.632963] [INFO ] [REMOTE ] ELS: Full fetch complete (71049 records). [2025-10-29T18:32:17.633125] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-29T18:32:17.633926] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:32:17.634010] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:32:17.634052] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:32:17.634093] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-29T18:32:17.634148] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-29T18:32:17.634186] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-10-29T18:32:17.634339] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-10-29T18:32:17.634409] [INFO ] [MAIN ] Update Progress: 729/2367 symbols completed. ELS took 32.2s. Estimated remaining: 3h 27m 17s. Rate: 7.9 symbols/min [2025-10-29T18:32:17.811413] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:32:17.819630] [DEBUG] [LOCAL ] EMF: Loaded 2985 existing records from primary storage. [2025-10-29T18:32:17.819827] [INFO ] [MAIN ] EMF: Loaded 2985 existing records. [2025-10-29T18:32:17.996127] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-29T18:32:17.999767] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:32:18.000981] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-29T18:32:18.001032] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-29T18:32:18.001167] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-29T18:32:18.001234] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-29T18:32:18.375386] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:32:18.502411] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T18:32:18.793532] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-29T18:32:18.838584] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T18:32:19.593557] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-29T18:32:20.248083] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T18:32:20.261935] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T18:32:20.393598] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-29T18:32:21.193566] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-29T18:32:21.801195] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T18:32:21.963633] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T18:32:21.993522] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-29T18:32:22.691240] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T18:32:22.793556] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-29T18:32:23.593520] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-29T18:32:23.704071] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T18:32:24.393562] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-29T18:32:24.891865] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T18:32:25.181314] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T18:32:25.185967] [INFO ] [REMOTE ] EMD: Full fetch complete (31846 records). [2025-10-29T18:32:25.186074] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-29T18:32:25.198762] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-29T18:32:25.552039] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-29T18:32:25.552111] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-29T18:32:25.552627] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-29T18:32:25.552698] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-29T18:32:25.553359] [DEBUG] [LOCAL ] EMD: Trimmed 31846 records to 20351 (keeping 200 days of data) [2025-10-29T18:32:25.670623] [DEBUG] [LOCAL ] EMD: Primary data saved (20351 records). [2025-10-29T18:32:25.670763] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-29T18:32:25.670837] [INFO ] [MAIN ] Update Progress: 730/2367 symbols completed. EMD took 14.8s. Estimated remaining: 3h 27m 10s. Rate: 7.9 symbols/min [2025-10-29T18:32:25.839740] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:32:25.886319] [DEBUG] [LOCAL ] EMN: Loaded 50800 existing records from primary storage. [2025-10-29T18:32:25.886601] [INFO ] [MAIN ] EMN: Loaded 50800 existing records. [2025-10-29T18:32:25.998690] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-29T18:32:26.064579] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:32:26.064774] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-29T18:32:26.064820] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-29T18:32:26.065095] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-29T18:32:26.065178] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-29T18:32:26.420702] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:32:26.793574] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-29T18:32:26.984973] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-29T18:32:27.218319] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T18:32:27.502486] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T18:32:27.593565] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-29T18:32:28.393534] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-29T18:32:28.607976] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T18:32:29.193556] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-29T18:32:29.707241] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T18:32:29.993549] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-29T18:32:30.288161] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-29T18:32:30.721089] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T18:32:30.793534] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-29T18:32:31.593628] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-29T18:32:32.155411] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T18:32:32.393562] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-29T18:32:32.662286] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T18:32:32.891286] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-29T18:32:33.193627] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-29T18:32:33.579123] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-29T18:32:33.993614] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-29T18:32:34.793571] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-29T18:32:35.144090] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T18:32:35.593565] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-29T18:32:35.953186] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-29T18:32:36.393609] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-29T18:32:36.486676] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-29T18:32:36.496620] [INFO ] [REMOTE ] ELV: Full fetch complete (72927 records). [2025-10-29T18:32:36.496798] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-29T18:32:36.498361] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:32:36.498458] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:32:36.498501] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:32:36.498539] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-29T18:32:36.498593] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-29T18:32:36.498628] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-29T18:32:36.498829] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-10-29T18:32:36.498910] [INFO ] [MAIN ] Update Progress: 731/2367 symbols completed. ELV took 38.2s. Estimated remaining: 3h 27m 10s. Rate: 7.9 symbols/min [2025-10-29T18:32:36.671022] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:32:36.686203] [DEBUG] [LOCAL ] EMO: Loaded 13310 existing records from primary storage. [2025-10-29T18:32:36.686422] [INFO ] [MAIN ] EMO: Loaded 13310 existing records. [2025-10-29T18:32:36.860012] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:32:36.860231] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-29T18:32:36.860284] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-29T18:32:36.860474] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-29T18:32:36.860511] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-29T18:32:37.206208] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-29T18:32:37.211702] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:32:37.570611] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T18:32:37.993631] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-29T18:32:38.333572] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-29T18:32:38.340050] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:32:38.793560] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-29T18:32:39.593580] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-29T18:32:40.015066] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-29T18:32:40.067233] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-29T18:32:40.393597] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-29T18:32:41.193730] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-29T18:32:41.497953] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-29T18:32:41.761891] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T18:32:41.993579] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-29T18:32:42.367759] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-29T18:32:42.793556] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-29T18:32:43.593564] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-29T18:32:43.784634] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T18:32:44.046066] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-29T18:32:44.047330] [INFO ] [REMOTE ] EMF: Full fetch complete (5968 records). [2025-10-29T18:32:44.047401] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-29T18:32:44.398752] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-29T18:32:44.406167] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-29T18:32:44.406244] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-29T18:32:44.407154] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-29T18:32:44.407215] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-29T18:32:44.407582] [DEBUG] [LOCAL ] EMF: Trimmed 5968 records to 3024 (keeping 200 days of data) [2025-10-29T18:32:44.426683] [DEBUG] [LOCAL ] EMF: Primary data saved (3024 records). [2025-10-29T18:32:44.426765] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-29T18:32:44.426834] [INFO ] [MAIN ] Update Progress: 732/2367 symbols completed. EMF took 26.8s. Estimated remaining: 3h 27m 3s. Rate: 7.9 symbols/min [2025-10-29T18:32:44.592052] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:32:44.599058] [DEBUG] [LOCAL ] EMP: Loaded 2819 existing records from primary storage. [2025-10-29T18:32:44.599273] [INFO ] [MAIN ] EMP: Loaded 2819 existing records. [2025-10-29T18:32:44.777424] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:32:44.777702] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-29T18:32:44.777770] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-29T18:32:44.777953] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-29T18:32:44.778009] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-29T18:32:45.125938] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:32:45.193548] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-29T18:32:45.478440] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T18:32:45.677713] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-29T18:32:45.993626] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-29T18:32:46.793556] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-29T18:32:46.837557] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-29T18:32:47.074009] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-29T18:32:47.593547] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-29T18:32:47.901106] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-29T18:32:48.393607] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-29T18:32:48.759040] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-29T18:32:49.193552] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-29T18:32:49.993560] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-29T18:32:50.564214] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T18:32:50.793840] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-29T18:32:51.593589] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-29T18:32:51.620628] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-29T18:32:52.272737] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-29T18:32:52.361548] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T18:32:52.393535] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-29T18:32:52.931340] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-29T18:32:53.193560] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-29T18:32:53.993598] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-29T18:32:54.455931] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-29T18:32:54.793566] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-29T18:32:55.228888] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-29T18:32:55.593578] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-29T18:32:56.393584] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-29T18:32:56.919108] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-29T18:32:57.073274] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (3.88 seconds). [2025-10-29T18:32:57.193540] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-29T18:32:57.434156] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-29T18:32:57.440961] [INFO ] [REMOTE ] EME: Full fetch complete (47032 records). [2025-10-29T18:32:57.441103] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-29T18:32:57.810207] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-29T18:32:57.810279] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-29T18:32:57.810925] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-29T18:32:57.810986] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-29T18:32:57.811914] [DEBUG] [LOCAL ] EME: Trimmed 47032 records to 30390 (keeping 200 days of data) [2025-10-29T18:32:57.999935] [DEBUG] [LOCAL ] EME: Primary data saved (30390 records). [2025-10-29T18:32:58.000063] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-29T18:32:58.000452] [INFO ] [MAIN ] EME: Full history saved. [2025-10-29T18:32:58.002012] [INFO ] [MAIN ] Update Progress: 733/2367 symbols completed. EME took 46.2s. Estimated remaining: 3h 27m 9s. Rate: 7.9 symbols/min [2025-10-29T18:32:58.168439] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:32:58.168587] [DEBUG] [LOCAL ] EMR: No existing data file found in primary storage. [2025-10-29T18:32:58.168623] [WARN ] [MAIN ] EMR: No existing data found, performing full refresh instead. [2025-10-29T18:32:58.168772] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-29T18:32:58.168812] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-29T18:32:58.168853] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-29T18:32:58.168883] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-29T18:32:58.523688] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:32:58.555187] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T18:32:58.684348] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-29T18:32:58.793603] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-29T18:32:59.315114] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-29T18:32:59.593556] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-29T18:33:00.088939] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-29T18:33:00.393576] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-29T18:33:01.193533] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-29T18:33:01.314941] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-29T18:33:01.993575] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-29T18:33:02.462793] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T18:33:02.775276] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-29T18:33:02.793583] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-29T18:33:03.491057] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T18:33:03.593553] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-29T18:33:04.393565] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-29T18:33:04.703848] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:33:05.034586] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T18:33:05.193605] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-29T18:33:05.559672] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-29T18:33:05.993633] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-29T18:33:06.793560] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-29T18:33:07.338634] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T18:33:07.353919] [INFO ] [REMOTE ] EMN: Full fetch complete (72149 records). [2025-10-29T18:33:07.354107] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-29T18:33:07.355054] [FATAL] [VALIDATOR ] EMN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:33:07.355154] [FATAL] [MAIN ] EMN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:33:07.355198] [WARN ] [MAIN ] EMN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:33:07.355244] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-29T18:33:07.355301] [DEBUG] [LOCAL ] EMN: No primary data file found to delete. [2025-10-29T18:33:07.355337] [INFO ] [LOCAL ] EMN: Starting deletion of derivative data. [2025-10-29T18:33:07.355518] [DEBUG] [LOCAL ] EMN: Deleted derivative data file. [2025-10-29T18:33:07.356823] [INFO ] [MAIN ] Update Progress: 734/2367 symbols completed. EMN took 41.7s. Estimated remaining: 3h 27m 5s. Rate: 7.9 symbols/min [2025-10-29T18:33:07.594320] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:33:07.594719] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-29T18:33:07.595716] [DEBUG] [LOCAL ] ENB: No existing data file found in primary storage. [2025-10-29T18:33:07.595780] [WARN ] [MAIN ] ENB: No existing data found, performing full refresh instead. [2025-10-29T18:33:07.596991] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-29T18:33:07.597057] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-29T18:33:07.597107] [DEBUG] [LOCAL ] ENB: No primary data file found to delete. [2025-10-29T18:33:07.597144] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-29T18:33:08.159593] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:33:08.207958] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-29T18:33:08.331946] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-29T18:33:08.393635] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-29T18:33:09.193576] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-29T18:33:09.566704] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-29T18:33:09.567694] [INFO ] [REMOTE ] EMP: Full fetch complete (4019 records). [2025-10-29T18:33:09.567761] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-29T18:33:09.925041] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-29T18:33:09.925253] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-29T18:33:09.925442] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-29T18:33:09.925548] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-29T18:33:09.926074] [DEBUG] [LOCAL ] EMP: Trimmed 4019 records to 2802 (keeping 200 days of data) [2025-10-29T18:33:09.943602] [DEBUG] [LOCAL ] EMP: Primary data saved (2802 records). [2025-10-29T18:33:09.943741] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-29T18:33:09.943834] [INFO ] [MAIN ] Update Progress: 735/2367 symbols completed. EMP took 25.5s. Estimated remaining: 3h 26m 47s. Rate: 7.9 symbols/min [2025-10-29T18:33:09.998826] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-29T18:33:10.124348] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-29T18:33:10.165261] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:33:10.200082] [DEBUG] [LOCAL ] ENIC: Loaded 35951 existing records from primary storage. [2025-10-29T18:33:10.200347] [INFO ] [MAIN ] ENIC: Loaded 35951 existing records. [2025-10-29T18:33:10.384977] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:33:10.385212] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-29T18:33:10.385259] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-29T18:33:10.385633] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-29T18:33:10.385767] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-29T18:33:10.735238] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:33:10.793555] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-29T18:33:11.605218] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-29T18:33:11.610761] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-29T18:33:11.978259] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T18:33:12.393557] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-29T18:33:13.086331] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-29T18:33:13.193562] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-29T18:33:13.899297] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T18:33:13.993531] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-29T18:33:14.006942] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-29T18:33:14.010620] [INFO ] [REMOTE ] EMO: Full fetch complete (17697 records). [2025-10-29T18:33:14.010722] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-29T18:33:14.011153] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:33:14.011231] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:33:14.011278] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:33:14.011339] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-29T18:33:14.011399] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-29T18:33:14.011433] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-10-29T18:33:14.011601] [DEBUG] [LOCAL ] EMO: Deleted derivative data file. [2025-10-29T18:33:14.011712] [INFO ] [MAIN ] Update Progress: 736/2367 symbols completed. EMO took 37.5s. Estimated remaining: 3h 26m 31s. Rate: 7.9 symbols/min [2025-10-29T18:33:14.178748] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:33:14.182578] [DEBUG] [LOCAL ] ENO: Loaded 1587 existing records from primary storage. [2025-10-29T18:33:14.182746] [INFO ] [MAIN ] ENO: Loaded 1587 existing records. [2025-10-29T18:33:14.353612] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:33:14.353846] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-29T18:33:14.353902] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-29T18:33:14.354039] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-29T18:33:14.354077] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-29T18:33:14.729285] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:33:14.793543] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-29T18:33:15.194826] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-29T18:33:15.587431] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-29T18:33:15.597971] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-29T18:33:16.393526] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-29T18:33:16.448406] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T18:33:17.193566] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-29T18:33:17.631916] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:33:17.993539] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-29T18:33:18.134567] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T18:33:18.793585] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-29T18:33:19.212700] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-29T18:33:19.386147] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T18:33:19.593558] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-29T18:33:20.393565] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-29T18:33:20.788580] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T18:33:20.991220] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T18:33:21.193563] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-29T18:33:21.993626] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-29T18:33:22.747585] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-29T18:33:22.793578] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-29T18:33:23.169168] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T18:33:23.287005] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-29T18:33:23.593574] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-29T18:33:24.393556] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-29T18:33:24.985637] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T18:33:25.193574] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-29T18:33:25.566995] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T18:33:25.993610] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-29T18:33:26.793543] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-29T18:33:26.941402] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-29T18:33:26.952837] [INFO ] [REMOTE ] EMR: Full fetch complete (77176 records). [2025-10-29T18:33:26.953008] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-29T18:33:27.145933] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T18:33:27.456569] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-29T18:33:27.456693] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-29T18:33:27.457770] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-29T18:33:27.457836] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-29T18:33:27.459548] [DEBUG] [LOCAL ] EMR: Trimmed 77176 records to 53120 (keeping 200 days of data) [2025-10-29T18:33:27.593719] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-29T18:33:27.820939] [DEBUG] [LOCAL ] EMR: Primary data saved (53120 records). [2025-10-29T18:33:27.821132] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-29T18:33:27.821271] [INFO ] [MAIN ] Update Progress: 737/2367 symbols completed. EMR took 29.8s. Estimated remaining: 3h 26m 37s. Rate: 7.9 symbols/min [2025-10-29T18:33:28.011250] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:33:28.011881] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-10-29T18:33:28.012142] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-10-29T18:33:28.012288] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-29T18:33:28.012355] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-29T18:33:28.012404] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-29T18:33:28.012435] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-29T18:33:28.071069] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-29T18:33:28.351334] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-29T18:33:28.400806] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-29T18:33:28.431925] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:33:29.193585] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-29T18:33:29.340143] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T18:33:29.511896] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-29T18:33:29.993578] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-29T18:33:30.793529] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-29T18:33:30.929907] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T18:33:31.143624] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-29T18:33:31.593578] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-29T18:33:32.393538] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-29T18:33:32.491728] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T18:33:33.193586] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-29T18:33:33.466941] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-29T18:33:33.820634] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T18:33:33.993563] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-29T18:33:34.793532] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-29T18:33:34.947278] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T18:33:35.593570] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-29T18:33:36.309382] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-29T18:33:36.393597] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-29T18:33:36.771199] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-29T18:33:36.778268] [INFO ] [REMOTE ] ENIC: Full fetch complete (51064 records). [2025-10-29T18:33:36.778409] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-29T18:33:37.161078] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-29T18:33:37.161168] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-29T18:33:37.161983] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-29T18:33:37.162047] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-29T18:33:37.163133] [DEBUG] [LOCAL ] ENIC: Trimmed 51064 records to 35977 (keeping 200 days of data) [2025-10-29T18:33:37.207211] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-29T18:33:37.384022] [DEBUG] [LOCAL ] ENIC: Primary data saved (35977 records). [2025-10-29T18:33:37.384218] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-29T18:33:37.384337] [INFO ] [MAIN ] Update Progress: 738/2367 symbols completed. ENIC took 27.4s. Estimated remaining: 3h 26m 34s. Rate: 7.9 symbols/min [2025-10-29T18:33:37.575545] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:33:37.576015] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-10-29T18:33:37.576194] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-10-29T18:33:37.576570] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-29T18:33:37.576732] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-29T18:33:37.576819] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-10-29T18:33:37.577030] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-29T18:33:37.924086] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T18:33:37.999471] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-29T18:33:38.006470] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:33:38.267152] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T18:33:38.368143] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-29T18:33:38.793564] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-29T18:33:39.593586] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-29T18:33:39.922676] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-29T18:33:39.924085] [INFO ] [REMOTE ] ENO: Full fetch complete (2929 records). [2025-10-29T18:33:39.924182] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-29T18:33:39.924754] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:33:39.924836] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:33:39.924879] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:33:39.924920] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-29T18:33:39.924980] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-29T18:33:39.925044] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-10-29T18:33:39.925214] [DEBUG] [LOCAL ] ENO: Deleted derivative data file. [2025-10-29T18:33:39.925301] [INFO ] [MAIN ] Update Progress: 739/2367 symbols completed. ENO took 25.9s. Estimated remaining: 3h 26m 15s. Rate: 7.9 symbols/min [2025-10-29T18:33:40.124088] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:33:40.187358] [DEBUG] [LOCAL ] ENS: Loaded 29403 existing records from primary storage. [2025-10-29T18:33:40.190069] [INFO ] [MAIN ] ENS: Loaded 29403 existing records. [2025-10-29T18:33:40.189924] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-29T18:33:40.386079] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:33:40.386289] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-29T18:33:40.386365] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-29T18:33:40.386959] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-29T18:33:40.387020] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-29T18:33:40.399152] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-29T18:33:40.799364] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:33:41.193561] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-29T18:33:41.993566] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-29T18:33:42.068922] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-29T18:33:42.331517] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T18:33:42.793551] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-29T18:33:42.893416] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:33:43.593607] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-29T18:33:44.253690] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T18:33:44.393560] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-29T18:33:44.655738] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T18:33:45.193628] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-29T18:33:45.993591] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-29T18:33:46.134975] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T18:33:46.340949] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T18:33:46.793697] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-29T18:33:47.202019] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T18:33:47.593602] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-29T18:33:47.619618] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T18:33:48.393569] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-29T18:33:48.568014] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-29T18:33:49.193616] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-29T18:33:49.407387] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T18:33:49.993635] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-29T18:33:50.667938] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T18:33:50.793545] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-29T18:33:51.183406] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T18:33:51.593571] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-29T18:33:51.986753] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T18:33:52.393620] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-29T18:33:53.193629] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-29T18:33:53.489672] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-29T18:33:53.514277] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-29T18:33:53.521977] [INFO ] [REMOTE ] ENB: Full fetch complete (77663 records). [2025-10-29T18:33:53.522171] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-29T18:33:53.934045] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-29T18:33:53.934137] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-29T18:33:53.935058] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-29T18:33:53.935120] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-29T18:33:53.936678] [DEBUG] [LOCAL ] ENB: Trimmed 77663 records to 53511 (keeping 200 days of data) [2025-10-29T18:33:53.997636] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-29T18:33:54.285961] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-29T18:33:54.286194] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-29T18:33:54.286326] [INFO ] [MAIN ] Update Progress: 740/2367 symbols completed. ENB took 46.9s. Estimated remaining: 3h 26m 22s. Rate: 7.9 symbols/min [2025-10-29T18:33:54.460932] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:33:54.461168] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-10-29T18:33:54.461364] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-10-29T18:33:54.461526] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-29T18:33:54.461593] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-29T18:33:54.461769] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-10-29T18:33:54.461863] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-29T18:33:54.662349] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-29T18:33:54.798712] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-29T18:33:54.860858] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:33:54.977135] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T18:33:55.593613] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-29T18:33:56.070713] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T18:33:56.393546] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-29T18:33:56.460256] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T18:33:57.193549] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-29T18:33:57.607181] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T18:33:57.856531] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-29T18:33:57.993554] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-29T18:33:58.793558] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-29T18:33:59.186372] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T18:33:59.194336] [INFO ] [REMOTE ] ENOV: Full fetch complete (62840 records). [2025-10-29T18:33:59.194452] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-29T18:33:59.195148] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:33:59.195245] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:33:59.195324] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:33:59.195416] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-29T18:33:59.195495] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-29T18:33:59.195534] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-29T18:33:59.195573] [DEBUG] [LOCAL ] ENOV: No derivative data file found to delete. [2025-10-29T18:33:59.195629] [INFO ] [MAIN ] Update Progress: 741/2367 symbols completed. ENOV took 31.4s. Estimated remaining: 3h 26m 9s. Rate: 7.9 symbols/min [2025-10-29T18:33:59.369253] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:33:59.369396] [DEBUG] [LOCAL ] EOD: No existing data file found in primary storage. [2025-10-29T18:33:59.369432] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-10-29T18:33:59.369572] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-29T18:33:59.369630] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-29T18:33:59.369710] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-29T18:33:59.369767] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-29T18:33:59.602165] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-29T18:33:59.744692] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:33:59.770004] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T18:34:00.393695] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-29T18:34:00.632746] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T18:34:01.193618] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-29T18:34:01.999942] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-29T18:34:02.005631] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-29T18:34:02.793521] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-29T18:34:02.864670] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-29T18:34:02.994143] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T18:34:03.593609] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-29T18:34:04.127827] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T18:34:04.393558] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-29T18:34:04.668494] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-29T18:34:05.193556] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-29T18:34:05.499978] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T18:34:05.993547] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-29T18:34:06.793559] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-29T18:34:07.415717] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T18:34:07.593555] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-29T18:34:07.669169] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-29T18:34:08.393564] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-29T18:34:09.115522] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T18:34:09.125916] [INFO ] [REMOTE ] ENS: Full fetch complete (42911 records). [2025-10-29T18:34:09.126072] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-29T18:34:09.204408] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-29T18:34:09.498370] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (3.50 seconds). [2025-10-29T18:34:09.618123] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-29T18:34:09.626917] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-29T18:34:09.627437] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T18:34:09.628158] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-29T18:34:09.633313] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-29T18:34:09.634635] [DEBUG] [LOCAL ] ENS: Trimmed 42911 records to 29479 (keeping 200 days of data) [2025-10-29T18:34:09.815475] [DEBUG] [LOCAL ] ENS: Primary data saved (29479 records). [2025-10-29T18:34:09.815606] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-29T18:34:09.815741] [INFO ] [MAIN ] Update Progress: 742/2367 symbols completed. ENS took 29.9s. Estimated remaining: 3h 26m 8s. Rate: 7.9 symbols/min [2025-10-29T18:34:09.938186] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T18:34:10.009828] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-29T18:34:10.016991] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:34:10.070010] [DEBUG] [LOCAL ] EOG: Loaded 53388 existing records from primary storage. [2025-10-29T18:34:10.070383] [INFO ] [MAIN ] EOG: Loaded 53388 existing records. [2025-10-29T18:34:10.258817] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:34:10.259066] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-29T18:34:10.259115] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-29T18:34:10.259427] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-29T18:34:10.259479] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-29T18:34:10.625115] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:34:10.793530] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-29T18:34:10.811977] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T18:34:11.357244] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-29T18:34:11.593559] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-29T18:34:12.393533] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-29T18:34:12.489020] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-29T18:34:13.198548] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-29T18:34:13.200173] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-29T18:34:13.993554] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-29T18:34:14.633595] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-29T18:34:14.793529] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-29T18:34:14.835401] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-29T18:34:15.553433] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T18:34:15.593530] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-29T18:34:16.262607] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-29T18:34:16.393558] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-29T18:34:17.193534] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-29T18:34:17.238434] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-29T18:34:17.993549] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-29T18:34:18.551394] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T18:34:18.560165] [INFO ] [REMOTE ] ENR: Full fetch complete (59776 records). [2025-10-29T18:34:18.560288] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-29T18:34:18.798713] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-29T18:34:18.979323] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-29T18:34:18.979480] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-29T18:34:18.980269] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-29T18:34:18.980341] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-29T18:34:18.996746] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-29T18:34:19.003181] [DEBUG] [LOCAL ] ENR: Trimmed 59776 records to 43550 (keeping 200 days of data) [2025-10-29T18:34:19.252604] [DEBUG] [LOCAL ] ENR: Primary data saved (43550 records). [2025-10-29T18:34:19.252755] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-29T18:34:19.252828] [INFO ] [MAIN ] Update Progress: 743/2367 symbols completed. ENR took 41.9s. Estimated remaining: 3h 26m 4s. Rate: 7.9 symbols/min [2025-10-29T18:34:19.419660] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:34:19.430332] [DEBUG] [LOCAL ] EOI: Loaded 9917 existing records from primary storage. [2025-10-29T18:34:19.430519] [INFO ] [MAIN ] EOI: Loaded 9917 existing records. [2025-10-29T18:34:19.606618] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-29T18:34:19.611735] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:34:19.613036] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-29T18:34:19.613122] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-29T18:34:19.613322] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-29T18:34:19.613380] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-29T18:34:19.986125] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:34:19.995233] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T18:34:20.393568] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-29T18:34:20.812459] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T18:34:20.817756] [INFO ] [REMOTE ] ENVA: Full fetch complete (36834 records). [2025-10-29T18:34:20.817847] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-29T18:34:21.193470] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T18:34:21.204738] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-29T18:34:21.207967] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-29T18:34:21.211186] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-29T18:34:21.211933] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-29T18:34:21.212013] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-29T18:34:21.213249] [INFO ] [REMOTE ] EOD: Full fetch complete (20667 records). [2025-10-29T18:34:21.213679] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-29T18:34:21.213813] [DEBUG] [LOCAL ] ENVA: Trimmed 36834 records to 24947 (keeping 200 days of data) [2025-10-29T18:34:21.215028] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:34:21.215168] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:34:21.215235] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:34:21.215307] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-29T18:34:21.215371] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-29T18:34:21.215409] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-29T18:34:21.215452] [DEBUG] [LOCAL ] EOD: No derivative data file found to delete. [2025-10-29T18:34:21.215509] [INFO ] [MAIN ] Update Progress: 744/2367 symbols completed. EOD took 22.0s. Estimated remaining: 3h 25m 44s. Rate: 7.9 symbols/min [2025-10-29T18:34:21.540501] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:34:21.550312] [DEBUG] [LOCAL ] ENVA: Primary data saved (24947 records). [2025-10-29T18:34:21.551155] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-29T18:34:21.551259] [INFO ] [MAIN ] Update Progress: 745/2367 symbols completed. ENVA took 27.3s. Estimated remaining: 3h 25m 21s. Rate: 7.9 symbols/min [2025-10-29T18:34:21.712478] [DEBUG] [LOCAL ] EOS: Loaded 14269 existing records from primary storage. [2025-10-29T18:34:21.727939] [INFO ] [MAIN ] EOS: Loaded 14269 existing records. [2025-10-29T18:34:21.788531] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:34:21.918519] [DEBUG] [LOCAL ] EOT: Loaded 6982 existing records from primary storage. [2025-10-29T18:34:21.926776] [INFO ] [MAIN ] EOT: Loaded 6982 existing records. [2025-10-29T18:34:22.021057] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-29T18:34:22.000483] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:34:22.049722] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-29T18:34:22.057086] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-29T18:34:22.061456] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-29T18:34:22.066915] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-29T18:34:22.259815] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:34:22.283251] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-29T18:34:22.288461] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-29T18:34:22.297052] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-29T18:34:22.318952] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-29T18:34:22.803625] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:34:22.818374] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-29T18:34:22.917523] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:34:22.925317] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:34:22.961431] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-29T18:34:23.593571] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-29T18:34:24.136676] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T18:34:24.393575] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-29T18:34:24.965076] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T18:34:25.008867] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T18:34:25.193542] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-29T18:34:25.745696] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-29T18:34:25.993533] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-29T18:34:26.743271] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-29T18:34:26.793565] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-29T18:34:27.298667] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T18:34:27.593591] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-29T18:34:28.086339] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-29T18:34:28.393596] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-29T18:34:28.890487] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-29T18:34:29.193549] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-29T18:34:29.835848] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-29T18:34:29.993585] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-29T18:34:30.620336] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T18:34:30.793625] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-29T18:34:31.593593] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-29T18:34:32.230792] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T18:34:32.288975] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-29T18:34:32.393565] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-29T18:34:33.193555] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-29T18:34:33.889918] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-29T18:34:33.993561] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-29T18:34:34.308900] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T18:34:34.653073] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-29T18:34:34.793602] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-29T18:34:35.328101] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-29T18:34:35.593559] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-29T18:34:36.148470] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-29T18:34:36.393592] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-29T18:34:37.193568] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-29T18:34:37.760556] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T18:34:37.780952] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T18:34:37.993577] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-29T18:34:38.793569] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-29T18:34:39.193580] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T18:34:39.380092] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T18:34:39.593569] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-29T18:34:40.213738] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-29T18:34:40.393608] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-29T18:34:41.032007] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T18:34:41.034829] [INFO ] [REMOTE ] EOI: Full fetch complete (15820 records). [2025-10-29T18:34:41.034898] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-29T18:34:41.200081] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-29T18:34:41.406188] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-29T18:34:41.406261] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-29T18:34:41.406662] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-29T18:34:41.406724] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-29T18:34:41.407210] [DEBUG] [LOCAL ] EOI: Trimmed 15820 records to 9916 (keeping 200 days of data) [2025-10-29T18:34:41.468225] [DEBUG] [LOCAL ] EOI: Primary data saved (9916 records). [2025-10-29T18:34:41.468354] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-29T18:34:41.468431] [INFO ] [MAIN ] Update Progress: 746/2367 symbols completed. EOI took 22.2s. Estimated remaining: 3h 25m 40s. Rate: 7.9 symbols/min [2025-10-29T18:34:41.650172] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:34:41.673969] [DEBUG] [LOCAL ] EPAC: Loaded 25996 existing records from primary storage. [2025-10-29T18:34:41.674244] [INFO ] [MAIN ] EPAC: Loaded 25996 existing records. [2025-10-29T18:34:41.879082] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:34:41.879339] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-29T18:34:41.879993] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-29T18:34:41.880197] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-29T18:34:41.880237] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-29T18:34:41.998630] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-29T18:34:42.251620] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:34:42.621425] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T18:34:42.654333] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-29T18:34:42.793616] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-29T18:34:43.231392] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-29T18:34:43.593568] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-29T18:34:44.393568] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-29T18:34:45.193598] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-29T18:34:45.395218] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-29T18:34:45.840211] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T18:34:45.931569] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T18:34:45.993610] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-29T18:34:46.793605] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-29T18:34:47.149509] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:34:47.593585] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-29T18:34:47.846395] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T18:34:48.249055] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-29T18:34:48.393587] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-29T18:34:48.953622] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-29T18:34:49.193569] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-29T18:34:49.993604] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-29T18:34:50.770965] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T18:34:50.783456] [INFO ] [REMOTE ] EOG: Full fetch complete (77080 records). [2025-10-29T18:34:50.783621] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-29T18:34:50.784475] [FATAL] [VALIDATOR ] EOG: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:34:50.784569] [FATAL] [MAIN ] EOG: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:34:50.784612] [WARN ] [MAIN ] EOG: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:34:50.784679] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-29T18:34:50.784755] [DEBUG] [LOCAL ] EOG: No primary data file found to delete. [2025-10-29T18:34:50.784792] [INFO ] [LOCAL ] EOG: Starting deletion of derivative data. [2025-10-29T18:34:50.784971] [DEBUG] [LOCAL ] EOG: Deleted derivative data file. [2025-10-29T18:34:50.785062] [INFO ] [MAIN ] Update Progress: 747/2367 symbols completed. EOG took 41.0s. Estimated remaining: 3h 25m 36s. Rate: 7.9 symbols/min [2025-10-29T18:34:50.798611] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-29T18:34:50.962690] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:34:51.000447] [DEBUG] [LOCAL ] EPAM: Loaded 38976 existing records from primary storage. [2025-10-29T18:34:51.000754] [INFO ] [MAIN ] EPAM: Loaded 38976 existing records. [2025-10-29T18:34:51.182815] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:34:51.183038] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-29T18:34:51.183085] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-29T18:34:51.183344] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-29T18:34:51.183384] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-29T18:34:51.478711] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T18:34:51.557305] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:34:51.593515] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-29T18:34:51.696269] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T18:34:52.393567] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-29T18:34:52.857368] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-29T18:34:53.193557] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-29T18:34:53.955485] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T18:34:53.959347] [INFO ] [REMOTE ] EOS: Full fetch complete (22655 records). [2025-10-29T18:34:53.959476] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-29T18:34:53.959989] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:34:53.960073] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:34:53.960115] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:34:53.960178] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-29T18:34:53.960242] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-29T18:34:53.960279] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-10-29T18:34:53.960431] [DEBUG] [LOCAL ] EOS: Deleted derivative data file. [2025-10-29T18:34:53.960502] [INFO ] [MAIN ] Update Progress: 748/2367 symbols completed. EOS took 32.7s. Estimated remaining: 3h 25m 19s. Rate: 7.9 symbols/min [2025-10-29T18:34:54.003959] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-29T18:34:54.142345] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-29T18:34:54.167606] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:34:54.203305] [DEBUG] [LOCAL ] EPC: Loaded 39562 existing records from primary storage. [2025-10-29T18:34:54.203585] [INFO ] [MAIN ] EPC: Loaded 39562 existing records. [2025-10-29T18:34:54.380380] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:34:54.380639] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-29T18:34:54.380817] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-29T18:34:54.381049] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-29T18:34:54.381113] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-29T18:34:54.760443] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:34:54.793583] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-29T18:34:54.868074] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-29T18:34:54.871151] [INFO ] [REMOTE ] EOT: Full fetch complete (10713 records). [2025-10-29T18:34:54.871251] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-29T18:34:55.252882] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-29T18:34:55.252980] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-29T18:34:55.253271] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-29T18:34:55.253316] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-29T18:34:55.253905] [DEBUG] [LOCAL ] EOT: Trimmed 10713 records to 6957 (keeping 200 days of data) [2025-10-29T18:34:55.294982] [DEBUG] [LOCAL ] EOT: Primary data saved (6957 records). [2025-10-29T18:34:55.295087] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-29T18:34:55.295161] [INFO ] [MAIN ] Update Progress: 749/2367 symbols completed. EOT took 33.7s. Estimated remaining: 3h 24m 58s. Rate: 7.9 symbols/min [2025-10-29T18:34:55.472874] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:34:55.522798] [DEBUG] [LOCAL ] EPD: Loaded 53606 existing records from primary storage. [2025-10-29T18:34:55.523130] [INFO ] [MAIN ] EPD: Loaded 53606 existing records. [2025-10-29T18:34:55.598801] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-29T18:34:55.718199] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:34:55.718483] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-29T18:34:55.718530] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-29T18:34:55.719103] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-29T18:34:55.719160] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-29T18:34:56.100255] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T18:34:56.098708] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:34:56.393559] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-29T18:34:56.932502] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T18:34:57.193561] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-29T18:34:57.421772] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T18:34:57.993574] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-29T18:34:58.782602] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-29T18:34:58.793505] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-29T18:34:58.950158] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-29T18:34:59.593550] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-29T18:35:00.079568] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T18:35:00.163715] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-29T18:35:00.393571] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-29T18:35:01.193595] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-29T18:35:01.603381] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T18:35:01.993577] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-29T18:35:02.562861] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T18:35:02.793599] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-29T18:35:03.579312] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-29T18:35:03.593572] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-29T18:35:04.029792] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T18:35:04.393545] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-29T18:35:04.443128] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T18:35:05.193627] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-29T18:35:05.384073] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T18:35:05.993578] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-29T18:35:06.330267] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T18:35:06.793618] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-29T18:35:07.593774] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-29T18:35:07.597371] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-29T18:35:07.684488] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T18:35:08.393570] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-29T18:35:09.193597] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-29T18:35:09.516532] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T18:35:09.993585] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-29T18:35:10.141413] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-29T18:35:10.734778] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T18:35:10.781903] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-29T18:35:10.793534] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-29T18:35:11.593531] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-29T18:35:11.688125] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T18:35:12.393577] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-29T18:35:12.996591] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T18:35:13.193548] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-29T18:35:13.554448] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T18:35:13.993571] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-29T18:35:14.673695] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-29T18:35:14.793522] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-29T18:35:14.930293] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T18:35:14.936271] [INFO ] [REMOTE ] EPAC: Full fetch complete (38751 records). [2025-10-29T18:35:14.936376] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-29T18:35:15.320733] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-29T18:35:15.320818] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-29T18:35:15.321410] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-29T18:35:15.321449] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-29T18:35:15.322324] [DEBUG] [LOCAL ] EPAC: Trimmed 38751 records to 26036 (keeping 200 days of data) [2025-10-29T18:35:15.477340] [DEBUG] [LOCAL ] EPAC: Primary data saved (26036 records). [2025-10-29T18:35:15.477462] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-29T18:35:15.477536] [INFO ] [MAIN ] Update Progress: 750/2367 symbols completed. EPAC took 34.0s. Estimated remaining: 3h 25m 17s. Rate: 7.9 symbols/min [2025-10-29T18:35:15.598629] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-29T18:35:15.672164] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:35:15.711159] [DEBUG] [LOCAL ] EPR: Loaded 43440 existing records from primary storage. [2025-10-29T18:35:15.711506] [INFO ] [MAIN ] EPR: Loaded 43440 existing records. [2025-10-29T18:35:15.890819] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:35:15.891046] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-29T18:35:15.891092] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-29T18:35:15.891324] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-29T18:35:15.891380] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-29T18:35:16.277131] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:35:16.309852] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-29T18:35:16.393553] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-29T18:35:16.812424] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T18:35:17.193620] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-29T18:35:17.873545] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T18:35:17.993593] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-29T18:35:18.793542] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-29T18:35:18.948548] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-29T18:35:19.092219] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T18:35:19.593624] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-29T18:35:19.820288] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T18:35:20.393703] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-29T18:35:20.758207] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T18:35:21.193585] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-29T18:35:21.369708] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T18:35:21.993600] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-29T18:35:22.793558] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-29T18:35:23.109594] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-29T18:35:23.275277] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-29T18:35:23.593586] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-29T18:35:24.393544] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-29T18:35:24.456014] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T18:35:24.467573] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-10-29T18:35:24.467766] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-29T18:35:24.909745] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-29T18:35:24.909928] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-29T18:35:24.910918] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-29T18:35:24.910999] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-29T18:35:24.935910] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 53606 (keeping 200 days of data) [2025-10-29T18:35:24.936786] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T18:35:25.196289] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-29T18:35:25.276450] [DEBUG] [LOCAL ] EPD: Primary data saved (53606 records). [2025-10-29T18:35:25.276570] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-29T18:35:25.276664] [INFO ] [MAIN ] Update Progress: 751/2367 symbols completed. EPD took 30.0s. Estimated remaining: 3h 25m 14s. Rate: 7.9 symbols/min [2025-10-29T18:35:25.444449] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:35:25.485942] [DEBUG] [LOCAL ] EPRT: Loaded 48419 existing records from primary storage. [2025-10-29T18:35:25.486240] [INFO ] [MAIN ] EPRT: Loaded 48419 existing records. [2025-10-29T18:35:25.674241] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:35:25.674577] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-29T18:35:25.674709] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-29T18:35:25.675130] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-29T18:35:25.675203] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-29T18:35:25.998666] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-29T18:35:26.072580] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:35:26.095615] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-29T18:35:26.523727] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T18:35:26.532728] [INFO ] [REMOTE ] EPAM: Full fetch complete (56530 records). [2025-10-29T18:35:26.532860] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-29T18:35:26.533587] [FATAL] [VALIDATOR ] EPAM: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:35:26.533703] [FATAL] [MAIN ] EPAM: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:35:26.533768] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:35:26.533841] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-29T18:35:26.533918] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-29T18:35:26.533996] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-10-29T18:35:26.534252] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-10-29T18:35:26.534365] [INFO ] [MAIN ] Update Progress: 752/2367 symbols completed. EPAM took 35.7s. Estimated remaining: 3h 24m 53s. Rate: 7.9 symbols/min [2025-10-29T18:35:26.710668] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:35:26.710873] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-29T18:35:26.710914] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-29T18:35:26.711021] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-29T18:35:26.711061] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-29T18:35:26.711099] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-29T18:35:26.711130] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-29T18:35:26.799721] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-29T18:35:27.074728] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:35:27.140560] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T18:35:27.593531] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-29T18:35:27.927967] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T18:35:28.393584] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-29T18:35:28.646277] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T18:35:29.193579] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-29T18:35:29.648157] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T18:35:29.656203] [INFO ] [REMOTE ] EPC: Full fetch complete (57394 records). [2025-10-29T18:35:29.656331] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-29T18:35:30.001071] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-29T18:35:30.035310] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T18:35:30.058675] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-29T18:35:30.058776] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-29T18:35:30.059546] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-29T18:35:30.059589] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-29T18:35:30.060769] [DEBUG] [LOCAL ] EPC: Trimmed 57394 records to 39579 (keeping 200 days of data) [2025-10-29T18:35:30.293458] [DEBUG] [LOCAL ] EPC: Primary data saved (39579 records). [2025-10-29T18:35:30.293589] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-29T18:35:30.293689] [INFO ] [MAIN ] Update Progress: 753/2367 symbols completed. EPC took 36.3s. Estimated remaining: 3h 24m 37s. Rate: 7.9 symbols/min [2025-10-29T18:35:30.464160] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:35:30.512090] [DEBUG] [LOCAL ] EQH: Loaded 52655 existing records from primary storage. [2025-10-29T18:35:30.512393] [INFO ] [MAIN ] EQH: Loaded 52655 existing records. [2025-10-29T18:35:30.698088] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:35:30.698284] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-29T18:35:30.698330] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-29T18:35:30.698514] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-29T18:35:30.698551] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-29T18:35:30.800208] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-29T18:35:31.084289] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:35:31.593608] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-29T18:35:31.966943] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T18:35:32.393631] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-29T18:35:32.547602] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-29T18:35:32.887455] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T18:35:32.904619] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T18:35:33.193579] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-29T18:35:33.656602] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T18:35:33.993567] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-29T18:35:34.793581] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-29T18:35:35.360687] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T18:35:35.384427] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-29T18:35:35.593577] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-29T18:35:36.393555] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-29T18:35:36.754466] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T18:35:36.898049] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T18:35:37.193570] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-29T18:35:37.599110] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-29T18:35:37.993576] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-29T18:35:38.793558] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-29T18:35:39.426858] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-29T18:35:39.593551] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-29T18:35:40.030543] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T18:35:40.393605] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-29T18:35:40.663594] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-29T18:35:41.193554] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-29T18:35:41.588679] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T18:35:41.993578] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-29T18:35:42.482973] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T18:35:42.494181] [INFO ] [REMOTE ] EPR: Full fetch complete (63304 records). [2025-10-29T18:35:42.494399] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-29T18:35:42.802629] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-29T18:35:42.936743] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-29T18:35:42.936835] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-29T18:35:42.937936] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-29T18:35:42.938002] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-29T18:35:42.939327] [DEBUG] [LOCAL ] EPR: Trimmed 63304 records to 43429 (keeping 200 days of data) [2025-10-29T18:35:43.199153] [DEBUG] [LOCAL ] EPR: Primary data saved (43429 records). [2025-10-29T18:35:43.199270] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-29T18:35:43.199344] [INFO ] [MAIN ] Update Progress: 754/2367 symbols completed. EPR took 27.7s. Estimated remaining: 3h 24m 41s. Rate: 7.9 symbols/min [2025-10-29T18:35:43.367510] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:35:43.422124] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T18:35:43.450034] [DEBUG] [LOCAL ] EQNR: Loaded 53041 existing records from primary storage. [2025-10-29T18:35:43.450357] [INFO ] [MAIN ] EQNR: Loaded 53041 existing records. [2025-10-29T18:35:43.598883] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-29T18:35:43.630635] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:35:43.630923] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-29T18:35:43.630993] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-29T18:35:43.639716] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T18:35:43.639753] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-29T18:35:43.640968] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-29T18:35:44.005550] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:35:44.393561] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-29T18:35:45.193566] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-29T18:35:45.697782] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T18:35:45.993531] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-29T18:35:46.649433] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T18:35:46.793534] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-29T18:35:46.854711] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-29T18:35:47.381783] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-29T18:35:47.501394] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (3.90 seconds). [2025-10-29T18:35:47.593556] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-29T18:35:48.393565] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-29T18:35:49.037089] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T18:35:49.095021] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-29T18:35:49.098265] [INFO ] [REMOTE ] EQBK: Full fetch complete (15717 records). [2025-10-29T18:35:49.098346] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-29T18:35:49.198741] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-29T18:35:49.474096] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-29T18:35:49.474174] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-29T18:35:49.474540] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-29T18:35:49.474582] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-29T18:35:49.475136] [DEBUG] [LOCAL ] EQBK: Trimmed 15717 records to 11085 (keeping 200 days of data) [2025-10-29T18:35:49.543158] [DEBUG] [LOCAL ] EQBK: Primary data saved (11085 records). [2025-10-29T18:35:49.543305] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-29T18:35:49.543381] [INFO ] [MAIN ] Update Progress: 755/2367 symbols completed. EQBK took 23.0s. Estimated remaining: 3h 24m 31s. Rate: 7.9 symbols/min [2025-10-29T18:35:49.710444] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:35:49.710634] [DEBUG] [LOCAL ] EQR: No existing data file found in primary storage. [2025-10-29T18:35:49.710707] [WARN ] [MAIN ] EQR: No existing data found, performing full refresh instead. [2025-10-29T18:35:49.710821] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-29T18:35:49.710863] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-29T18:35:49.710902] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-10-29T18:35:49.710934] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-29T18:35:49.998776] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-29T18:35:50.063344] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:35:50.466334] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-29T18:35:50.793562] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-29T18:35:51.460974] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-29T18:35:51.593547] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-29T18:35:52.024079] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T18:35:52.393566] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-29T18:35:53.055422] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-29T18:35:53.193528] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-29T18:35:53.692707] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:35:53.993585] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-29T18:35:54.655499] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T18:35:54.793536] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-29T18:35:55.175533] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T18:35:55.593595] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-29T18:35:56.134842] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T18:35:56.393558] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-29T18:35:56.701076] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T18:35:57.193595] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-29T18:35:57.572596] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T18:35:57.993622] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-29T18:35:58.422568] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T18:35:58.793582] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-29T18:35:59.479816] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T18:35:59.593595] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-29T18:35:59.955244] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T18:36:00.393558] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-29T18:36:01.038580] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T18:36:01.193571] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-29T18:36:01.993582] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-29T18:36:02.501403] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-29T18:36:02.680500] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T18:36:02.691320] [INFO ] [REMOTE ] EPRT: Full fetch complete (69736 records). [2025-10-29T18:36:02.691450] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-29T18:36:02.798691] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-29T18:36:03.094876] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-29T18:36:03.095031] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-29T18:36:03.095971] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-29T18:36:03.096039] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-29T18:36:03.097365] [DEBUG] [LOCAL ] EPRT: Trimmed 69736 records to 48379 (keeping 200 days of data) [2025-10-29T18:36:03.343857] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T18:36:03.429114] [DEBUG] [LOCAL ] EPRT: Primary data saved (48379 records). [2025-10-29T18:36:03.429235] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-29T18:36:03.430022] [INFO ] [MAIN ] Update Progress: 756/2367 symbols completed. EPRT took 38.2s. Estimated remaining: 3h 24m 36s. Rate: 7.9 symbols/min [2025-10-29T18:36:03.598774] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-29T18:36:03.601339] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:03.602026] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-29T18:36:03.602075] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-29T18:36:03.602177] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-29T18:36:03.602218] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-29T18:36:03.602304] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-29T18:36:03.602343] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-29T18:36:03.977670] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:04.054854] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T18:36:04.393558] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-29T18:36:04.971618] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-29T18:36:05.193539] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-29T18:36:05.764023] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T18:36:05.993559] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-29T18:36:06.793539] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-29T18:36:07.323689] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T18:36:07.593535] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-29T18:36:07.813766] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (3.42 seconds). [2025-10-29T18:36:07.824889] [INFO ] [REMOTE ] EQH: Full fetch complete (76588 records). [2025-10-29T18:36:07.825044] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-29T18:36:08.237965] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-29T18:36:08.238067] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-29T18:36:08.239128] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-29T18:36:08.239226] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-29T18:36:08.240966] [DEBUG] [LOCAL ] EQH: Trimmed 76588 records to 52645 (keeping 200 days of data) [2025-10-29T18:36:08.364719] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-29T18:36:08.397718] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-29T18:36:08.594471] [DEBUG] [LOCAL ] EQH: Primary data saved (52645 records). [2025-10-29T18:36:08.594601] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-29T18:36:08.594696] [INFO ] [MAIN ] Update Progress: 757/2367 symbols completed. EQH took 38.3s. Estimated remaining: 3h 24m 24s. Rate: 7.9 symbols/min [2025-10-29T18:36:08.916869] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-29T18:36:09.193564] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-29T18:36:09.993560] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-29T18:36:10.239787] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-29T18:36:10.245972] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-29T18:36:10.257393] [INFO ] [REMOTE ] EQNR: Full fetch complete (77014 records). [2025-10-29T18:36:10.257543] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-29T18:36:10.683148] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-29T18:36:10.683289] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-29T18:36:10.684299] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-29T18:36:10.684440] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-29T18:36:10.685987] [DEBUG] [LOCAL ] EQNR: Trimmed 77014 records to 53037 (keeping 200 days of data) [2025-10-29T18:36:10.793757] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-29T18:36:11.004955] [DEBUG] [LOCAL ] EQNR: Primary data saved (53037 records). [2025-10-29T18:36:11.005093] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-29T18:36:11.005172] [INFO ] [MAIN ] Update Progress: 758/2367 symbols completed. EQNR took 27.8s. Estimated remaining: 3h 24m 5s. Rate: 7.9 symbols/min [2025-10-29T18:36:11.137380] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-29T18:36:11.151934] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-29T18:36:11.593586] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-29T18:36:11.825787] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-29T18:36:12.393568] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-29T18:36:13.193557] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-29T18:36:13.549146] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-29T18:36:13.835788] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:36:13.993566] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-29T18:36:14.793599] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-29T18:36:15.053882] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-29T18:36:15.239175] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-29T18:36:15.593554] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-29T18:36:16.063746] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T18:36:16.393559] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-29T18:36:16.782385] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T18:36:17.193579] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-29T18:36:17.580553] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T18:36:17.993561] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-29T18:36:18.793613] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-29T18:36:19.153427] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:36:19.228370] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T18:36:19.229324] [INFO ] [REMOTE ] EQS: Full fetch complete (2347 records). [2025-10-29T18:36:19.229395] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-29T18:36:19.417733] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-29T18:36:19.417921] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:36:19.417970] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:36:19.418011] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-29T18:36:19.418066] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-29T18:36:19.418101] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-29T18:36:19.418142] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-29T18:36:19.418197] [INFO ] [MAIN ] Update Progress: 759/2367 symbols completed. EQS took 16.0s. Estimated remaining: 3h 23m 59s. Rate: 7.9 symbols/min [2025-10-29T18:36:19.593611] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-29T18:36:21.095149] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T18:36:21.106170] [INFO ] [REMOTE ] EQR: Full fetch complete (74653 records). [2025-10-29T18:36:21.106296] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-29T18:36:21.504681] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-29T18:36:21.504790] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-29T18:36:21.505745] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-29T18:36:21.505809] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-29T18:36:21.507298] [DEBUG] [LOCAL ] EQR: Trimmed 74653 records to 51795 (keeping 200 days of data) [2025-10-29T18:36:21.822661] [DEBUG] [LOCAL ] EQR: Primary data saved (51795 records). [2025-10-29T18:36:21.822819] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-29T18:36:21.822891] [INFO ] [MAIN ] Update Progress: 760/2367 symbols completed. EQR took 32.3s. Estimated remaining: 3h 23m 40s. Rate: 7.9 symbols/min [2025-10-29T18:36:22.442870] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:22.465408] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:22.547040] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:22.545102] [DEBUG] [LOCAL ] EQT: No existing data file found in primary storage. [2025-10-29T18:36:22.553852] [WARN ] [MAIN ] EQT: No existing data found, performing full refresh instead. [2025-10-29T18:36:22.582293] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:22.582471] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-29T18:36:22.585845] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-29T18:36:22.586142] [DEBUG] [LOCAL ] EQT: No primary data file found to delete. [2025-10-29T18:36:22.585735] [DEBUG] [LOCAL ] EQV: Loaded 2819 existing records from primary storage. [2025-10-29T18:36:22.586256] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-29T18:36:22.597614] [INFO ] [MAIN ] EQV: Loaded 2819 existing records. [2025-10-29T18:36:23.085575] [DEBUG] [LOCAL ] ERJ: Loaded 50209 existing records from primary storage. [2025-10-29T18:36:23.051203] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:36:23.107349] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-29T18:36:23.091501] [DEBUG] [LOCAL ] ERO: Loaded 41989 existing records from primary storage. [2025-10-29T18:36:23.119157] [INFO ] [MAIN ] ERJ: Loaded 50209 existing records. [2025-10-29T18:36:23.120014] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-29T18:36:23.119561] [INFO ] [MAIN ] ERO: Loaded 41989 existing records. [2025-10-29T18:36:23.161147] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-29T18:36:23.201558] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-29T18:36:23.388699] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:23.481935] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-29T18:36:23.763137] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:36:23.818291] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:36:23.842631] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-29T18:36:23.818442] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-29T18:36:23.866800] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-29T18:36:23.866967] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-29T18:36:23.887547] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-29T18:36:23.898084] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-29T18:36:23.916572] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-29T18:36:23.932607] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-29T18:36:24.186281] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:24.208255] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-29T18:36:24.780240] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:24.774802] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:24.780574] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-29T18:36:24.781020] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-29T18:36:24.971428] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T18:36:24.973945] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-29T18:36:25.204638] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-29T18:36:25.215483] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-29T18:36:25.348169] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T18:36:25.349817] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-29T18:36:25.682364] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-29T18:36:25.993580] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-29T18:36:26.129968] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T18:36:26.284824] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-29T18:36:26.334199] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T18:36:26.699443] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-29T18:36:26.793588] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-29T18:36:27.593561] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-29T18:36:28.306733] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-29T18:36:28.393603] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-29T18:36:28.754522] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T18:36:29.193589] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-29T18:36:29.940102] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T18:36:29.993529] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-29T18:36:30.183387] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T18:36:30.793562] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-29T18:36:31.139132] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-29T18:36:31.472087] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-29T18:36:31.593524] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-29T18:36:32.393567] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-29T18:36:32.751847] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-29T18:36:32.991016] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T18:36:33.193569] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-29T18:36:33.993556] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-29T18:36:34.793561] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-29T18:36:35.069531] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T18:36:35.154713] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-29T18:36:35.593630] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-29T18:36:36.349820] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-29T18:36:36.393573] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-29T18:36:37.034501] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T18:36:37.193550] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-29T18:36:37.760369] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T18:36:37.993565] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-29T18:36:38.609155] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-29T18:36:38.660209] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T18:36:38.793564] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-29T18:36:39.593599] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-29T18:36:39.924311] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-29T18:36:40.280798] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T18:36:40.393555] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-29T18:36:41.193574] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-29T18:36:41.526541] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T18:36:41.993528] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-29T18:36:42.194008] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-29T18:36:42.206353] [INFO ] [REMOTE ] EQT: Full fetch complete (77859 records). [2025-10-29T18:36:42.206553] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-29T18:36:42.597939] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-29T18:36:42.598036] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-29T18:36:42.600285] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-29T18:36:42.600349] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-29T18:36:42.601758] [DEBUG] [LOCAL ] EQT: Trimmed 77859 records to 53684 (keeping 200 days of data) [2025-10-29T18:36:42.805455] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-29T18:36:42.922601] [DEBUG] [LOCAL ] EQT: Primary data saved (53684 records). [2025-10-29T18:36:42.922796] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-29T18:36:42.922882] [INFO ] [MAIN ] Update Progress: 761/2367 symbols completed. EQT took 21.1s. Estimated remaining: 3h 24m 1s. Rate: 7.9 symbols/min [2025-10-29T18:36:43.093073] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:43.140874] [DEBUG] [LOCAL ] ES: Loaded 52680 existing records from primary storage. [2025-10-29T18:36:43.141240] [INFO ] [MAIN ] ES: Loaded 52680 existing records. [2025-10-29T18:36:43.338834] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:36:43.339183] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-29T18:36:43.339321] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-29T18:36:43.339792] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-29T18:36:43.339914] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-29T18:36:43.510571] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-29T18:36:43.604977] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-29T18:36:43.760871] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:43.787888] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T18:36:44.393580] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-29T18:36:44.846515] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:36:45.193634] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-29T18:36:45.722044] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T18:36:45.993590] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-29T18:36:46.624014] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-29T18:36:46.793550] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-29T18:36:47.056022] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T18:36:47.593560] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-29T18:36:48.074550] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T18:36:48.393563] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-29T18:36:49.193619] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-29T18:36:49.620088] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T18:36:49.791194] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T18:36:49.792482] [INFO ] [REMOTE ] EQV: Full fetch complete (4827 records). [2025-10-29T18:36:49.792548] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-29T18:36:49.998730] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-29T18:36:50.147945] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-29T18:36:50.148118] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-29T18:36:50.148277] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-29T18:36:50.164140] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-29T18:36:50.177638] [DEBUG] [LOCAL ] EQV: Trimmed 4827 records to 2868 (keeping 200 days of data) [2025-10-29T18:36:50.180217] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-29T18:36:50.210959] [DEBUG] [LOCAL ] EQV: Primary data saved (2868 records). [2025-10-29T18:36:50.211091] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-29T18:36:50.211168] [INFO ] [MAIN ] Update Progress: 762/2367 symbols completed. EQV took 28.4s. Estimated remaining: 3h 23m 53s. Rate: 7.9 symbols/min [2025-10-29T18:36:50.376315] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:50.403030] [DEBUG] [LOCAL ] ESAB: Loaded 25690 existing records from primary storage. [2025-10-29T18:36:50.403275] [INFO ] [MAIN ] ESAB: Loaded 25690 existing records. [2025-10-29T18:36:50.576062] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:36:50.576289] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-29T18:36:50.576338] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-29T18:36:50.576510] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-29T18:36:50.576550] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-29T18:36:50.798711] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-29T18:36:50.937486] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:51.338400] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T18:36:51.593550] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-29T18:36:51.714811] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T18:36:52.393557] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-29T18:36:52.873478] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T18:36:53.193560] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-29T18:36:53.998680] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-29T18:36:54.020800] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-29T18:36:54.032135] [INFO ] [REMOTE ] ERJ: Full fetch complete (73235 records). [2025-10-29T18:36:54.032301] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-29T18:36:54.429780] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-29T18:36:54.429916] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-29T18:36:54.431106] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-29T18:36:54.431220] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-29T18:36:54.433014] [DEBUG] [LOCAL ] ERJ: Trimmed 73235 records to 50193 (keeping 200 days of data) [2025-10-29T18:36:54.667105] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-29T18:36:54.765360] [DEBUG] [LOCAL ] ERJ: Primary data saved (50193 records). [2025-10-29T18:36:54.765487] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-29T18:36:54.765565] [INFO ] [MAIN ] Update Progress: 763/2367 symbols completed. ERJ took 32.9s. Estimated remaining: 3h 23m 39s. Rate: 7.9 symbols/min [2025-10-29T18:36:54.807436] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-29T18:36:54.942994] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:54.959238] [DEBUG] [LOCAL ] ESE: Loaded 16155 existing records from primary storage. [2025-10-29T18:36:54.959459] [INFO ] [MAIN ] ESE: Loaded 16155 existing records. [2025-10-29T18:36:55.137882] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:36:55.138114] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-29T18:36:55.138176] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-29T18:36:55.138403] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-29T18:36:55.138475] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-29T18:36:55.522053] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:55.550846] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T18:36:55.593526] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-29T18:36:56.393536] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-29T18:36:57.193528] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-29T18:36:57.237371] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T18:36:57.846333] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (3.04 seconds). [2025-10-29T18:36:57.856532] [INFO ] [REMOTE ] ERO: Full fetch complete (60742 records). [2025-10-29T18:36:57.856671] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-29T18:36:57.998764] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-29T18:36:58.272050] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-29T18:36:58.272160] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-29T18:36:58.272952] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-29T18:36:58.273015] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-29T18:36:58.274230] [DEBUG] [LOCAL ] ERO: Trimmed 60742 records to 41983 (keeping 200 days of data) [2025-10-29T18:36:58.342559] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-29T18:36:58.527748] [DEBUG] [LOCAL ] ERO: Primary data saved (41983 records). [2025-10-29T18:36:58.527874] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-29T18:36:58.527950] [INFO ] [MAIN ] Update Progress: 764/2367 symbols completed. ERO took 36.7s. Estimated remaining: 3h 23m 23s. Rate: 7.9 symbols/min [2025-10-29T18:36:58.700810] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:36:58.747028] [DEBUG] [LOCAL ] ESI: Loaded 50572 existing records from primary storage. [2025-10-29T18:36:58.747325] [INFO ] [MAIN ] ESI: Loaded 50572 existing records. [2025-10-29T18:36:58.801570] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-29T18:36:58.929555] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:36:58.929924] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-29T18:36:58.929980] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-29T18:36:58.930476] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-29T18:36:58.930534] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-29T18:36:59.189606] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:36:59.293256] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:36:59.525599] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T18:36:59.593524] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-29T18:37:00.393513] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-29T18:37:01.193603] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-29T18:37:01.922675] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (4.73 seconds). [2025-10-29T18:37:01.993519] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-29T18:37:02.110580] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-29T18:37:02.168010] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T18:37:02.793571] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-29T18:37:03.327136] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T18:37:03.593561] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-29T18:37:03.783552] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T18:37:04.016995] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (3.62 seconds). [2025-10-29T18:37:04.393552] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-29T18:37:04.975725] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T18:37:05.110677] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T18:37:05.193549] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-29T18:37:05.954053] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T18:37:05.993522] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-29T18:37:06.681882] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T18:37:06.793581] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-29T18:37:07.593610] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-29T18:37:08.393602] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-29T18:37:09.193595] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-29T18:37:09.666906] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T18:37:09.993588] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-29T18:37:10.117926] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (3.32 seconds). [2025-10-29T18:37:10.640874] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T18:37:10.669660] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T18:37:10.793616] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-29T18:37:10.865606] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-10-29T18:37:11.593552] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-29T18:37:12.120104] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T18:37:12.371461] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T18:37:12.393521] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-29T18:37:13.193572] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-29T18:37:13.572960] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T18:37:13.993624] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-29T18:37:14.616096] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-29T18:37:14.626919] [INFO ] [REMOTE ] ES: Full fetch complete (76087 records). [2025-10-29T18:37:14.627030] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-29T18:37:14.627638] [FATAL] [VALIDATOR ] ES: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:37:14.627769] [FATAL] [MAIN ] ES: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:37:14.627813] [WARN ] [MAIN ] ES: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:37:14.627852] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-29T18:37:14.627938] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-10-29T18:37:14.627997] [INFO ] [LOCAL ] ES: Starting deletion of derivative data. [2025-10-29T18:37:14.628211] [DEBUG] [LOCAL ] ES: Deleted derivative data file. [2025-10-29T18:37:14.628326] [INFO ] [MAIN ] Update Progress: 765/2367 symbols completed. ES took 31.7s. Estimated remaining: 3h 23m 33s. Rate: 7.9 symbols/min [2025-10-29T18:37:14.795713] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-29T18:37:14.798922] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:37:14.799965] [DEBUG] [LOCAL ] ESNT: No existing data file found in primary storage. [2025-10-29T18:37:14.800076] [WARN ] [MAIN ] ESNT: No existing data found, performing full refresh instead. [2025-10-29T18:37:14.800256] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-29T18:37:14.800427] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-29T18:37:14.811227] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-10-29T18:37:14.811475] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-29T18:37:14.823778] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T18:37:15.167797] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:37:15.593554] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-29T18:37:15.833352] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T18:37:16.393585] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-29T18:37:16.503989] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T18:37:16.507256] [INFO ] [REMOTE ] ESE: Full fetch complete (22965 records). [2025-10-29T18:37:16.507330] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-29T18:37:16.872845] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-29T18:37:16.872920] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-29T18:37:16.873367] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-29T18:37:16.873426] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-29T18:37:16.874037] [DEBUG] [LOCAL ] ESE: Trimmed 22965 records to 16064 (keeping 200 days of data) [2025-10-29T18:37:16.974149] [DEBUG] [LOCAL ] ESE: Primary data saved (16064 records). [2025-10-29T18:37:16.974299] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-29T18:37:16.974379] [INFO ] [MAIN ] Update Progress: 766/2367 symbols completed. ESE took 22.2s. Estimated remaining: 3h 23m 15s. Rate: 7.9 symbols/min [2025-10-29T18:37:17.153140] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:37:17.199208] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-29T18:37:17.202472] [DEBUG] [LOCAL ] ESRT: Loaded 46380 existing records from primary storage. [2025-10-29T18:37:17.202873] [INFO ] [MAIN ] ESRT: Loaded 46380 existing records. [2025-10-29T18:37:17.385430] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:37:17.385766] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-29T18:37:17.385841] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-29T18:37:17.386343] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-29T18:37:17.386425] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-29T18:37:17.748337] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:37:17.993558] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-29T18:37:18.140912] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-29T18:37:18.793609] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-29T18:37:19.249593] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T18:37:19.361430] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-10-29T18:37:19.593562] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-29T18:37:20.263628] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T18:37:20.393542] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-29T18:37:20.593922] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-29T18:37:21.193584] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-29T18:37:21.352108] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T18:37:21.993573] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-29T18:37:22.175592] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T18:37:22.793568] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-29T18:37:23.196737] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T18:37:23.593550] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-29T18:37:23.929527] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T18:37:24.393613] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-29T18:37:24.673795] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-29T18:37:25.193565] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-29T18:37:25.610956] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T18:37:25.617189] [INFO ] [REMOTE ] ESAB: Full fetch complete (36705 records). [2025-10-29T18:37:25.617327] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-29T18:37:25.996119] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-29T18:37:25.996341] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-29T18:37:25.997223] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-29T18:37:25.997881] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-29T18:37:25.997943] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-29T18:37:25.998924] [DEBUG] [LOCAL ] ESAB: Trimmed 36705 records to 25781 (keeping 200 days of data) [2025-10-29T18:37:26.156903] [DEBUG] [LOCAL ] ESAB: Primary data saved (25781 records). [2025-10-29T18:37:26.157022] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-29T18:37:26.157099] [INFO ] [MAIN ] Update Progress: 767/2367 symbols completed. ESAB took 35.9s. Estimated remaining: 3h 23m 10s. Rate: 7.9 symbols/min [2025-10-29T18:37:26.340143] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:37:26.371993] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T18:37:26.412262] [DEBUG] [LOCAL ] ESS: Loaded 29980 existing records from primary storage. [2025-10-29T18:37:26.412628] [INFO ] [MAIN ] ESS: Loaded 29980 existing records. [2025-10-29T18:37:26.589816] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:37:26.590093] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-29T18:37:26.590141] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-29T18:37:26.590566] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-29T18:37:26.590624] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-29T18:37:26.798840] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-29T18:37:26.940742] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:37:27.434296] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T18:37:27.593624] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-29T18:37:28.010799] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T18:37:28.393616] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-29T18:37:28.557255] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T18:37:29.193618] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-29T18:37:29.993593] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-29T18:37:30.793696] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-29T18:37:31.018760] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-29T18:37:31.124302] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:37:31.388510] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-10-29T18:37:31.593548] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-29T18:37:32.078449] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-29T18:37:32.393534] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-29T18:37:32.440682] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T18:37:33.193571] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-29T18:37:33.549559] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-29T18:37:33.993568] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-29T18:37:34.308230] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T18:37:34.793744] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-29T18:37:35.103282] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T18:37:35.593572] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-29T18:37:35.807416] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-29T18:37:36.393570] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-29T18:37:36.763141] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T18:37:37.193638] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-29T18:37:37.364871] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T18:37:37.993605] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-29T18:37:38.481677] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T18:37:38.793601] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-29T18:37:38.816237] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T18:37:39.593567] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-29T18:37:39.849979] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T18:37:39.861245] [INFO ] [REMOTE ] ESNT: Full fetch complete (56791 records). [2025-10-29T18:37:39.861415] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-29T18:37:40.256173] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-29T18:37:40.256247] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-29T18:37:40.256979] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-29T18:37:40.257039] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-29T18:37:40.258086] [DEBUG] [LOCAL ] ESNT: Trimmed 56791 records to 37477 (keeping 200 days of data) [2025-10-29T18:37:40.421075] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-29T18:37:40.487380] [DEBUG] [LOCAL ] ESNT: Primary data saved (37477 records). [2025-10-29T18:37:40.487534] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-29T18:37:40.487712] [INFO ] [MAIN ] Update Progress: 768/2367 symbols completed. ESNT took 25.9s. Estimated remaining: 3h 23m 17s. Rate: 7.9 symbols/min [2025-10-29T18:37:40.714353] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T18:37:40.711995] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:37:40.773745] [DEBUG] [LOCAL ] ESTC: Loaded 50182 existing records from primary storage. [2025-10-29T18:37:40.774128] [INFO ] [MAIN ] ESTC: Loaded 50182 existing records. [2025-10-29T18:37:40.968011] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:37:40.968235] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-29T18:37:40.968289] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-29T18:37:40.968900] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-29T18:37:40.968958] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-29T18:37:41.202631] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-29T18:37:41.322773] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:37:41.596025] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T18:37:41.993580] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-29T18:37:42.793551] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-29T18:37:42.949951] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-29T18:37:43.517808] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-29T18:37:43.593526] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-29T18:37:44.251526] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T18:37:44.261404] [INFO ] [REMOTE ] ESRT: Full fetch complete (66775 records). [2025-10-29T18:37:44.261520] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-29T18:37:44.398737] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-29T18:37:44.644210] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-29T18:37:44.644289] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-29T18:37:44.645165] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-29T18:37:44.645227] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-29T18:37:44.646534] [DEBUG] [LOCAL ] ESRT: Trimmed 66775 records to 46361 (keeping 200 days of data) [2025-10-29T18:37:44.908627] [DEBUG] [LOCAL ] ESRT: Primary data saved (46361 records). [2025-10-29T18:37:44.908803] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-29T18:37:44.909736] [INFO ] [MAIN ] Update Progress: 769/2367 symbols completed. ESRT took 27.9s. Estimated remaining: 3h 23m 2s. Rate: 7.9 symbols/min [2025-10-29T18:37:45.081792] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:37:45.134694] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-29T18:37:45.135008] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-29T18:37:45.198955] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-29T18:37:45.314757] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:37:45.315021] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-29T18:37:45.315120] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-29T18:37:45.315833] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-29T18:37:45.315892] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-29T18:37:45.674420] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:37:45.993585] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-29T18:37:46.210116] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T18:37:46.793566] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-29T18:37:47.322001] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (3.73 seconds). [2025-10-29T18:37:47.332942] [INFO ] [REMOTE ] ESI: Full fetch complete (73338 records). [2025-10-29T18:37:47.333079] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-29T18:37:47.730542] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-29T18:37:47.730673] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-29T18:37:47.731550] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-29T18:37:47.731675] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-29T18:37:47.733197] [DEBUG] [LOCAL ] ESI: Trimmed 73338 records to 50570 (keeping 200 days of data) [2025-10-29T18:37:47.857523] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-10-29T18:37:47.872497] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-29T18:37:47.913151] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T18:37:48.138059] [DEBUG] [LOCAL ] ESI: Primary data saved (50570 records). [2025-10-29T18:37:48.138191] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-29T18:37:48.138266] [INFO ] [MAIN ] Update Progress: 770/2367 symbols completed. ESI took 49.6s. Estimated remaining: 3h 22m 46s. Rate: 7.9 symbols/min [2025-10-29T18:37:48.332126] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:37:48.344792] [DEBUG] [LOCAL ] ETB: Loaded 11398 existing records from primary storage. [2025-10-29T18:37:48.345035] [INFO ] [MAIN ] ETB: Loaded 11398 existing records. [2025-10-29T18:37:48.409243] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-29T18:37:48.523193] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:37:48.523626] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-29T18:37:48.523724] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-29T18:37:48.523961] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-29T18:37:48.524019] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-29T18:37:48.877792] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:37:49.066330] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:37:49.193558] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-29T18:37:49.514276] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T18:37:49.993612] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-29T18:37:50.035729] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (4.04 seconds). [2025-10-29T18:37:50.404610] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T18:37:50.793552] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-29T18:37:51.086891] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T18:37:51.593531] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-29T18:37:51.720321] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T18:37:52.393576] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-29T18:37:52.841199] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-29T18:37:53.193578] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-29T18:37:53.885915] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T18:37:53.993592] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-29T18:37:54.229317] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-29T18:37:54.586098] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-29T18:37:54.793570] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-29T18:37:55.593570] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-29T18:37:56.393568] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-29T18:37:56.484037] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-29T18:37:56.713113] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-29T18:37:57.193595] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-29T18:37:57.517148] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T18:37:57.523987] [INFO ] [REMOTE ] ESS: Full fetch complete (43860 records). [2025-10-29T18:37:57.524102] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-29T18:37:57.930964] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-29T18:37:57.931818] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-29T18:37:57.931482] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-29T18:37:57.936318] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-29T18:37:57.936667] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-29T18:37:57.937541] [DEBUG] [LOCAL ] ESS: Trimmed 43860 records to 30028 (keeping 200 days of data) [2025-10-29T18:37:57.999690] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-29T18:37:58.118977] [DEBUG] [LOCAL ] ESS: Primary data saved (30028 records). [2025-10-29T18:37:58.119101] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-29T18:37:58.119188] [INFO ] [MAIN ] Update Progress: 771/2367 symbols completed. ESS took 32.0s. Estimated remaining: 3h 22m 43s. Rate: 7.9 symbols/min [2025-10-29T18:37:58.287250] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:37:58.312293] [DEBUG] [LOCAL ] ETD: Loaded 26545 existing records from primary storage. [2025-10-29T18:37:58.312532] [INFO ] [MAIN ] ETD: Loaded 26545 existing records. [2025-10-29T18:37:58.486277] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:37:58.486474] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-29T18:37:58.486521] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-29T18:37:58.486725] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-29T18:37:58.486780] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-29T18:37:58.804447] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-29T18:37:58.844630] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:37:59.394273] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T18:37:59.593610] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-29T18:38:00.076330] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-29T18:38:00.393521] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-29T18:38:00.569267] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-29T18:38:01.193538] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-29T18:38:01.249137] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T18:38:01.993576] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-29T18:38:02.080365] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T18:38:02.793561] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-29T18:38:03.441029] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-29T18:38:03.593595] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-29T18:38:03.692016] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-29T18:38:04.392979] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T18:38:04.398321] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-29T18:38:05.193558] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-29T18:38:05.797779] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T18:38:05.836222] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:38:05.993564] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-29T18:38:06.793583] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-29T18:38:07.593601] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-29T18:38:08.393554] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-29T18:38:08.476899] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-29T18:38:08.815961] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T18:38:09.153369] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-29T18:38:09.193547] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-29T18:38:09.771422] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-29T18:38:09.775141] [INFO ] [REMOTE ] ETB: Full fetch complete (18496 records). [2025-10-29T18:38:09.775227] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-29T18:38:09.998740] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-29T18:38:10.177761] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-29T18:38:10.177840] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-29T18:38:10.178263] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-29T18:38:10.178323] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-29T18:38:10.178952] [DEBUG] [LOCAL ] ETB: Trimmed 18496 records to 11380 (keeping 200 days of data) [2025-10-29T18:38:10.247206] [DEBUG] [LOCAL ] ETB: Primary data saved (11380 records). [2025-10-29T18:38:10.247344] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-29T18:38:10.247426] [INFO ] [MAIN ] Update Progress: 772/2367 symbols completed. ETB took 22.1s. Estimated remaining: 3h 22m 45s. Rate: 7.9 symbols/min [2025-10-29T18:38:10.429923] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (4.44 seconds). [2025-10-29T18:38:10.471872] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:38:10.489309] [DEBUG] [LOCAL ] ETG: Loaded 16124 existing records from primary storage. [2025-10-29T18:38:10.489533] [INFO ] [MAIN ] ETG: Loaded 16124 existing records. [2025-10-29T18:38:10.664139] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:38:10.664343] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-29T18:38:10.664390] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-29T18:38:10.664675] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-29T18:38:10.664732] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-29T18:38:10.800321] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-29T18:38:11.036781] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:38:11.593537] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-29T18:38:11.850967] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-29T18:38:12.393529] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-29T18:38:12.826369] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T18:38:13.173937] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T18:38:13.193534] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-29T18:38:13.982187] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T18:38:13.993515] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-29T18:38:14.316872] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (4.32 seconds). [2025-10-29T18:38:14.793534] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-29T18:38:14.902799] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-29T18:38:15.593585] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-29T18:38:16.381085] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-29T18:38:16.393525] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-29T18:38:16.453458] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-29T18:38:17.193594] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-29T18:38:17.328577] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T18:38:17.333923] [INFO ] [REMOTE ] ETD: Full fetch complete (38324 records). [2025-10-29T18:38:17.334022] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-29T18:38:17.709233] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-29T18:38:17.709320] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-29T18:38:17.709974] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-29T18:38:17.710041] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-29T18:38:17.710956] [DEBUG] [LOCAL ] ETD: Trimmed 38324 records to 26554 (keeping 200 days of data) [2025-10-29T18:38:17.878255] [DEBUG] [LOCAL ] ETD: Primary data saved (26554 records). [2025-10-29T18:38:17.878419] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-29T18:38:17.878500] [INFO ] [MAIN ] Update Progress: 773/2367 symbols completed. ETD took 19.8s. Estimated remaining: 3h 22m 37s. Rate: 7.9 symbols/min [2025-10-29T18:38:17.998749] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-29T18:38:18.057113] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:38:18.073239] [DEBUG] [LOCAL ] ETJ: Loaded 15711 existing records from primary storage. [2025-10-29T18:38:18.073446] [INFO ] [MAIN ] ETJ: Loaded 15711 existing records. [2025-10-29T18:38:18.268095] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:38:18.268308] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-29T18:38:18.268356] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-29T18:38:18.268679] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-29T18:38:18.268738] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-29T18:38:18.665411] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:38:18.774365] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T18:38:18.785272] [INFO ] [REMOTE ] ESTC: Full fetch complete (72550 records). [2025-10-29T18:38:18.785403] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-29T18:38:18.793600] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-29T18:38:19.181371] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-29T18:38:19.181549] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-29T18:38:19.182547] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-29T18:38:19.182769] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-29T18:38:19.197111] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T18:38:19.202713] [DEBUG] [LOCAL ] ESTC: Trimmed 72550 records to 50188 (keeping 200 days of data) [2025-10-29T18:38:19.497963] [DEBUG] [LOCAL ] ESTC: Primary data saved (50188 records). [2025-10-29T18:38:19.498105] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-29T18:38:19.498185] [INFO ] [MAIN ] Update Progress: 774/2367 symbols completed. ESTC took 39.0s. Estimated remaining: 3h 22m 17s. Rate: 7.9 symbols/min [2025-10-29T18:38:19.597468] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-29T18:38:19.669213] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:38:19.716966] [DEBUG] [LOCAL ] ETN: Loaded 52498 existing records from primary storage. [2025-10-29T18:38:19.717272] [INFO ] [MAIN ] ETN: Loaded 52498 existing records. [2025-10-29T18:38:19.881146] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T18:38:19.910202] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:38:19.915076] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-29T18:38:19.915129] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-29T18:38:19.916256] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-29T18:38:19.916313] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-29T18:38:20.261046] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:38:20.393537] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-29T18:38:21.149779] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T18:38:21.193555] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-29T18:38:21.723292] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T18:38:21.993531] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-29T18:38:22.173333] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-29T18:38:22.539690] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-29T18:38:22.793562] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-29T18:38:23.593616] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-29T18:38:24.393617] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-29T18:38:24.804909] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-29T18:38:25.004502] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T18:38:25.193680] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-29T18:38:25.662903] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-29T18:38:25.711819] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-29T18:38:25.993559] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-29T18:38:26.618615] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-29T18:38:26.793611] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-29T18:38:27.593574] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-29T18:38:28.121250] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-29T18:38:28.319083] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T18:38:28.393537] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-29T18:38:29.193587] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-29T18:38:29.860302] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T18:38:29.970314] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T18:38:29.993512] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-29T18:38:30.523910] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T18:38:30.793573] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-29T18:38:31.456616] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T18:38:31.593538] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-29T18:38:32.277366] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T18:38:32.393602] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-29T18:38:33.193575] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-29T18:38:33.267502] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-29T18:38:33.993625] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-29T18:38:34.793536] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-29T18:38:35.199834] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-29T18:38:35.409071] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T18:38:35.412493] [INFO ] [REMOTE ] ETJ: Full fetch complete (25068 records). [2025-10-29T18:38:35.412568] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-29T18:38:35.599292] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-29T18:38:35.784234] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-29T18:38:35.784309] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-29T18:38:35.784922] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-29T18:38:35.784982] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-29T18:38:35.785574] [DEBUG] [LOCAL ] ETJ: Trimmed 25068 records to 15693 (keeping 200 days of data) [2025-10-29T18:38:35.877202] [DEBUG] [LOCAL ] ETJ: Primary data saved (15693 records). [2025-10-29T18:38:35.877343] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-29T18:38:35.877422] [INFO ] [MAIN ] Update Progress: 775/2367 symbols completed. ETJ took 18.0s. Estimated remaining: 3h 22m 27s. Rate: 7.9 symbols/min [2025-10-29T18:38:36.042722] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:38:36.049959] [DEBUG] [LOCAL ] ETO: Loaded 6682 existing records from primary storage. [2025-10-29T18:38:36.050114] [INFO ] [MAIN ] ETO: Loaded 6682 existing records. [2025-10-29T18:38:36.222775] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:38:36.223007] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-29T18:38:36.223056] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-29T18:38:36.223315] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-29T18:38:36.223372] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-29T18:38:36.402394] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-29T18:38:36.582866] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:38:37.193586] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-29T18:38:37.593112] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (3.60 seconds). [2025-10-29T18:38:37.748792] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-29T18:38:37.759768] [INFO ] [REMOTE ] ET: Full fetch complete (77579 records). [2025-10-29T18:38:37.759929] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-29T18:38:37.760799] [FATAL] [VALIDATOR ] ET: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:38:37.760887] [FATAL] [MAIN ] ET: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:38:37.760928] [WARN ] [MAIN ] ET: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:38:37.760965] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-29T18:38:37.761018] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-10-29T18:38:37.761052] [INFO ] [LOCAL ] ET: Starting deletion of derivative data. [2025-10-29T18:38:37.761201] [DEBUG] [LOCAL ] ET: Deleted derivative data file. [2025-10-29T18:38:37.762085] [INFO ] [MAIN ] Update Progress: 776/2367 symbols completed. ET took 52.9s. Estimated remaining: 3h 22m 8s. Rate: 7.9 symbols/min [2025-10-29T18:38:37.959578] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:38:37.966518] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T18:38:38.010265] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-29T18:38:38.039814] [DEBUG] [LOCAL ] ETR: Loaded 53167 existing records from primary storage. [2025-10-29T18:38:38.040298] [INFO ] [MAIN ] ETR: Loaded 53167 existing records. [2025-10-29T18:38:38.238880] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:38:38.239227] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-29T18:38:38.239281] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-29T18:38:38.240519] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-29T18:38:38.240621] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-29T18:38:38.506265] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T18:38:38.654864] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:38:38.793576] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-29T18:38:39.240460] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T18:38:39.593601] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-29T18:38:40.393682] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-29T18:38:41.193546] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-29T18:38:41.644168] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T18:38:41.677304] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-29T18:38:41.993590] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-29T18:38:42.558090] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-10-29T18:38:42.793596] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-29T18:38:43.221609] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:38:43.341943] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (6.94 seconds). [2025-10-29T18:38:43.593594] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-29T18:38:44.393580] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-29T18:38:44.955877] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T18:38:45.193538] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-29T18:38:45.855791] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (3.06 seconds). [2025-10-29T18:38:45.863451] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T18:38:45.993604] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-29T18:38:46.527193] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T18:38:46.793593] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-29T18:38:47.389676] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T18:38:47.593535] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-29T18:38:48.047330] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-29T18:38:48.393576] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-29T18:38:49.193592] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-29T18:38:49.784784] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T18:38:49.808838] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-29T18:38:49.993568] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-29T18:38:50.793546] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-29T18:38:51.250296] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T18:38:51.593548] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-29T18:38:52.383893] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T18:38:52.389290] [INFO ] [REMOTE ] ETG: Full fetch complete (24286 records). [2025-10-29T18:38:52.389401] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-29T18:38:52.407850] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-29T18:38:52.806276] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-29T18:38:52.806354] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-29T18:38:52.806915] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-29T18:38:52.806976] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-29T18:38:52.807609] [DEBUG] [LOCAL ] ETG: Trimmed 24286 records to 16082 (keeping 200 days of data) [2025-10-29T18:38:52.904979] [DEBUG] [LOCAL ] ETG: Primary data saved (16082 records). [2025-10-29T18:38:52.905130] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-29T18:38:52.905227] [INFO ] [MAIN ] Update Progress: 777/2367 symbols completed. ETG took 42.7s. Estimated remaining: 3h 22m 16s. Rate: 7.9 symbols/min [2025-10-29T18:38:53.074357] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:38:53.074544] [DEBUG] [LOCAL ] ETSY: No existing data file found in primary storage. [2025-10-29T18:38:53.074583] [WARN ] [MAIN ] ETSY: No existing data found, performing full refresh instead. [2025-10-29T18:38:53.074719] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-29T18:38:53.074768] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-29T18:38:53.074812] [DEBUG] [LOCAL ] ETSY: No primary data file found to delete. [2025-10-29T18:38:53.074846] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-29T18:38:53.446637] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:38:53.446978] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-29T18:38:53.743599] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-29T18:38:53.993605] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-29T18:38:54.045837] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (8.05 seconds). [2025-10-29T18:38:54.729956] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T18:38:54.756579] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (3.96 seconds). [2025-10-29T18:38:54.793568] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-29T18:38:55.117903] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-29T18:38:55.385099] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T18:38:55.593619] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-29T18:38:56.000237] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T18:38:56.393542] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-29T18:38:57.193551] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-29T18:38:57.588095] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T18:38:57.689025] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T18:38:57.993633] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-29T18:38:58.793631] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-29T18:38:59.453788] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T18:38:59.456375] [INFO ] [REMOTE ] ETO: Full fetch complete (9685 records). [2025-10-29T18:38:59.456452] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-29T18:38:59.611962] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-29T18:38:59.801758] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-29T18:38:59.914070] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-29T18:38:59.914171] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-29T18:38:59.914522] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-29T18:38:59.914563] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-29T18:38:59.915099] [DEBUG] [LOCAL ] ETO: Trimmed 9685 records to 6656 (keeping 200 days of data) [2025-10-29T18:38:59.962194] [DEBUG] [LOCAL ] ETO: Primary data saved (6656 records). [2025-10-29T18:38:59.962379] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-29T18:38:59.962479] [INFO ] [MAIN ] Update Progress: 778/2367 symbols completed. ETO took 24.1s. Estimated remaining: 3h 22m 7s. Rate: 7.9 symbols/min [2025-10-29T18:39:00.141730] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:00.165017] [DEBUG] [LOCAL ] ETV: Loaded 21314 existing records from primary storage. [2025-10-29T18:39:00.165394] [INFO ] [MAIN ] ETV: Loaded 21314 existing records. [2025-10-29T18:39:00.362839] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:39:00.363185] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-29T18:39:00.363237] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-29T18:39:00.363815] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-29T18:39:00.363883] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-29T18:39:00.398858] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-29T18:39:00.781895] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:01.193591] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-29T18:39:01.863948] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-29T18:39:01.881911] [INFO ] [REMOTE ] ETR: Full fetch complete (77262 records). [2025-10-29T18:39:01.882149] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-29T18:39:01.998758] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-29T18:39:02.360638] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-29T18:39:02.360876] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-29T18:39:02.361793] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-29T18:39:02.361918] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-29T18:39:02.363716] [DEBUG] [LOCAL ] ETR: Trimmed 77262 records to 53168 (keeping 200 days of data) [2025-10-29T18:39:02.518680] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T18:39:02.750632] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-29T18:39:02.768373] [INFO ] [REMOTE ] ETN: Full fetch complete (76585 records). [2025-10-29T18:39:02.771562] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-29T18:39:02.804758] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-29T18:39:02.870975] [DEBUG] [LOCAL ] ETR: Primary data saved (53168 records). [2025-10-29T18:39:02.881454] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-29T18:39:02.882405] [INFO ] [MAIN ] Update Progress: 779/2367 symbols completed. ETR took 25.1s. Estimated remaining: 3h 21m 50s. Rate: 7.9 symbols/min [2025-10-29T18:39:03.253187] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:03.358372] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-29T18:39:03.358577] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-29T18:39:03.359482] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-29T18:39:03.359662] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-29T18:39:03.361332] [DEBUG] [LOCAL ] ETN: Trimmed 76585 records to 52486 (keeping 200 days of data) [2025-10-29T18:39:03.425451] [DEBUG] [LOCAL ] ETW: Loaded 24557 existing records from primary storage. [2025-10-29T18:39:03.483476] [INFO ] [MAIN ] ETW: Loaded 24557 existing records. [2025-10-29T18:39:03.715282] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-29T18:39:03.760269] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-29T18:39:03.941516] [DEBUG] [LOCAL ] ETN: Primary data saved (52486 records). [2025-10-29T18:39:03.962092] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-29T18:39:03.962209] [INFO ] [MAIN ] Update Progress: 780/2367 symbols completed. ETN took 44.5s. Estimated remaining: 3h 21m 29s. Rate: 7.9 symbols/min [2025-10-29T18:39:04.015772] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:39:04.053789] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-29T18:39:04.053930] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-29T18:39:04.065750] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-29T18:39:04.087053] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-29T18:39:04.245602] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:04.270036] [DEBUG] [LOCAL ] ETX: No existing data file found in primary storage. [2025-10-29T18:39:04.270270] [WARN ] [MAIN ] ETX: No existing data found, performing full refresh instead. [2025-10-29T18:39:04.270580] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-29T18:39:04.286628] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-29T18:39:04.310874] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-10-29T18:39:04.316202] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-29T18:39:04.861420] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:04.874858] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-29T18:39:04.872863] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:39:04.903674] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-29T18:39:04.972388] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:05.193551] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-29T18:39:05.695560] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-29T18:39:05.799291] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:39:05.993638] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-29T18:39:06.252968] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-29T18:39:06.793572] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-29T18:39:07.593552] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-29T18:39:07.874783] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-29T18:39:08.250796] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-29T18:39:08.393539] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-29T18:39:09.193553] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-29T18:39:09.762769] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T18:39:09.977875] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T18:39:09.993511] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-29T18:39:10.793556] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-29T18:39:10.846598] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-29T18:39:11.132152] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-29T18:39:11.593556] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-29T18:39:12.344802] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T18:39:12.393555] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-29T18:39:12.732419] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-29T18:39:13.193567] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-29T18:39:13.993552] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-29T18:39:14.440556] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T18:39:14.521836] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T18:39:14.793542] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-29T18:39:15.164790] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-29T18:39:15.593565] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-29T18:39:16.393590] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-29T18:39:16.522014] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T18:39:17.193563] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-29T18:39:17.858485] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T18:39:17.993557] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-29T18:39:18.216891] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T18:39:18.793582] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-29T18:39:19.529496] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T18:39:19.593596] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-29T18:39:20.394687] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-29T18:39:20.396609] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-29T18:39:21.193546] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-29T18:39:21.384595] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T18:39:21.844856] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T18:39:21.993613] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-29T18:39:22.294059] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T18:39:22.793563] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-29T18:39:23.553232] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T18:39:23.593567] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-29T18:39:24.301765] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T18:39:24.393545] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-29T18:39:25.031345] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (7.04 seconds). [2025-10-29T18:39:25.193552] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-29T18:39:25.993692] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-29T18:39:26.617189] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T18:39:26.618850] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-29T18:39:26.631386] [INFO ] [REMOTE ] ETX: Full fetch complete (6848 records). [2025-10-29T18:39:26.631903] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-29T18:39:26.797477] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-29T18:39:27.007877] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-29T18:39:27.007956] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-29T18:39:27.008150] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-29T18:39:27.008191] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-29T18:39:27.008720] [DEBUG] [LOCAL ] ETX: Trimmed 6848 records to 5349 (keeping 200 days of data) [2025-10-29T18:39:27.043331] [DEBUG] [LOCAL ] ETX: Primary data saved (5349 records). [2025-10-29T18:39:27.043465] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-29T18:39:27.043535] [INFO ] [MAIN ] Update Progress: 781/2367 symbols completed. ETX took 23.1s. Estimated remaining: 3h 21m 52s. Rate: 7.9 symbols/min [2025-10-29T18:39:27.216380] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:27.216565] [DEBUG] [LOCAL ] ETY: No existing data file found in primary storage. [2025-10-29T18:39:27.216604] [WARN ] [MAIN ] ETY: No existing data found, performing full refresh instead. [2025-10-29T18:39:27.216739] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-29T18:39:27.216783] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-29T18:39:27.216824] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-29T18:39:27.216857] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-29T18:39:27.565735] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:27.593524] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-29T18:39:28.000410] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T18:39:28.005852] [INFO ] [REMOTE ] ETV: Full fetch complete (31951 records). [2025-10-29T18:39:28.005962] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-29T18:39:28.372744] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-29T18:39:28.372870] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-29T18:39:28.373414] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-29T18:39:28.373453] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-29T18:39:28.374220] [DEBUG] [LOCAL ] ETV: Trimmed 31951 records to 21300 (keeping 200 days of data) [2025-10-29T18:39:28.424688] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-29T18:39:28.482980] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-29T18:39:28.520125] [DEBUG] [LOCAL ] ETV: Primary data saved (21300 records). [2025-10-29T18:39:28.520236] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-29T18:39:28.520306] [INFO ] [MAIN ] Update Progress: 782/2367 symbols completed. ETV took 28.6s. Estimated remaining: 3h 21m 32s. Rate: 7.9 symbols/min [2025-10-29T18:39:28.692175] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:28.707766] [DEBUG] [LOCAL ] EVC: Loaded 17402 existing records from primary storage. [2025-10-29T18:39:28.708017] [INFO ] [MAIN ] EVC: Loaded 17402 existing records. [2025-10-29T18:39:28.888268] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:39:28.888515] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-29T18:39:28.888567] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-29T18:39:28.889055] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-29T18:39:28.889113] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-29T18:39:29.198725] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-29T18:39:29.251242] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:29.993611] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-29T18:39:30.222065] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-29T18:39:30.233468] [INFO ] [REMOTE ] ETSY: Full fetch complete (77659 records). [2025-10-29T18:39:30.233607] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-29T18:39:30.641575] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-29T18:39:30.641687] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-29T18:39:30.642738] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-29T18:39:30.642806] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-29T18:39:30.644346] [DEBUG] [LOCAL ] ETSY: Trimmed 77659 records to 53556 (keeping 200 days of data) [2025-10-29T18:39:30.953757] [DEBUG] [LOCAL ] ETSY: Primary data saved (53556 records). [2025-10-29T18:39:30.953892] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-29T18:39:30.953963] [INFO ] [MAIN ] Update Progress: 783/2367 symbols completed. ETSY took 38.0s. Estimated remaining: 3h 21m 14s. Rate: 7.9 symbols/min [2025-10-29T18:39:31.132794] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:31.162635] [DEBUG] [LOCAL ] EVEX: Loaded 33359 existing records from primary storage. [2025-10-29T18:39:31.162957] [INFO ] [MAIN ] EVEX: Loaded 33359 existing records. [2025-10-29T18:39:31.346969] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:39:31.347205] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-29T18:39:31.347263] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-29T18:39:31.347862] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-29T18:39:31.347920] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-29T18:39:31.728986] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:31.729409] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-29T18:39:32.056908] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (7.66 seconds). [2025-10-29T18:39:32.062348] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-29T18:39:32.843840] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T18:39:32.849838] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-29T18:39:32.886022] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T18:39:33.193636] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-29T18:39:33.446694] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (4.25 seconds). [2025-10-29T18:39:33.625864] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T18:39:33.995419] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-29T18:39:33.998690] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T18:39:34.793539] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-29T18:39:34.874708] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T18:39:35.517238] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T18:39:35.593608] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-29T18:39:36.393564] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-29T18:39:36.520089] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-29T18:39:37.193690] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-29T18:39:37.993737] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-29T18:39:38.389843] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-29T18:39:38.776915] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T18:39:38.793521] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-29T18:39:38.932481] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (8.94 seconds). [2025-10-29T18:39:39.533519] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-29T18:39:39.593599] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-29T18:39:40.362418] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T18:39:40.393610] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-29T18:39:41.193538] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-29T18:39:41.312608] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T18:39:41.993537] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-29T18:39:42.136320] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T18:39:42.142411] [INFO ] [REMOTE ] ETW: Full fetch complete (36352 records). [2025-10-29T18:39:42.142531] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-29T18:39:42.429334] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (5.24 seconds). [2025-10-29T18:39:42.547208] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-29T18:39:42.547293] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-29T18:39:42.548048] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-29T18:39:42.548113] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-29T18:39:42.549089] [DEBUG] [LOCAL ] ETW: Trimmed 36352 records to 24420 (keeping 200 days of data) [2025-10-29T18:39:42.693116] [DEBUG] [LOCAL ] ETW: Primary data saved (24420 records). [2025-10-29T18:39:42.693239] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-29T18:39:42.693315] [INFO ] [MAIN ] Update Progress: 784/2367 symbols completed. ETW took 39.8s. Estimated remaining: 3h 21m 15s. Rate: 7.9 symbols/min [2025-10-29T18:39:42.798713] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-29T18:39:42.874572] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:42.883974] [DEBUG] [LOCAL ] EVF: Loaded 9375 existing records from primary storage. [2025-10-29T18:39:42.884189] [INFO ] [MAIN ] EVF: Loaded 9375 existing records. [2025-10-29T18:39:43.062557] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:39:43.062794] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-29T18:39:43.062850] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-29T18:39:43.063137] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-29T18:39:43.063199] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-29T18:39:43.373242] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T18:39:43.455742] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:43.593522] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-29T18:39:43.683350] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T18:39:44.326951] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-29T18:39:44.393527] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-29T18:39:45.069092] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-29T18:39:45.193525] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-29T18:39:45.905227] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-29T18:39:45.993592] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-29T18:39:46.793538] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-29T18:39:46.878311] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T18:39:47.397028] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-29T18:39:47.593543] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-29T18:39:48.239943] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T18:39:48.393569] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-29T18:39:49.193558] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-29T18:39:49.993566] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-29T18:39:50.627067] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T18:39:50.793565] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-29T18:39:51.284692] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T18:39:51.601924] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-29T18:39:51.603602] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-29T18:39:51.936358] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (3.54 seconds). [2025-10-29T18:39:52.091867] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-29T18:39:52.393558] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-29T18:39:53.153471] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T18:39:53.193560] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-29T18:39:53.979424] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-29T18:39:53.993521] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-29T18:39:54.793539] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-29T18:39:54.807026] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-29T18:39:55.593571] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-29T18:39:56.393543] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-29T18:39:56.514933] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-29T18:39:56.520442] [INFO ] [REMOTE ] ETY: Full fetch complete (33676 records). [2025-10-29T18:39:56.520593] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-29T18:39:56.907085] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-29T18:39:56.907386] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-29T18:39:56.908130] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-29T18:39:56.908272] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-29T18:39:56.909165] [DEBUG] [LOCAL ] ETY: Trimmed 33676 records to 21658 (keeping 200 days of data) [2025-10-29T18:39:57.019758] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-29T18:39:57.053964] [DEBUG] [LOCAL ] ETY: Primary data saved (21658 records). [2025-10-29T18:39:57.054115] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-29T18:39:57.054197] [INFO ] [MAIN ] Update Progress: 785/2367 symbols completed. ETY took 30.0s. Estimated remaining: 3h 21m 21s. Rate: 7.9 symbols/min [2025-10-29T18:39:57.200469] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-29T18:39:57.228607] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:57.236787] [DEBUG] [LOCAL ] EVG: Loaded 5672 existing records from primary storage. [2025-10-29T18:39:57.237008] [INFO ] [MAIN ] EVG: Loaded 5672 existing records. [2025-10-29T18:39:57.426829] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:39:57.427099] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-29T18:39:57.427156] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-29T18:39:57.427380] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-29T18:39:57.427445] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-29T18:39:57.782228] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:57.993553] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-29T18:39:58.067966] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T18:39:58.071333] [INFO ] [REMOTE ] EVC: Full fetch complete (28088 records). [2025-10-29T18:39:58.071421] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-29T18:39:58.430562] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-29T18:39:58.430639] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-29T18:39:58.431169] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-29T18:39:58.431212] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-29T18:39:58.431901] [DEBUG] [LOCAL ] EVC: Trimmed 28088 records to 17352 (keeping 200 days of data) [2025-10-29T18:39:58.506828] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-29T18:39:58.537242] [DEBUG] [LOCAL ] EVC: Primary data saved (17352 records). [2025-10-29T18:39:58.537365] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-29T18:39:58.537439] [INFO ] [MAIN ] Update Progress: 786/2367 symbols completed. EVC took 30.0s. Estimated remaining: 3h 21m 1s. Rate: 7.9 symbols/min [2025-10-29T18:39:58.706725] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:39:58.747499] [DEBUG] [LOCAL ] EVH: Loaded 49543 existing records from primary storage. [2025-10-29T18:39:58.747835] [INFO ] [MAIN ] EVH: Loaded 49543 existing records. [2025-10-29T18:39:58.801153] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-29T18:39:58.926771] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:39:58.927055] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-29T18:39:58.927105] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-29T18:39:58.928000] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-29T18:39:58.928059] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-29T18:39:59.280394] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:39:59.286267] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-29T18:39:59.593565] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-29T18:39:59.791421] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (5.00 seconds). [2025-10-29T18:40:00.046943] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T18:40:00.393612] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-29T18:40:01.139703] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T18:40:01.193565] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-29T18:40:01.711699] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-29T18:40:01.993717] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-29T18:40:02.613756] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-29T18:40:02.793598] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-29T18:40:03.593574] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-29T18:40:04.123472] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T18:40:04.388360] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T18:40:04.391577] [INFO ] [REMOTE ] EVF: Full fetch complete (12933 records). [2025-10-29T18:40:04.391729] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-29T18:40:04.403362] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-29T18:40:04.763359] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-29T18:40:04.763434] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-29T18:40:04.763735] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-29T18:40:04.763810] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-29T18:40:04.764267] [DEBUG] [LOCAL ] EVF: Trimmed 12933 records to 9374 (keeping 200 days of data) [2025-10-29T18:40:04.817342] [DEBUG] [LOCAL ] EVF: Primary data saved (9374 records). [2025-10-29T18:40:04.817457] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-29T18:40:04.817530] [INFO ] [MAIN ] Update Progress: 787/2367 symbols completed. EVF took 22.1s. Estimated remaining: 3h 20m 51s. Rate: 7.9 symbols/min [2025-10-29T18:40:04.920836] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T18:40:05.021141] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:40:05.032574] [DEBUG] [LOCAL ] EVN: Loaded 10875 existing records from primary storage. [2025-10-29T18:40:05.032841] [INFO ] [MAIN ] EVN: Loaded 10875 existing records. [2025-10-29T18:40:05.203001] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-29T18:40:05.227854] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:40:05.228080] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-29T18:40:05.228126] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-29T18:40:05.228463] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-29T18:40:05.228519] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-29T18:40:05.587071] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:40:05.993591] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-29T18:40:06.422802] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-29T18:40:06.793580] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-29T18:40:07.258672] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-29T18:40:07.593579] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-29T18:40:08.109351] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-29T18:40:08.393530] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-29T18:40:08.608045] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (3.41 seconds). [2025-10-29T18:40:09.053461] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T18:40:09.193552] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-29T18:40:09.993557] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-29T18:40:10.658529] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T18:40:10.668313] [INFO ] [REMOTE ] EVEX: Full fetch complete (44413 records). [2025-10-29T18:40:10.668464] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-29T18:40:10.807443] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-29T18:40:11.045711] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-29T18:40:11.045791] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-29T18:40:11.046406] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-29T18:40:11.046444] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-29T18:40:11.047342] [DEBUG] [LOCAL ] EVEX: Trimmed 44413 records to 33559 (keeping 200 days of data) [2025-10-29T18:40:11.227017] [DEBUG] [LOCAL ] EVEX: Primary data saved (33559 records). [2025-10-29T18:40:11.227196] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-29T18:40:11.227323] [INFO ] [MAIN ] Update Progress: 788/2367 symbols completed. EVEX took 40.3s. Estimated remaining: 3h 20m 40s. Rate: 7.9 symbols/min [2025-10-29T18:40:11.335764] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T18:40:11.409850] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:40:11.435236] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T18:40:11.470090] [DEBUG] [LOCAL ] EVR: Loaded 32859 existing records from primary storage. [2025-10-29T18:40:11.470365] [INFO ] [MAIN ] EVR: Loaded 32859 existing records. [2025-10-29T18:40:11.608260] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-29T18:40:11.651446] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:40:11.651612] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-29T18:40:11.651689] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-29T18:40:11.652308] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-29T18:40:11.652364] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-29T18:40:12.006517] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:40:12.178260] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-29T18:40:12.393602] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-29T18:40:12.942605] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T18:40:13.193610] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-29T18:40:13.993550] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-29T18:40:14.035885] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T18:40:14.793588] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-29T18:40:15.284905] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T18:40:15.593583] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-29T18:40:16.393560] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-29T18:40:17.193591] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-29T18:40:17.225886] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (3.23 seconds). [2025-10-29T18:40:17.553717] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-29T18:40:17.555628] [INFO ] [REMOTE ] EVG: Full fetch complete (8121 records). [2025-10-29T18:40:17.555737] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-29T18:40:17.926231] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-29T18:40:17.926437] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-29T18:40:17.926765] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-29T18:40:17.941192] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-29T18:40:17.953638] [DEBUG] [LOCAL ] EVG: Trimmed 8121 records to 5753 (keeping 200 days of data) [2025-10-29T18:40:17.970175] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-29T18:40:17.993539] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-29T18:40:18.001749] [DEBUG] [LOCAL ] EVG: Primary data saved (5753 records). [2025-10-29T18:40:18.001827] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-29T18:40:18.001901] [INFO ] [MAIN ] Update Progress: 789/2367 symbols completed. EVG took 20.9s. Estimated remaining: 3h 20m 31s. Rate: 7.9 symbols/min [2025-10-29T18:40:18.184477] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:40:18.199458] [DEBUG] [LOCAL ] EVT: Loaded 16162 existing records from primary storage. [2025-10-29T18:40:18.199711] [INFO ] [MAIN ] EVT: Loaded 16162 existing records. [2025-10-29T18:40:18.376060] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:40:18.376235] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-29T18:40:18.376279] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-29T18:40:18.376627] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-29T18:40:18.376717] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-29T18:40:18.735761] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:40:18.793515] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-29T18:40:19.118509] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T18:40:19.463712] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-29T18:40:19.593615] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-29T18:40:19.803808] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T18:40:20.393568] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-29T18:40:20.795516] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T18:40:21.193620] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-29T18:40:21.663036] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T18:40:21.993553] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-29T18:40:22.486546] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T18:40:22.793572] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-29T18:40:23.209497] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T18:40:23.480723] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T18:40:23.593584] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-29T18:40:24.393568] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-29T18:40:24.778772] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-29T18:40:25.039703] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-29T18:40:25.193579] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-29T18:40:25.727003] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-29T18:40:25.993597] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-29T18:40:26.615410] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-29T18:40:26.793563] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-29T18:40:27.490964] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T18:40:27.593550] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-29T18:40:28.269107] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-29T18:40:28.393600] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-29T18:40:29.193615] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-29T18:40:29.781176] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T18:40:29.993573] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-29T18:40:30.725943] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T18:40:30.793551] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-29T18:40:31.593601] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-29T18:40:32.148006] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T18:40:32.305003] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T18:40:32.393595] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-29T18:40:33.088991] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (4.70 seconds). [2025-10-29T18:40:33.100591] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T18:40:33.193536] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-29T18:40:33.993585] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-29T18:40:34.405412] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T18:40:34.714238] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-29T18:40:34.717406] [INFO ] [REMOTE ] EVN: Full fetch complete (16714 records). [2025-10-29T18:40:34.717478] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-29T18:40:34.798800] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-29T18:40:35.091102] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-29T18:40:35.091179] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-29T18:40:35.091593] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-29T18:40:35.091635] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-29T18:40:35.092172] [DEBUG] [LOCAL ] EVN: Trimmed 16714 records to 10843 (keeping 200 days of data) [2025-10-29T18:40:35.157096] [DEBUG] [LOCAL ] EVN: Primary data saved (10843 records). [2025-10-29T18:40:35.157227] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-29T18:40:35.157304] [INFO ] [MAIN ] Update Progress: 790/2367 symbols completed. EVN took 30.3s. Estimated remaining: 3h 20m 43s. Rate: 7.9 symbols/min [2025-10-29T18:40:35.337558] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:40:35.361279] [DEBUG] [LOCAL ] EVTC: Loaded 26510 existing records from primary storage. [2025-10-29T18:40:35.361525] [INFO ] [MAIN ] EVTC: Loaded 26510 existing records. [2025-10-29T18:40:35.552134] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:40:35.552351] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-29T18:40:35.552443] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-29T18:40:35.553003] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-29T18:40:35.553086] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-29T18:40:35.598741] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-29T18:40:35.932622] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:40:36.159202] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T18:40:36.393630] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-29T18:40:36.897374] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T18:40:37.193540] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-29T18:40:37.993594] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-29T18:40:38.187285] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-29T18:40:38.319003] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T18:40:38.793704] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-29T18:40:39.593623] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-29T18:40:40.072193] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T18:40:40.393536] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-29T18:40:40.429599] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-29T18:40:40.535019] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-29T18:40:41.193548] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-29T18:40:41.781842] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-29T18:40:41.792413] [INFO ] [REMOTE ] EVH: Full fetch complete (71962 records). [2025-10-29T18:40:41.792566] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-29T18:40:42.000323] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-29T18:40:42.194300] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-29T18:40:42.194369] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-29T18:40:42.195265] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-29T18:40:42.195341] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-29T18:40:42.197040] [DEBUG] [LOCAL ] EVH: Trimmed 71962 records to 49524 (keeping 200 days of data) [2025-10-29T18:40:42.327182] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T18:40:42.504795] [DEBUG] [LOCAL ] EVH: Primary data saved (49524 records). [2025-10-29T18:40:42.504940] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-29T18:40:42.505019] [INFO ] [MAIN ] Update Progress: 791/2367 symbols completed. EVH took 44.0s. Estimated remaining: 3h 20m 34s. Rate: 7.9 symbols/min [2025-10-29T18:40:42.683027] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:40:42.683228] [DEBUG] [LOCAL ] EVTL: No existing data file found in primary storage. [2025-10-29T18:40:42.683271] [WARN ] [MAIN ] EVTL: No existing data found, performing full refresh instead. [2025-10-29T18:40:42.683380] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-29T18:40:42.683421] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-29T18:40:42.683463] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-10-29T18:40:42.683495] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-29T18:40:42.798629] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-29T18:40:43.058260] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:40:43.059568] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T18:40:43.593564] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-29T18:40:43.786418] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T18:40:43.789878] [INFO ] [REMOTE ] EVT: Full fetch complete (24768 records). [2025-10-29T18:40:43.789949] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-29T18:40:44.150178] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-29T18:40:44.150284] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-29T18:40:44.150853] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-29T18:40:44.150917] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-29T18:40:44.151735] [DEBUG] [LOCAL ] EVT: Trimmed 24768 records to 16180 (keeping 200 days of data) [2025-10-29T18:40:44.250837] [DEBUG] [LOCAL ] EVT: Primary data saved (16180 records). [2025-10-29T18:40:44.250971] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-29T18:40:44.251048] [INFO ] [MAIN ] Update Progress: 792/2367 symbols completed. EVT took 26.2s. Estimated remaining: 3h 20m 15s. Rate: 7.9 symbols/min [2025-10-29T18:40:44.397333] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-29T18:40:44.432931] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:40:44.458393] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T18:40:44.484864] [DEBUG] [LOCAL ] EVTR: Loaded 25713 existing records from primary storage. [2025-10-29T18:40:44.485150] [INFO ] [MAIN ] EVTR: Loaded 25713 existing records. [2025-10-29T18:40:44.675718] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:40:44.675973] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-29T18:40:44.676023] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-29T18:40:44.676573] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-29T18:40:44.676633] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-29T18:40:45.055863] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:40:45.193529] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-29T18:40:45.473176] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T18:40:45.993599] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-29T18:40:46.073982] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T18:40:46.793628] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-29T18:40:46.924396] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T18:40:47.332584] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-29T18:40:47.593568] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-29T18:40:48.393579] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-29T18:40:48.698570] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T18:40:49.066855] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T18:40:49.193583] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-29T18:40:49.993538] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-29T18:40:50.123175] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-29T18:40:50.793635] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-29T18:40:51.064804] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-29T18:40:51.070484] [INFO ] [REMOTE ] EVR: Full fetch complete (50071 records). [2025-10-29T18:40:51.070572] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-29T18:40:51.071123] [FATAL] [VALIDATOR ] EVR: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:40:51.071205] [FATAL] [MAIN ] EVR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:40:51.071246] [WARN ] [MAIN ] EVR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:40:51.071285] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-29T18:40:51.071337] [DEBUG] [LOCAL ] EVR: No primary data file found to delete. [2025-10-29T18:40:51.071370] [INFO ] [LOCAL ] EVR: Starting deletion of derivative data. [2025-10-29T18:40:51.071556] [DEBUG] [LOCAL ] EVR: Deleted derivative data file. [2025-10-29T18:40:51.071670] [INFO ] [MAIN ] Update Progress: 793/2367 symbols completed. EVR took 39.8s. Estimated remaining: 3h 20m 6s. Rate: 7.9 symbols/min [2025-10-29T18:40:51.237721] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:40:51.285865] [DEBUG] [LOCAL ] EW: Loaded 53386 existing records from primary storage. [2025-10-29T18:40:51.286153] [INFO ] [MAIN ] EW: Loaded 53386 existing records. [2025-10-29T18:40:51.465124] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:40:51.465308] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-29T18:40:51.465355] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-29T18:40:51.466164] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-29T18:40:51.466221] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-29T18:40:51.594820] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-29T18:40:51.619529] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T18:40:51.845242] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:40:52.393544] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-29T18:40:52.479139] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T18:40:53.120105] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-29T18:40:53.193535] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-29T18:40:53.972869] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T18:40:53.993544] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-29T18:40:54.751334] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T18:40:54.793573] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-29T18:40:55.593603] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-29T18:40:55.632138] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-29T18:40:56.393565] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-29T18:40:56.758905] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T18:40:57.193619] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-29T18:40:57.745815] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T18:40:57.993550] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-29T18:40:58.104349] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-29T18:40:58.793561] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-29T18:40:59.602465] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-29T18:40:59.604323] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-29T18:41:00.393557] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-29T18:41:00.510822] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-29T18:41:01.193559] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-29T18:41:01.530884] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T18:41:01.993593] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-29T18:41:02.131879] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T18:41:02.489834] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (4.50 seconds). [2025-10-29T18:41:02.793579] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-29T18:41:03.106594] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T18:41:03.113804] [INFO ] [REMOTE ] EVTR: Full fetch complete (34584 records). [2025-10-29T18:41:03.113878] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-29T18:41:03.485803] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-29T18:41:03.485878] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-29T18:41:03.486425] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-29T18:41:03.486463] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-29T18:41:03.487197] [DEBUG] [LOCAL ] EVTR: Trimmed 34584 records to 25634 (keeping 200 days of data) [2025-10-29T18:41:03.594718] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-29T18:41:03.641268] [DEBUG] [LOCAL ] EVTR: Primary data saved (25634 records). [2025-10-29T18:41:03.641401] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-29T18:41:03.641480] [INFO ] [MAIN ] Update Progress: 794/2367 symbols completed. EVTR took 19.4s. Estimated remaining: 3h 20m 8s. Rate: 7.9 symbols/min [2025-10-29T18:41:03.826525] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:41:03.846271] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-29T18:41:03.879404] [DEBUG] [LOCAL ] EXG: Loaded 32985 existing records from primary storage. [2025-10-29T18:41:03.879752] [INFO ] [MAIN ] EXG: Loaded 32985 existing records. [2025-10-29T18:41:04.064288] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:41:04.064521] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-29T18:41:04.064570] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-29T18:41:04.065212] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-29T18:41:04.065271] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-29T18:41:04.398714] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-29T18:41:04.480393] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:41:04.838792] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T18:41:05.193592] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-29T18:41:05.691595] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T18:41:05.993556] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-29T18:41:06.482210] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T18:41:06.793570] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-29T18:41:07.593589] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-29T18:41:07.700136] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-29T18:41:08.220834] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T18:41:08.393566] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-29T18:41:08.460717] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-29T18:41:09.193572] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-29T18:41:09.639901] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T18:41:09.860253] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T18:41:09.993591] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-29T18:41:10.793588] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-29T18:41:11.271196] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T18:41:11.593559] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-29T18:41:12.010932] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T18:41:12.393556] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-29T18:41:12.463828] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T18:41:13.193701] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-29T18:41:13.691020] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T18:41:13.993604] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-29T18:41:14.158758] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T18:41:14.793618] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-29T18:41:15.036016] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T18:41:15.043103] [INFO ] [REMOTE ] EVTC: Full fetch complete (38517 records). [2025-10-29T18:41:15.043272] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-29T18:41:15.461069] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-29T18:41:15.461224] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-29T18:41:15.462561] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-29T18:41:15.462634] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-29T18:41:15.464159] [DEBUG] [LOCAL ] EVTC: Trimmed 38517 records to 26600 (keeping 200 days of data) [2025-10-29T18:41:15.597403] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-29T18:41:15.639747] [DEBUG] [LOCAL ] EVTC: Primary data saved (26600 records). [2025-10-29T18:41:15.639961] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-29T18:41:15.640075] [INFO ] [MAIN ] Update Progress: 795/2367 symbols completed. EVTC took 40.5s. Estimated remaining: 3h 20m 9s. Rate: 7.9 symbols/min [2025-10-29T18:41:15.839310] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:41:15.894112] [DEBUG] [LOCAL ] EXK: Loaded 53188 existing records from primary storage. [2025-10-29T18:41:15.894500] [INFO ] [MAIN ] EXK: Loaded 53188 existing records. [2025-10-29T18:41:16.074446] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:41:16.074758] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-29T18:41:16.074892] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-29T18:41:16.075427] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-29T18:41:16.075486] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-29T18:41:16.403030] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-29T18:41:16.449905] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:41:16.480901] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-29T18:41:16.993618] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T18:41:17.193603] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-29T18:41:17.573997] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T18:41:17.993681] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-29T18:41:18.805224] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-29T18:41:18.811569] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-29T18:41:19.593596] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-29T18:41:19.846909] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T18:41:19.904613] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-29T18:41:19.917634] [INFO ] [REMOTE ] EVTL: Full fetch complete (55748 records). [2025-10-29T18:41:19.917944] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-29T18:41:20.347300] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-29T18:41:20.347444] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-29T18:41:20.348565] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-29T18:41:20.348635] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-29T18:41:20.350434] [DEBUG] [LOCAL ] EVTL: Trimmed 55748 records to 42274 (keeping 200 days of data) [2025-10-29T18:41:20.396177] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-29T18:41:20.605088] [DEBUG] [LOCAL ] EVTL: Primary data saved (42274 records). [2025-10-29T18:41:20.605264] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-29T18:41:20.605347] [INFO ] [MAIN ] Update Progress: 796/2367 symbols completed. EVTL took 38.1s. Estimated remaining: 3h 19m 56s. Rate: 7.9 symbols/min [2025-10-29T18:41:20.797173] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:41:20.826953] [DEBUG] [LOCAL ] EXP: Loaded 28717 existing records from primary storage. [2025-10-29T18:41:20.853945] [INFO ] [MAIN ] EXP: Loaded 28717 existing records. [2025-10-29T18:41:20.889294] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T18:41:21.068142] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:41:21.068397] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-29T18:41:21.068442] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-29T18:41:21.068686] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-29T18:41:21.068742] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-29T18:41:21.204240] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-29T18:41:21.420707] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:41:21.876118] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T18:41:21.888605] [INFO ] [REMOTE ] EW: Full fetch complete (77505 records). [2025-10-29T18:41:21.888811] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-29T18:41:21.998725] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-29T18:41:22.341017] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-29T18:41:22.341169] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-29T18:41:22.342255] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-29T18:41:22.342321] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-29T18:41:22.343829] [DEBUG] [LOCAL ] EW: Trimmed 77505 records to 53387 (keeping 200 days of data) [2025-10-29T18:41:22.574209] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-29T18:41:22.693429] [DEBUG] [LOCAL ] EW: Primary data saved (53387 records). [2025-10-29T18:41:22.693559] [INFO ] [MAIN ] EW: Full history saved. [2025-10-29T18:41:22.693636] [INFO ] [MAIN ] Update Progress: 797/2367 symbols completed. EW took 31.6s. Estimated remaining: 3h 19m 37s. Rate: 7.9 symbols/min [2025-10-29T18:41:22.793545] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-29T18:41:22.956769] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T18:41:23.593567] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-29T18:41:23.657196] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T18:41:24.393603] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-29T18:41:24.988624] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T18:41:25.193551] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-29T18:41:25.256907] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T18:41:25.993600] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-29T18:41:26.126490] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T18:41:26.793733] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-29T18:41:26.925502] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-29T18:41:27.593554] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-29T18:41:28.178149] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T18:41:28.393549] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-29T18:41:28.518746] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T18:41:29.193575] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-29T18:41:29.452231] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T18:41:29.993542] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-29T18:41:30.120162] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T18:41:30.793535] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-29T18:41:30.884601] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T18:41:31.593584] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-29T18:41:32.147633] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-29T18:41:32.393594] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-29T18:41:32.454865] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-29T18:41:32.461582] [INFO ] [REMOTE ] EXG: Full fetch complete (49150 records). [2025-10-29T18:41:32.461750] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-29T18:41:32.846687] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-29T18:41:32.846788] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-29T18:41:32.847520] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-29T18:41:32.847586] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-29T18:41:32.848731] [DEBUG] [LOCAL ] EXG: Trimmed 49150 records to 32854 (keeping 200 days of data) [2025-10-29T18:41:33.036580] [DEBUG] [LOCAL ] EXG: Primary data saved (32854 records). [2025-10-29T18:41:33.036730] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-29T18:41:33.036825] [INFO ] [MAIN ] Update Progress: 798/2367 symbols completed. EXG took 29.4s. Estimated remaining: 3h 19m 35s. Rate: 7.9 symbols/min [2025-10-29T18:41:33.193525] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-29T18:41:33.716736] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T18:41:33.993551] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-29T18:41:35.450353] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T18:41:35.462962] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-29T18:41:36.743503] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T18:41:36.757197] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-29T18:41:37.279840] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (4.09 seconds). [2025-10-29T18:41:37.286517] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-29T18:41:38.348088] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-29T18:41:38.355868] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-29T18:41:38.443795] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-29T18:41:38.456525] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-29T18:41:39.244316] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:41:39.250870] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-29T18:41:40.157549] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T18:41:40.164110] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-29T18:41:40.268991] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-29T18:41:40.279928] [INFO ] [REMOTE ] EXK: Full fetch complete (76510 records). [2025-10-29T18:41:40.280080] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-29T18:41:40.280912] [FATAL] [VALIDATOR ] EXK: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:41:40.280999] [FATAL] [MAIN ] EXK: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:41:40.281041] [WARN ] [MAIN ] EXK: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:41:40.281085] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-29T18:41:40.281139] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-10-29T18:41:40.281173] [INFO ] [LOCAL ] EXK: Starting deletion of derivative data. [2025-10-29T18:41:40.281374] [DEBUG] [LOCAL ] EXK: Deleted derivative data file. [2025-10-29T18:41:40.282383] [INFO ] [MAIN ] Update Progress: 799/2367 symbols completed. EXK took 24.6s. Estimated remaining: 3h 19m 27s. Rate: 7.9 symbols/min [2025-10-29T18:41:41.213286] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-29T18:41:41.219873] [INFO ] [REMOTE ] EXP: Full fetch complete (42897 records). [2025-10-29T18:41:41.220075] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-29T18:41:41.604683] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-29T18:41:41.604770] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-29T18:41:41.605433] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-29T18:41:41.605471] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-29T18:41:41.609376] [DEBUG] [LOCAL ] EXP: Trimmed 42897 records to 28758 (keeping 200 days of data) [2025-10-29T18:41:41.788782] [DEBUG] [LOCAL ] EXP: Primary data saved (28758 records). [2025-10-29T18:41:41.788930] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-29T18:41:41.789040] [INFO ] [MAIN ] Update Progress: 800/2367 symbols completed. EXP took 21.2s. Estimated remaining: 3h 19m 7s. Rate: 7.9 symbols/min [2025-10-29T18:41:42.332201] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:41:42.454728] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:41:42.544183] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:41:42.545816] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:41:42.633411] [DEBUG] [LOCAL ] EXR: Loaded 45173 existing records from primary storage. [2025-10-29T18:41:42.636483] [DEBUG] [LOCAL ] FAF: Loaded 41201 existing records from primary storage. [2025-10-29T18:41:42.636906] [INFO ] [MAIN ] FAF: Loaded 41201 existing records. [2025-10-29T18:41:42.635420] [INFO ] [MAIN ] EXR: Loaded 45173 existing records. [2025-10-29T18:41:42.785282] [DEBUG] [LOCAL ] EXPD: Loaded 47457 existing records from primary storage. [2025-10-29T18:41:42.877039] [INFO ] [MAIN ] EXPD: Loaded 47457 existing records. [2025-10-29T18:41:42.886815] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-29T18:41:42.952761] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-29T18:41:43.175484] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:41:43.207333] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:41:43.223828] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-29T18:41:43.228617] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-29T18:41:43.254604] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-29T18:41:43.265372] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-29T18:41:43.292345] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-29T18:41:43.316163] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-29T18:41:43.331034] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-29T18:41:43.341369] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-29T18:41:43.497435] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:41:43.584852] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:41:43.614079] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-29T18:41:43.628573] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-29T18:41:43.663745] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-29T18:41:43.637586] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-29T18:41:43.684430] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-29T18:41:43.678748] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-29T18:41:43.846802] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-29T18:41:43.944059] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-29T18:41:44.427451] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:41:44.544608] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-29T18:41:44.673814] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:41:44.696886] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-29T18:41:45.040052] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:41:45.069250] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-29T18:41:45.073326] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:41:45.074628] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-29T18:41:45.849199] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T18:41:45.857742] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-29T18:41:46.018112] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T18:41:46.027509] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-29T18:41:46.260610] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T18:41:46.269998] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-29T18:41:46.952765] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-29T18:41:46.963943] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-29T18:41:46.985942] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:41:46.992786] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-29T18:41:47.141812] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:41:47.232691] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T18:41:47.593577] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-29T18:41:48.071636] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T18:41:48.393576] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-29T18:41:48.904005] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-29T18:41:49.066818] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T18:41:49.193556] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-29T18:41:49.470906] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-29T18:41:49.993626] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-29T18:41:50.331780] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T18:41:50.793763] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-29T18:41:51.335185] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T18:41:51.593546] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-29T18:41:52.393623] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-29T18:41:52.836507] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-29T18:41:52.923497] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T18:41:53.193556] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-29T18:41:53.993581] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-29T18:41:54.423182] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T18:41:54.793544] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-29T18:41:55.593552] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-29T18:41:55.902934] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T18:41:55.964936] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-29T18:41:56.393566] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-29T18:41:56.560119] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-29T18:41:57.193568] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-29T18:41:57.383732] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (4.99 seconds). [2025-10-29T18:41:57.993612] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-29T18:41:58.295102] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-29T18:41:58.793534] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-29T18:41:59.079976] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T18:41:59.593550] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-29T18:42:00.393579] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-29T18:42:00.783458] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-29T18:42:01.198803] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-29T18:42:01.230225] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-29T18:42:01.615232] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T18:42:01.993568] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-29T18:42:02.793615] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-29T18:42:03.151390] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (5.96 seconds). [2025-10-29T18:42:03.291243] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-29T18:42:03.346842] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T18:42:03.593566] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-29T18:42:04.093601] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T18:42:04.393553] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-29T18:42:04.964201] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-29T18:42:05.193565] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-29T18:42:05.812104] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T18:42:05.993564] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-29T18:42:06.793598] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-29T18:42:07.024043] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-29T18:42:07.060165] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T18:42:07.593586] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-29T18:42:07.928542] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T18:42:08.393563] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-29T18:42:09.193580] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-29T18:42:09.792529] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T18:42:09.802407] [INFO ] [REMOTE ] EXR: Full fetch complete (66044 records). [2025-10-29T18:42:09.802552] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-29T18:42:10.006057] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-29T18:42:10.209013] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-29T18:42:10.209098] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-29T18:42:10.209894] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-29T18:42:10.209958] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-29T18:42:10.211228] [DEBUG] [LOCAL ] EXR: Trimmed 66044 records to 45153 (keeping 200 days of data) [2025-10-29T18:42:10.496370] [DEBUG] [LOCAL ] EXR: Primary data saved (45153 records). [2025-10-29T18:42:10.496503] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-29T18:42:10.497576] [INFO ] [MAIN ] Update Progress: 801/2367 symbols completed. EXR took 28.7s. Estimated remaining: 3h 19m 41s. Rate: 7.8 symbols/min [2025-10-29T18:42:10.673516] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:42:10.724817] [DEBUG] [LOCAL ] FBIN: Loaded 50171 existing records from primary storage. [2025-10-29T18:42:10.725199] [INFO ] [MAIN ] FBIN: Loaded 50171 existing records. [2025-10-29T18:42:10.906980] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:42:10.907701] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-29T18:42:10.907762] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-29T18:42:10.907982] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-29T18:42:10.908040] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-29T18:42:11.267014] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:42:11.267433] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-29T18:42:11.393247] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-29T18:42:11.406854] [INFO ] [REMOTE ] EXPD: Full fetch complete (69199 records). [2025-10-29T18:42:11.407048] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-29T18:42:11.836634] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-29T18:42:11.836925] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-29T18:42:11.846089] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-29T18:42:11.846196] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-29T18:42:11.862312] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (3.47 seconds). [2025-10-29T18:42:11.870850] [DEBUG] [LOCAL ] EXPD: Trimmed 69199 records to 47368 (keeping 200 days of data) [2025-10-29T18:42:11.872019] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-29T18:42:12.155316] [DEBUG] [LOCAL ] EXPD: Primary data saved (47368 records). [2025-10-29T18:42:12.155438] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-29T18:42:12.155512] [INFO ] [MAIN ] Update Progress: 802/2367 symbols completed. EXPD took 30.4s. Estimated remaining: 3h 19m 21s. Rate: 7.9 symbols/min [2025-10-29T18:42:12.330833] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:42:12.358050] [DEBUG] [LOCAL ] FBK: Loaded 27079 existing records from primary storage. [2025-10-29T18:42:12.358397] [INFO ] [MAIN ] FBK: Loaded 27079 existing records. [2025-10-29T18:42:12.547609] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:42:12.547885] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-29T18:42:12.548023] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-29T18:42:12.548406] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-29T18:42:12.548481] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-29T18:42:12.830390] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-29T18:42:12.860623] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-29T18:42:12.964264] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:42:13.035633] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (5.44 seconds). [2025-10-29T18:42:13.073215] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T18:42:13.082509] [INFO ] [REMOTE ] FAF: Full fetch complete (58422 records). [2025-10-29T18:42:13.082705] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-29T18:42:13.198747] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-29T18:42:13.480607] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-29T18:42:13.480725] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-29T18:42:13.481459] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-29T18:42:13.481500] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-29T18:42:13.482760] [DEBUG] [LOCAL ] FAF: Trimmed 58422 records to 41147 (keeping 200 days of data) [2025-10-29T18:42:13.726664] [DEBUG] [LOCAL ] FAF: Primary data saved (41147 records). [2025-10-29T18:42:13.726792] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-29T18:42:13.726870] [INFO ] [MAIN ] Update Progress: 803/2367 symbols completed. FAF took 31.9s. Estimated remaining: 3h 19m 2s. Rate: 7.9 symbols/min [2025-10-29T18:42:13.911528] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:42:13.950236] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-29T18:42:13.963087] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-29T18:42:13.963359] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-29T18:42:13.995903] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-29T18:42:14.251612] [DEBUG] [LOCAL ] FBP: Loaded 45412 existing records from primary storage. [2025-10-29T18:42:14.282758] [INFO ] [MAIN ] FBP: Loaded 45412 existing records. [2025-10-29T18:42:14.298009] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T18:42:14.706924] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:42:14.707717] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-29T18:42:14.707542] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-29T18:42:14.707998] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-29T18:42:14.708073] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-29T18:42:14.709271] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-29T18:42:14.709322] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-29T18:42:14.709534] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-29T18:42:14.709696] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-29T18:42:14.786290] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-29T18:42:14.809631] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-29T18:42:15.084141] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T18:42:15.452158] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:42:15.477143] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-29T18:42:15.477290] [INFO ] [MAIN ] F: Full history saved. [2025-10-29T18:42:15.477372] [INFO ] [MAIN ] Update Progress: 804/2367 symbols completed. F took 33.7s. Estimated remaining: 3h 18m 43s. Rate: 7.9 symbols/min [2025-10-29T18:42:15.598730] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-29T18:42:15.656346] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:42:15.690087] [DEBUG] [LOCAL ] FBRT: Loaded 34679 existing records from primary storage. [2025-10-29T18:42:15.690355] [INFO ] [MAIN ] FBRT: Loaded 34679 existing records. [2025-10-29T18:42:15.899974] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:42:15.900163] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-29T18:42:15.900228] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-29T18:42:15.900396] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-29T18:42:15.900436] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-29T18:42:16.263582] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:42:16.292209] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T18:42:16.393580] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-29T18:42:16.944789] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T18:42:17.035580] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T18:42:17.193571] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-29T18:42:17.993575] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-29T18:42:18.368842] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T18:42:18.614060] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-29T18:42:18.793599] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-29T18:42:19.593556] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-29T18:42:19.851417] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T18:42:20.340684] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-29T18:42:20.393599] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-29T18:42:21.193574] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-29T18:42:21.646552] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T18:42:21.883572] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-29T18:42:21.993593] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-29T18:42:22.793581] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-29T18:42:23.087914] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T18:42:23.593554] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-29T18:42:24.108576] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T18:42:24.345205] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T18:42:24.393570] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-29T18:42:25.193604] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-29T18:42:25.333679] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T18:42:25.993601] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-29T18:42:26.286694] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T18:42:26.793614] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-29T18:42:27.418964] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T18:42:27.593546] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-29T18:42:27.983329] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T18:42:28.393626] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-29T18:42:28.840834] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T18:42:29.193613] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-29T18:42:29.474057] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T18:42:29.942944] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-29T18:42:29.993569] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-29T18:42:30.793545] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-29T18:42:30.976052] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T18:42:31.592865] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T18:42:31.597665] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-29T18:42:32.393560] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-29T18:42:32.926405] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T18:42:33.193526] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-29T18:42:33.378156] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-29T18:42:33.993527] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-29T18:42:34.162166] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-29T18:42:34.650318] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T18:42:34.793527] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-29T18:42:35.593549] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-29T18:42:35.750387] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-29T18:42:36.393607] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-29T18:42:36.673752] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T18:42:37.193546] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-29T18:42:37.333177] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-29T18:42:37.993634] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-29T18:42:38.793634] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-29T18:42:39.010252] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T18:42:39.018936] [INFO ] [REMOTE ] FBRT: Full fetch complete (49480 records). [2025-10-29T18:42:39.019099] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-29T18:42:39.410147] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-29T18:42:39.410235] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-29T18:42:39.410932] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-29T18:42:39.410996] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-29T18:42:39.412088] [DEBUG] [LOCAL ] FBRT: Trimmed 49480 records to 34662 (keeping 200 days of data) [2025-10-29T18:42:39.596416] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-29T18:42:39.628315] [DEBUG] [LOCAL ] FBRT: Primary data saved (34662 records). [2025-10-29T18:42:39.629575] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-29T18:42:39.629730] [INFO ] [MAIN ] Update Progress: 805/2367 symbols completed. FBRT took 24.2s. Estimated remaining: 3h 19m 7s. Rate: 7.8 symbols/min [2025-10-29T18:42:39.737358] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-29T18:42:39.843055] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:42:39.859201] [DEBUG] [LOCAL ] FC: Loaded 13903 existing records from primary storage. [2025-10-29T18:42:39.859461] [INFO ] [MAIN ] FC: Loaded 13903 existing records. [2025-10-29T18:42:40.043248] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:42:40.043591] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-29T18:42:40.043803] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-29T18:42:40.044027] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-29T18:42:40.044098] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-29T18:42:40.397854] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-29T18:42:40.435231] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:42:40.442240] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-29T18:42:40.978266] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T18:42:41.193591] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-29T18:42:41.993585] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-29T18:42:42.479611] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T18:42:42.489584] [INFO ] [REMOTE ] FBP: Full fetch complete (66807 records). [2025-10-29T18:42:42.489767] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-29T18:42:42.798199] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-29T18:42:42.904748] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-29T18:42:42.905568] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-29T18:42:42.906573] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-29T18:42:42.905488] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-29T18:42:42.906684] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-29T18:42:42.911492] [DEBUG] [LOCAL ] FBP: Trimmed 66807 records to 45384 (keeping 200 days of data) [2025-10-29T18:42:43.174543] [DEBUG] [LOCAL ] FBP: Primary data saved (45384 records). [2025-10-29T18:42:43.174697] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-29T18:42:43.174785] [INFO ] [MAIN ] Update Progress: 806/2367 symbols completed. FBP took 29.4s. Estimated remaining: 3h 18m 52s. Rate: 7.8 symbols/min [2025-10-29T18:42:43.339292] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:42:43.374477] [DEBUG] [LOCAL ] FCF: Loaded 38576 existing records from primary storage. [2025-10-29T18:42:43.374776] [INFO ] [MAIN ] FCF: Loaded 38576 existing records. [2025-10-29T18:42:43.547810] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:42:43.548037] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-29T18:42:43.548084] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-29T18:42:43.548259] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-29T18:42:43.548296] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-29T18:42:43.610731] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-29T18:42:43.848871] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (3.45 seconds). [2025-10-29T18:42:43.877494] [INFO ] [REMOTE ] FBK: Full fetch complete (35654 records). [2025-10-29T18:42:43.910012] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-29T18:42:43.971676] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:42:44.332826] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-29T18:42:44.333050] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-29T18:42:44.333621] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-29T18:42:44.342247] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-29T18:42:44.343572] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-29T18:42:44.347858] [DEBUG] [LOCAL ] FBK: Trimmed 35654 records to 27011 (keeping 200 days of data) [2025-10-29T18:42:44.397429] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-29T18:42:44.504582] [DEBUG] [LOCAL ] FBK: Primary data saved (27011 records). [2025-10-29T18:42:44.504730] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-29T18:42:44.504816] [INFO ] [MAIN ] Update Progress: 807/2367 symbols completed. FBK took 32.3s. Estimated remaining: 3h 18m 32s. Rate: 7.9 symbols/min [2025-10-29T18:42:44.670761] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:42:44.695148] [DEBUG] [LOCAL ] FCN: Loaded 25819 existing records from primary storage. [2025-10-29T18:42:44.695383] [INFO ] [MAIN ] FCN: Loaded 25819 existing records. [2025-10-29T18:42:44.869715] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:42:44.869931] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-29T18:42:44.869986] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-29T18:42:44.870458] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-29T18:42:44.870513] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-29T18:42:45.196691] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-29T18:42:45.237445] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:42:45.238677] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-29T18:42:45.993546] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-29T18:42:46.468948] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:42:46.726155] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-29T18:42:46.793569] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-29T18:42:47.593530] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-29T18:42:47.638258] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-29T18:42:48.393550] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-29T18:42:48.495748] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T18:42:48.986389] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (6.19 seconds). [2025-10-29T18:42:49.193583] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-29T18:42:49.381236] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T18:42:49.986253] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-29T18:42:49.995098] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-29T18:42:50.793606] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-29T18:42:51.307623] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T18:42:51.593542] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-29T18:42:51.835314] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-29T18:42:52.393577] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-29T18:42:53.193593] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-29T18:42:53.465815] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-29T18:42:53.476209] [INFO ] [REMOTE ] FBIN: Full fetch complete (72813 records). [2025-10-29T18:42:53.476388] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-29T18:42:53.886609] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-29T18:42:53.886725] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-29T18:42:53.887580] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-29T18:42:53.887621] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-29T18:42:53.889279] [DEBUG] [LOCAL ] FBIN: Trimmed 72813 records to 50142 (keeping 200 days of data) [2025-10-29T18:42:53.995877] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-29T18:42:54.212322] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-29T18:42:54.231674] [DEBUG] [LOCAL ] FBIN: Primary data saved (50142 records). [2025-10-29T18:42:54.231844] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-29T18:42:54.231977] [INFO ] [MAIN ] Update Progress: 808/2367 symbols completed. FBIN took 43.7s. Estimated remaining: 3h 18m 28s. Rate: 7.9 symbols/min [2025-10-29T18:42:54.414527] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:42:54.445392] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-29T18:42:54.483252] [DEBUG] [LOCAL ] FCPT: Loaded 36533 existing records from primary storage. [2025-10-29T18:42:54.483520] [INFO ] [MAIN ] FCPT: Loaded 36533 existing records. [2025-10-29T18:42:54.667016] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:42:54.673403] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-29T18:42:54.673671] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-29T18:42:54.675114] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-29T18:42:54.675156] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-29T18:42:54.677966] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-29T18:42:54.800725] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-29T18:42:55.076059] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:42:55.371168] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-29T18:42:55.593542] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-29T18:42:56.339342] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T18:42:56.393561] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-29T18:42:56.970413] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-29T18:42:57.193607] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-29T18:42:57.993556] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-29T18:42:58.243623] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T18:42:58.623226] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T18:42:58.793553] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-29T18:42:59.593583] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-29T18:43:00.393561] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-29T18:43:01.193549] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-29T18:43:01.403086] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T18:43:01.406730] [INFO ] [REMOTE ] FC: Full fetch complete (21676 records). [2025-10-29T18:43:01.416713] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-29T18:43:01.502912] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-29T18:43:01.830836] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-29T18:43:01.830922] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-29T18:43:01.831390] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-29T18:43:01.831429] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-29T18:43:01.832426] [DEBUG] [LOCAL ] FC: Trimmed 21676 records to 13843 (keeping 200 days of data) [2025-10-29T18:43:01.912524] [DEBUG] [LOCAL ] FC: Primary data saved (13843 records). [2025-10-29T18:43:01.912691] [INFO ] [MAIN ] FC: Full history saved. [2025-10-29T18:43:01.912790] [INFO ] [MAIN ] Update Progress: 809/2367 symbols completed. FC took 22.3s. Estimated remaining: 3h 18m 21s. Rate: 7.9 symbols/min [2025-10-29T18:43:01.998564] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-29T18:43:02.098103] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:43:02.098268] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-29T18:43:02.098307] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-29T18:43:02.098415] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-29T18:43:02.098456] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-29T18:43:02.098498] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-29T18:43:02.098530] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-29T18:43:02.398535] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (3.60 seconds). [2025-10-29T18:43:02.505313] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:43:02.540236] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T18:43:02.793552] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-29T18:43:03.018804] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-29T18:43:03.291625] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-29T18:43:03.593603] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-29T18:43:04.393535] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-29T18:43:04.595704] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T18:43:05.193615] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-29T18:43:05.437493] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T18:43:05.993570] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-29T18:43:06.076333] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T18:43:06.793556] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-29T18:43:07.055396] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-29T18:43:07.548240] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T18:43:07.593583] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-29T18:43:08.393610] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-29T18:43:08.759358] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T18:43:09.193633] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-29T18:43:09.631926] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T18:43:09.993605] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-29T18:43:10.249518] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-29T18:43:10.315419] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-29T18:43:10.793575] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-29T18:43:11.573998] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T18:43:11.593527] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-29T18:43:12.393522] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-29T18:43:12.593487] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-29T18:43:12.599841] [INFO ] [REMOTE ] FCN: Full fetch complete (36945 records). [2025-10-29T18:43:12.599974] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-29T18:43:12.979434] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-29T18:43:12.979509] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-29T18:43:12.980092] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-29T18:43:12.980151] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-29T18:43:12.980911] [DEBUG] [LOCAL ] FCN: Trimmed 36945 records to 25831 (keeping 200 days of data) [2025-10-29T18:43:13.133895] [DEBUG] [LOCAL ] FCN: Primary data saved (25831 records). [2025-10-29T18:43:13.134034] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-29T18:43:13.134116] [INFO ] [MAIN ] Update Progress: 810/2367 symbols completed. FCN took 28.6s. Estimated remaining: 3h 18m 20s. Rate: 7.9 symbols/min [2025-10-29T18:43:13.201839] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-29T18:43:13.322104] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:43:13.336732] [DEBUG] [LOCAL ] FCT: Loaded 14513 existing records from primary storage. [2025-10-29T18:43:13.336999] [INFO ] [MAIN ] FCT: Loaded 14513 existing records. [2025-10-29T18:43:13.543195] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:43:13.543595] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-29T18:43:13.543688] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-29T18:43:13.544110] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-29T18:43:13.563670] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-29T18:43:13.570591] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T18:43:13.919047] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:43:13.993542] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-29T18:43:14.603973] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T18:43:14.612227] [INFO ] [REMOTE ] FCF: Full fetch complete (57602 records). [2025-10-29T18:43:14.612373] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-29T18:43:14.613011] [FATAL] [VALIDATOR ] FCF: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:43:14.613095] [FATAL] [MAIN ] FCF: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:43:14.613136] [WARN ] [MAIN ] FCF: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:43:14.613174] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-29T18:43:14.613242] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-29T18:43:14.613276] [INFO ] [LOCAL ] FCF: Starting deletion of derivative data. [2025-10-29T18:43:14.613450] [DEBUG] [LOCAL ] FCF: Deleted derivative data file. [2025-10-29T18:43:14.613538] [INFO ] [MAIN ] Update Progress: 811/2367 symbols completed. FCF took 31.4s. Estimated remaining: 3h 18m 0s. Rate: 7.9 symbols/min [2025-10-29T18:43:14.788937] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:43:14.804141] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-29T18:43:14.806775] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-29T18:43:14.856864] [DEBUG] [LOCAL ] FCX: Loaded 53702 existing records from primary storage. [2025-10-29T18:43:14.857206] [INFO ] [MAIN ] FCX: Loaded 53702 existing records. [2025-10-29T18:43:15.035627] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:43:15.035957] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-29T18:43:15.036007] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-29T18:43:15.036915] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-29T18:43:15.036972] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-29T18:43:15.141108] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-29T18:43:15.396637] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:43:15.593548] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-29T18:43:16.393618] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-29T18:43:17.205270] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-29T18:43:17.229208] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-29T18:43:17.265811] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T18:43:17.809708] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-29T18:43:17.993560] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-29T18:43:18.268015] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-29T18:43:18.793585] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-29T18:43:19.593550] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-29T18:43:19.885277] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T18:43:20.026549] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-29T18:43:20.393562] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-29T18:43:21.193617] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-29T18:43:21.836592] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T18:43:21.945450] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T18:43:21.993595] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-29T18:43:22.793604] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-29T18:43:23.593568] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-29T18:43:23.801279] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-29T18:43:23.854414] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-29T18:43:23.892165] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T18:43:24.393585] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-29T18:43:25.193562] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-29T18:43:25.857739] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-29T18:43:25.993577] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-29T18:43:26.250382] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-29T18:43:26.434549] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-29T18:43:26.793568] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-29T18:43:27.260261] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-29T18:43:27.593560] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-29T18:43:28.393565] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-29T18:43:28.665728] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-29T18:43:28.886486] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T18:43:28.894445] [INFO ] [REMOTE ] FCPT: Full fetch complete (53801 records). [2025-10-29T18:43:28.894595] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-29T18:43:29.198724] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-29T18:43:29.288308] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-29T18:43:29.288395] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-29T18:43:29.289136] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-29T18:43:29.289199] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-29T18:43:29.290348] [DEBUG] [LOCAL ] FCPT: Trimmed 53801 records to 36500 (keeping 200 days of data) [2025-10-29T18:43:29.507465] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:43:29.511983] [DEBUG] [LOCAL ] FCPT: Primary data saved (36500 records). [2025-10-29T18:43:29.513422] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-29T18:43:29.513529] [INFO ] [MAIN ] Update Progress: 812/2367 symbols completed. FCPT took 35.3s. Estimated remaining: 3h 18m 7s. Rate: 7.8 symbols/min [2025-10-29T18:43:29.680498] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:43:29.708022] [DEBUG] [LOCAL ] FDP: Loaded 29373 existing records from primary storage. [2025-10-29T18:43:29.708279] [INFO ] [MAIN ] FDP: Loaded 29373 existing records. [2025-10-29T18:43:29.880856] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:43:29.881081] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-29T18:43:29.881128] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-29T18:43:29.881677] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-29T18:43:29.881737] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-29T18:43:29.998768] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-29T18:43:30.232885] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:43:30.793624] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-29T18:43:31.593538] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-29T18:43:31.646429] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-29T18:43:31.675446] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T18:43:31.889527] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T18:43:32.393605] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-29T18:43:33.193636] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-29T18:43:33.819734] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T18:43:33.993574] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-29T18:43:34.084061] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-29T18:43:34.689243] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-29T18:43:34.793600] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-29T18:43:35.098025] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-29T18:43:35.098742] [INFO ] [REMOTE ] FCRX: Full fetch complete (1619 records). [2025-10-29T18:43:35.098811] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-29T18:43:35.288007] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-29T18:43:35.288346] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:43:35.288448] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:43:35.288523] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-29T18:43:35.288588] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-29T18:43:35.288625] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-29T18:43:35.288711] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-29T18:43:35.288780] [INFO ] [MAIN ] Update Progress: 813/2367 symbols completed. FCRX took 33.4s. Estimated remaining: 3h 17m 55s. Rate: 7.9 symbols/min [2025-10-29T18:43:35.465724] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:43:35.492376] [DEBUG] [LOCAL ] FDS: Loaded 28214 existing records from primary storage. [2025-10-29T18:43:35.492671] [INFO ] [MAIN ] FDS: Loaded 28214 existing records. [2025-10-29T18:43:35.598763] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-29T18:43:35.682672] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:43:35.682902] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-29T18:43:35.682950] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-29T18:43:35.683604] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-29T18:43:35.683701] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-29T18:43:36.052879] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:43:36.393552] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-29T18:43:36.533773] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T18:43:37.193612] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-29T18:43:37.993537] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-29T18:43:38.126979] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-29T18:43:38.634757] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T18:43:38.793620] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-29T18:43:39.457999] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T18:43:39.593575] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-29T18:43:40.393608] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-29T18:43:41.193561] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-29T18:43:41.471549] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (5.08 seconds). [2025-10-29T18:43:41.499720] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T18:43:41.993551] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-29T18:43:42.310866] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T18:43:42.794674] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-29T18:43:42.797616] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (3.20 seconds). [2025-10-29T18:43:42.803121] [INFO ] [REMOTE ] FCT: Full fetch complete (21307 records). [2025-10-29T18:43:42.803291] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-29T18:43:42.850856] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T18:43:43.199032] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-29T18:43:43.199107] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-29T18:43:43.199554] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-29T18:43:43.199593] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-29T18:43:43.200177] [DEBUG] [LOCAL ] FCT: Trimmed 21307 records to 14480 (keeping 200 days of data) [2025-10-29T18:43:43.282879] [DEBUG] [LOCAL ] FCT: Primary data saved (14480 records). [2025-10-29T18:43:43.283005] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-29T18:43:43.283080] [INFO ] [MAIN ] Update Progress: 814/2367 symbols completed. FCT took 30.1s. Estimated remaining: 3h 17m 49s. Rate: 7.9 symbols/min [2025-10-29T18:43:43.455352] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:43:43.455556] [DEBUG] [LOCAL ] FDX: No existing data file found in primary storage. [2025-10-29T18:43:43.455603] [WARN ] [MAIN ] FDX: No existing data found, performing full refresh instead. [2025-10-29T18:43:43.455755] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-29T18:43:43.455797] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-29T18:43:43.455840] [DEBUG] [LOCAL ] FDX: No primary data file found to delete. [2025-10-29T18:43:43.455872] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-29T18:43:43.600124] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-29T18:43:43.819136] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:43:44.393519] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-29T18:43:44.461381] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T18:43:44.602256] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-29T18:43:45.193611] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-29T18:43:45.823345] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T18:43:45.993532] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-29T18:43:46.043544] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-29T18:43:46.793608] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-29T18:43:47.217197] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T18:43:47.593571] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-29T18:43:47.682958] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T18:43:48.393559] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-29T18:43:48.427444] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-29T18:43:49.193571] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-29T18:43:49.933688] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-29T18:43:49.993524] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-29T18:43:50.082470] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T18:43:50.793601] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-29T18:43:51.593575] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-29T18:43:51.742345] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T18:43:52.071331] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-29T18:43:52.082860] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-29T18:43:52.083015] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-29T18:43:52.398732] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-29T18:43:52.510348] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-29T18:43:52.510462] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-29T18:43:52.511722] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-29T18:43:52.511848] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-29T18:43:52.513597] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53702 (keeping 200 days of data) [2025-10-29T18:43:52.628299] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T18:43:52.873357] [DEBUG] [LOCAL ] FCX: Primary data saved (53702 records). [2025-10-29T18:43:52.873499] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-29T18:43:52.873577] [INFO ] [MAIN ] Update Progress: 815/2367 symbols completed. FCX took 38.3s. Estimated remaining: 3h 17m 45s. Rate: 7.8 symbols/min [2025-10-29T18:43:53.050295] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:43:53.096802] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-29T18:43:53.097189] [INFO ] [MAIN ] FE: Loaded 53430 existing records. [2025-10-29T18:43:53.198684] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-29T18:43:53.283612] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:43:53.284401] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-29T18:43:53.284524] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-29T18:43:53.285773] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-29T18:43:53.285832] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-29T18:43:53.675213] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:43:53.676588] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T18:43:53.993563] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-29T18:43:54.237992] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-29T18:43:54.793571] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-29T18:43:55.156307] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:43:55.593573] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-29T18:43:55.680840] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:43:56.393618] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-29T18:43:56.944222] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T18:43:56.957288] [INFO ] [REMOTE ] FDS: Full fetch complete (39626 records). [2025-10-29T18:43:56.957484] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-29T18:43:56.958293] [FATAL] [VALIDATOR ] FDS: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:43:56.958402] [FATAL] [MAIN ] FDS: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:43:56.958461] [WARN ] [MAIN ] FDS: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:43:56.958523] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-29T18:43:56.958606] [DEBUG] [LOCAL ] FDS: No primary data file found to delete. [2025-10-29T18:43:56.958695] [INFO ] [LOCAL ] FDS: Starting deletion of derivative data. [2025-10-29T18:43:56.958956] [DEBUG] [LOCAL ] FDS: Deleted derivative data file. [2025-10-29T18:43:56.959073] [INFO ] [MAIN ] Update Progress: 816/2367 symbols completed. FDS took 21.7s. Estimated remaining: 3h 17m 30s. Rate: 7.9 symbols/min [2025-10-29T18:43:57.194681] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-29T18:43:57.194583] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:43:57.195222] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-29T18:43:57.196400] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-29T18:43:57.196813] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-29T18:43:57.196859] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-29T18:43:57.196902] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-29T18:43:57.196934] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-29T18:43:57.403405] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T18:43:57.617630] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:43:57.993560] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-29T18:43:58.411227] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-29T18:43:58.794876] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-29T18:43:58.803757] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-29T18:43:59.080160] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-29T18:43:59.593595] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-29T18:43:59.906752] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-29T18:44:00.393565] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-29T18:44:00.941993] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-29T18:44:01.193566] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-29T18:44:01.993597] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-29T18:44:02.316454] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-29T18:44:02.793582] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-29T18:44:03.067360] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-29T18:44:03.593622] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-29T18:44:03.691415] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T18:44:03.697298] [INFO ] [REMOTE ] FDP: Full fetch complete (42846 records). [2025-10-29T18:44:03.697426] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-29T18:44:03.817338] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-29T18:44:04.093770] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-29T18:44:04.093846] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-29T18:44:04.094505] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-29T18:44:04.094568] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-29T18:44:04.095457] [DEBUG] [LOCAL ] FDP: Trimmed 42846 records to 29454 (keeping 200 days of data) [2025-10-29T18:44:04.268896] [DEBUG] [LOCAL ] FDP: Primary data saved (29454 records). [2025-10-29T18:44:04.269035] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-29T18:44:04.269119] [INFO ] [MAIN ] Update Progress: 817/2367 symbols completed. FDP took 34.8s. Estimated remaining: 3h 17m 22s. Rate: 7.9 symbols/min [2025-10-29T18:44:04.405090] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-29T18:44:04.436203] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:44:04.478355] [DEBUG] [LOCAL ] FERG: Loaded 48558 existing records from primary storage. [2025-10-29T18:44:04.478688] [INFO ] [MAIN ] FERG: Loaded 48558 existing records. [2025-10-29T18:44:04.649942] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:44:04.650159] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-29T18:44:04.650225] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-29T18:44:04.651116] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-29T18:44:04.651173] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-29T18:44:05.025612] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:44:05.193552] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-29T18:44:05.839041] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T18:44:05.993612] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-29T18:44:06.425841] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:44:06.793611] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-29T18:44:07.050147] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-29T18:44:07.431306] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-29T18:44:07.593569] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-29T18:44:07.826779] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-29T18:44:08.393574] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-29T18:44:08.790154] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T18:44:09.193563] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-29T18:44:09.622758] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T18:44:09.623561] [INFO ] [REMOTE ] FENG: Full fetch complete (2260 records). [2025-10-29T18:44:09.623626] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-29T18:44:09.796681] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-29T18:44:09.796867] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:44:09.796935] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:44:09.797004] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-29T18:44:09.797065] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-29T18:44:09.797100] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-29T18:44:09.797138] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-29T18:44:09.797191] [INFO ] [MAIN ] Update Progress: 818/2367 symbols completed. FENG took 12.8s. Estimated remaining: 3h 17m 10s. Rate: 7.9 symbols/min [2025-10-29T18:44:09.962847] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:44:09.975949] [DEBUG] [LOCAL ] FET: Loaded 12901 existing records from primary storage. [2025-10-29T18:44:09.976171] [INFO ] [MAIN ] FET: Loaded 12901 existing records. [2025-10-29T18:44:10.000377] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-29T18:44:10.173041] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:44:10.173255] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-29T18:44:10.173302] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-29T18:44:10.173679] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-29T18:44:10.173738] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-29T18:44:10.521689] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:44:10.793556] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-29T18:44:11.367357] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T18:44:11.593555] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-29T18:44:12.085630] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T18:44:12.126044] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-29T18:44:12.393603] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-29T18:44:13.193622] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-29T18:44:13.664677] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T18:44:13.993574] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-29T18:44:14.166012] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T18:44:14.793571] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-29T18:44:15.307979] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T18:44:15.541360] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-29T18:44:15.593565] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-29T18:44:16.393809] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-29T18:44:16.950268] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T18:44:17.193590] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-29T18:44:17.687975] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T18:44:17.772536] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T18:44:17.993618] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-29T18:44:18.793634] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-29T18:44:19.430973] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:44:19.593598] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-29T18:44:19.989115] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T18:44:20.393620] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-29T18:44:20.722628] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T18:44:21.193635] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-29T18:44:21.757430] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-29T18:44:21.790956] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T18:44:21.993576] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-29T18:44:22.793561] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-29T18:44:23.371362] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T18:44:23.593616] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-29T18:44:24.170271] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T18:44:24.393544] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-29T18:44:24.969073] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T18:44:25.193556] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-29T18:44:25.539485] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T18:44:25.993573] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-29T18:44:26.258832] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T18:44:26.793586] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-29T18:44:27.593621] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-29T18:44:27.736737] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-29T18:44:28.314520] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-29T18:44:28.393589] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-29T18:44:28.773015] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T18:44:29.193603] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-29T18:44:29.950494] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T18:44:29.961937] [INFO ] [REMOTE ] FE: Full fetch complete (77497 records). [2025-10-29T18:44:29.962062] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-29T18:44:29.998673] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-29T18:44:30.361362] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T18:44:30.386623] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-29T18:44:30.386989] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-29T18:44:30.387956] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-29T18:44:30.388018] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-29T18:44:30.389307] [DEBUG] [LOCAL ] FE: Trimmed 77497 records to 53430 (keeping 200 days of data) [2025-10-29T18:44:30.712763] [DEBUG] [LOCAL ] FE: Primary data saved (53430 records). [2025-10-29T18:44:30.712933] [INFO ] [MAIN ] FE: Full history saved. [2025-10-29T18:44:30.713058] [INFO ] [MAIN ] Update Progress: 819/2367 symbols completed. FE took 37.8s. Estimated remaining: 3h 17m 28s. Rate: 7.8 symbols/min [2025-10-29T18:44:30.802097] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-29T18:44:30.880721] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:44:30.899838] [DEBUG] [LOCAL ] FF: Loaded 23037 existing records from primary storage. [2025-10-29T18:44:30.900062] [INFO ] [MAIN ] FF: Loaded 23037 existing records. [2025-10-29T18:44:31.073207] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:44:31.073413] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-29T18:44:31.073459] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-29T18:44:31.073908] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-29T18:44:31.073965] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-29T18:44:31.425602] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:44:31.509263] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-29T18:44:31.593540] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-29T18:44:32.373997] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-29T18:44:32.397239] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-29T18:44:32.401719] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-29T18:44:33.193559] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-29T18:44:33.946972] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-29T18:44:33.957274] [INFO ] [REMOTE ] FDX: Full fetch complete (74086 records). [2025-10-29T18:44:33.957396] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-29T18:44:34.001564] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-29T18:44:34.361072] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-29T18:44:34.361178] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-29T18:44:34.362132] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-29T18:44:34.362217] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-29T18:44:34.363814] [DEBUG] [LOCAL ] FDX: Trimmed 74086 records to 50976 (keeping 200 days of data) [2025-10-29T18:44:34.706896] [DEBUG] [LOCAL ] FDX: Primary data saved (50976 records). [2025-10-29T18:44:34.707592] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-29T18:44:34.708868] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T18:44:34.718567] [INFO ] [MAIN ] Update Progress: 820/2367 symbols completed. FDX took 51.4s. Estimated remaining: 3h 17m 13s. Rate: 7.8 symbols/min [2025-10-29T18:44:34.749918] [INFO ] [REMOTE ] FERG: Full fetch complete (70800 records). [2025-10-29T18:44:34.786036] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-29T18:44:34.815059] [FATAL] [VALIDATOR ] FERG: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:44:34.809061] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-29T18:44:34.831941] [FATAL] [MAIN ] FERG: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:44:34.842527] [WARN ] [MAIN ] FERG: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:44:34.855899] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-29T18:44:34.856750] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-10-29T18:44:34.867350] [INFO ] [LOCAL ] FERG: Starting deletion of derivative data. [2025-10-29T18:44:34.903352] [DEBUG] [LOCAL ] FERG: Deleted derivative data file. [2025-10-29T18:44:34.931304] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:44:34.932367] [INFO ] [MAIN ] Update Progress: 821/2367 symbols completed. FERG took 30.7s. Estimated remaining: 3h 16m 52s. Rate: 7.9 symbols/min [2025-10-29T18:44:34.977964] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T18:44:34.987101] [DEBUG] [LOCAL ] FFA: Loaded 5236 existing records from primary storage. [2025-10-29T18:44:34.994193] [INFO ] [MAIN ] FFA: Loaded 5236 existing records. [2025-10-29T18:44:35.351237] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:44:35.357206] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:44:35.357617] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-29T18:44:35.357782] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-29T18:44:35.358520] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-29T18:44:35.358586] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-29T18:44:35.549747] [DEBUG] [LOCAL ] FFC: Loaded 16268 existing records from primary storage. [2025-10-29T18:44:35.588060] [INFO ] [MAIN ] FFC: Loaded 16268 existing records. [2025-10-29T18:44:35.594718] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-29T18:44:35.884165] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:44:35.879694] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T18:44:35.926162] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:44:35.926330] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-29T18:44:35.926378] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-29T18:44:35.926805] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-29T18:44:35.926873] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-29T18:44:36.272189] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:44:36.393567] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-29T18:44:36.684496] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T18:44:37.193570] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-29T18:44:37.453303] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T18:44:37.720556] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T18:44:37.993554] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-29T18:44:38.707808] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T18:44:38.793593] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-29T18:44:39.390073] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T18:44:39.593544] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-29T18:44:39.961881] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T18:44:40.393577] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-29T18:44:41.001970] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-29T18:44:41.193569] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-29T18:44:41.901634] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T18:44:41.993567] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-29T18:44:42.621023] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T18:44:42.793566] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-29T18:44:43.396173] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-29T18:44:43.593558] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-29T18:44:44.295174] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T18:44:44.393520] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-29T18:44:45.151375] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T18:44:45.155042] [INFO ] [REMOTE ] FET: Full fetch complete (18740 records). [2025-10-29T18:44:45.155118] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-29T18:44:45.198678] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-29T18:44:45.507548] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-29T18:44:45.507621] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-29T18:44:45.508099] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-29T18:44:45.508152] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-29T18:44:45.508706] [DEBUG] [LOCAL ] FET: Trimmed 18740 records to 13007 (keeping 200 days of data) [2025-10-29T18:44:45.581856] [DEBUG] [LOCAL ] FET: Primary data saved (13007 records). [2025-10-29T18:44:45.581974] [INFO ] [MAIN ] FET: Full history saved. [2025-10-29T18:44:45.582048] [INFO ] [MAIN ] Update Progress: 822/2367 symbols completed. FET took 35.8s. Estimated remaining: 3h 16m 50s. Rate: 7.8 symbols/min [2025-10-29T18:44:45.697880] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-29T18:44:45.759723] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:44:45.790496] [DEBUG] [LOCAL ] FFWM: Loaded 35414 existing records from primary storage. [2025-10-29T18:44:45.790785] [INFO ] [MAIN ] FFWM: Loaded 35414 existing records. [2025-10-29T18:44:45.963553] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:44:45.963786] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-29T18:44:45.963841] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-29T18:44:45.964382] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-29T18:44:45.964438] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-29T18:44:45.998745] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-29T18:44:46.323960] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:44:46.779182] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T18:44:46.793522] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-29T18:44:47.515583] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-29T18:44:47.593525] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-29T18:44:48.322582] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T18:44:48.393542] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-29T18:44:49.120618] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-29T18:44:49.127069] [INFO ] [REMOTE ] FFC: Full fetch complete (24465 records). [2025-10-29T18:44:49.127330] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-29T18:44:49.198954] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-29T18:44:49.680485] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-29T18:44:49.680609] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-29T18:44:49.681314] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-29T18:44:49.681384] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-29T18:44:49.682451] [DEBUG] [LOCAL ] FFC: Trimmed 24465 records to 16185 (keeping 200 days of data) [2025-10-29T18:44:49.782457] [DEBUG] [LOCAL ] FFC: Primary data saved (16185 records). [2025-10-29T18:44:49.782605] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-29T18:44:49.782712] [INFO ] [MAIN ] Update Progress: 823/2367 symbols completed. FFC took 14.8s. Estimated remaining: 3h 16m 35s. Rate: 7.9 symbols/min [2025-10-29T18:44:49.967086] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:44:49.986516] [DEBUG] [LOCAL ] FG: Loaded 20582 existing records from primary storage. [2025-10-29T18:44:49.986797] [INFO ] [MAIN ] FG: Loaded 20582 existing records. [2025-10-29T18:44:49.998999] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-29T18:44:50.201164] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:44:50.201370] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-29T18:44:50.201422] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-29T18:44:50.201870] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-29T18:44:50.201967] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-29T18:44:50.591929] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T18:44:50.595738] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:44:50.793565] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-29T18:44:51.202773] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T18:44:51.428578] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-29T18:44:51.593574] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-29T18:44:52.177433] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-29T18:44:52.393552] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-29T18:44:53.193534] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-29T18:44:53.264853] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T18:44:53.965431] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-29T18:44:53.993522] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-29T18:44:54.723602] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T18:44:54.793571] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-29T18:44:55.441140] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T18:44:55.593593] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-29T18:44:56.140333] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-29T18:44:56.393600] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-29T18:44:57.136011] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T18:44:57.193547] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-29T18:44:57.993552] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-29T18:44:58.135823] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-29T18:44:58.659830] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-29T18:44:58.793569] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-29T18:44:59.593559] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-29T18:44:59.799451] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T18:45:00.393563] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-29T18:45:00.433128] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T18:45:01.193552] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-29T18:45:01.431254] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T18:45:01.590548] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-29T18:45:01.993836] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-29T18:45:02.793684] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-29T18:45:03.308083] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T18:45:03.593607] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-29T18:45:03.838429] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T18:45:03.843724] [INFO ] [REMOTE ] FF: Full fetch complete (36133 records). [2025-10-29T18:45:03.843924] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-29T18:45:04.250332] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-29T18:45:04.250469] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-29T18:45:04.251295] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-29T18:45:04.251360] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-29T18:45:04.252415] [DEBUG] [LOCAL ] FF: Trimmed 36133 records to 22942 (keeping 200 days of data) [2025-10-29T18:45:04.396063] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-29T18:45:04.396225] [DEBUG] [LOCAL ] FF: Primary data saved (22942 records). [2025-10-29T18:45:04.396709] [INFO ] [MAIN ] FF: Full history saved. [2025-10-29T18:45:04.396854] [INFO ] [MAIN ] Update Progress: 824/2367 symbols completed. FF took 33.7s. Estimated remaining: 3h 16m 41s. Rate: 7.8 symbols/min [2025-10-29T18:45:04.605964] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:45:04.606291] [DEBUG] [LOCAL ] FGN: No existing data file found in primary storage. [2025-10-29T18:45:04.606451] [WARN ] [MAIN ] FGN: No existing data found, performing full refresh instead. [2025-10-29T18:45:04.606609] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-29T18:45:04.606702] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-29T18:45:04.606765] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-29T18:45:04.606801] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-29T18:45:05.017037] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-29T18:45:05.026803] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T18:45:05.124285] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:45:05.193602] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-29T18:45:05.993561] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-29T18:45:06.065536] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T18:45:06.522018] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-29T18:45:06.793568] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-29T18:45:07.593612] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-29T18:45:07.903020] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T18:45:07.968003] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T18:45:08.393555] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-29T18:45:09.139800] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T18:45:09.193610] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-29T18:45:09.993693] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-29T18:45:10.284637] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-29T18:45:10.415098] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T18:45:10.793563] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-29T18:45:11.561783] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T18:45:11.593546] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-29T18:45:12.393566] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-29T18:45:12.792879] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T18:45:12.801266] [INFO ] [REMOTE ] FFWM: Full fetch complete (52183 records). [2025-10-29T18:45:12.801429] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-29T18:45:12.918795] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T18:45:13.200395] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-29T18:45:13.201510] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-29T18:45:13.201605] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-29T18:45:13.203151] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-29T18:45:13.203328] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-29T18:45:13.204512] [DEBUG] [LOCAL ] FFWM: Trimmed 52183 records to 35440 (keeping 200 days of data) [2025-10-29T18:45:13.396635] [DEBUG] [LOCAL ] FFWM: Primary data saved (35440 records). [2025-10-29T18:45:13.396811] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-29T18:45:13.396890] [INFO ] [MAIN ] Update Progress: 825/2367 symbols completed. FFWM took 27.8s. Estimated remaining: 3h 16m 36s. Rate: 7.8 symbols/min [2025-10-29T18:45:13.561928] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:45:13.562112] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-29T18:45:13.562148] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-29T18:45:13.562279] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-29T18:45:13.562319] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-29T18:45:13.562358] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-29T18:45:13.562389] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-29T18:45:13.681933] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-29T18:45:13.925491] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:45:13.993565] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-29T18:45:14.593295] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T18:45:14.793561] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-29T18:45:15.593533] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-29T18:45:15.739848] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-29T18:45:15.963513] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-29T18:45:16.393575] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-29T18:45:16.902932] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-29T18:45:17.193594] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-29T18:45:17.854398] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T18:45:17.857663] [INFO ] [REMOTE ] FFA: Full fetch complete (8599 records). [2025-10-29T18:45:17.857788] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-29T18:45:18.000092] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-29T18:45:18.215962] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-29T18:45:18.216044] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-29T18:45:18.216323] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-29T18:45:18.216360] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-29T18:45:18.216780] [DEBUG] [LOCAL ] FFA: Trimmed 8599 records to 5201 (keeping 200 days of data) [2025-10-29T18:45:18.246825] [DEBUG] [LOCAL ] FFA: Primary data saved (5201 records). [2025-10-29T18:45:18.246905] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-29T18:45:18.246975] [INFO ] [MAIN ] Update Progress: 826/2367 symbols completed. FFA took 43.5s. Estimated remaining: 3h 16m 23s. Rate: 7.8 symbols/min [2025-10-29T18:45:18.412343] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:45:18.447117] [DEBUG] [LOCAL ] FHI: Loaded 39205 existing records from primary storage. [2025-10-29T18:45:18.447378] [INFO ] [MAIN ] FHI: Loaded 39205 existing records. [2025-10-29T18:45:18.554213] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T18:45:18.631866] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:45:18.632039] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-29T18:45:18.632085] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-29T18:45:18.632732] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-29T18:45:18.632788] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-29T18:45:18.796200] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-29T18:45:18.994174] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:45:19.231283] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-29T18:45:19.593601] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-29T18:45:19.977047] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T18:45:20.393624] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-29T18:45:21.158872] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T18:45:21.193591] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-29T18:45:21.599959] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-29T18:45:21.993574] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-29T18:45:22.740906] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T18:45:22.793603] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-29T18:45:23.139130] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-29T18:45:23.593571] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-29T18:45:24.393577] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-29T18:45:24.730146] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T18:45:24.843294] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-29T18:45:25.193582] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-29T18:45:25.993542] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-29T18:45:26.107787] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T18:45:26.793559] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-29T18:45:26.908803] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-29T18:45:27.593547] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-29T18:45:27.675884] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-29T18:45:27.680163] [INFO ] [REMOTE ] FG: Full fetch complete (29046 records). [2025-10-29T18:45:27.680280] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-29T18:45:27.966457] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-29T18:45:28.052131] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-29T18:45:28.052207] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-29T18:45:28.052811] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-29T18:45:28.052875] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-29T18:45:28.053574] [DEBUG] [LOCAL ] FG: Trimmed 29046 records to 20410 (keeping 200 days of data) [2025-10-29T18:45:28.172492] [DEBUG] [LOCAL ] FG: Primary data saved (20410 records). [2025-10-29T18:45:28.172609] [INFO ] [MAIN ] FG: Full history saved. [2025-10-29T18:45:28.172703] [INFO ] [MAIN ] Update Progress: 827/2367 symbols completed. FG took 38.4s. Estimated remaining: 3h 16m 19s. Rate: 7.8 symbols/min [2025-10-29T18:45:28.336741] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:45:28.385010] [DEBUG] [LOCAL ] FHN: Loaded 53398 existing records from primary storage. [2025-10-29T18:45:28.385315] [INFO ] [MAIN ] FHN: Loaded 53398 existing records. [2025-10-29T18:45:28.398798] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-29T18:45:28.569476] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:45:28.569714] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-29T18:45:28.569790] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-29T18:45:28.570866] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-29T18:45:28.570924] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-29T18:45:28.918032] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:45:29.193563] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-29T18:45:29.649529] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T18:45:29.993581] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-29T18:45:30.597447] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T18:45:30.793562] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-29T18:45:31.255698] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-29T18:45:31.256792] [INFO ] [REMOTE ] FGN: Full fetch complete (5373 records). [2025-10-29T18:45:31.256860] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-29T18:45:31.257215] [FATAL] [VALIDATOR ] FGN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:45:31.257300] [FATAL] [MAIN ] FGN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:45:31.257356] [WARN ] [MAIN ] FGN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:45:31.257431] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-29T18:45:31.257491] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-29T18:45:31.257526] [INFO ] [LOCAL ] FGN: Starting deletion of derivative data. [2025-10-29T18:45:31.257564] [DEBUG] [LOCAL ] FGN: No derivative data file found to delete. [2025-10-29T18:45:31.257615] [INFO ] [MAIN ] Update Progress: 828/2367 symbols completed. FGN took 26.9s. Estimated remaining: 3h 16m 3s. Rate: 7.8 symbols/min [2025-10-29T18:45:31.424499] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:45:31.473635] [DEBUG] [LOCAL ] FI: Loaded 53573 existing records from primary storage. [2025-10-29T18:45:31.473994] [INFO ] [MAIN ] FI: Loaded 53573 existing records. [2025-10-29T18:45:31.598994] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-29T18:45:31.652617] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:45:31.652949] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-29T18:45:31.653001] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-29T18:45:31.653978] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-29T18:45:31.654034] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-29T18:45:32.036198] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:45:32.393534] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-29T18:45:32.784903] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T18:45:33.193532] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-29T18:45:33.704187] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T18:45:33.993551] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-29T18:45:34.341153] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T18:45:34.366052] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-29T18:45:34.793598] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-29T18:45:35.287973] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-29T18:45:35.571530] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (6.38 seconds). [2025-10-29T18:45:35.593522] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-29T18:45:36.393609] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-29T18:45:36.804370] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T18:45:37.193621] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-29T18:45:37.553412] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T18:45:37.583395] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:45:37.993551] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-29T18:45:38.323719] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T18:45:38.793566] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-29T18:45:39.593560] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-29T18:45:40.010510] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T18:45:40.393576] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-29T18:45:40.717484] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T18:45:40.982811] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T18:45:40.984579] [INFO ] [REMOTE ] FGSN: Full fetch complete (8174 records). [2025-10-29T18:45:40.984691] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-29T18:45:41.173593] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-29T18:45:41.173869] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:45:41.173937] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:45:41.173988] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-29T18:45:41.174043] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-29T18:45:41.174080] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-29T18:45:41.174124] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-29T18:45:41.174227] [INFO ] [MAIN ] Update Progress: 829/2367 symbols completed. FGSN took 27.8s. Estimated remaining: 3h 15m 60s. Rate: 7.8 symbols/min [2025-10-29T18:45:41.198635] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-29T18:45:41.379437] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:45:41.379622] [DEBUG] [LOCAL ] FICO: No existing data file found in primary storage. [2025-10-29T18:45:41.379724] [WARN ] [MAIN ] FICO: No existing data found, performing full refresh instead. [2025-10-29T18:45:41.379805] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-29T18:45:41.379842] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-29T18:45:41.379883] [DEBUG] [LOCAL ] FICO: No primary data file found to delete. [2025-10-29T18:45:41.379914] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-29T18:45:41.749259] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:45:41.993562] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-29T18:45:42.793562] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-29T18:45:42.995626] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-29T18:45:43.109153] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T18:45:43.593574] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-29T18:45:44.226471] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T18:45:44.393610] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-29T18:45:44.506943] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T18:45:45.193610] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-29T18:45:45.714436] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:45:45.993586] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-29T18:45:46.793538] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-29T18:45:47.289230] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:45:47.593562] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-29T18:45:47.741000] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T18:45:48.393563] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-29T18:45:48.846418] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T18:45:48.854598] [INFO ] [REMOTE ] FHI: Full fetch complete (56984 records). [2025-10-29T18:45:48.854938] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-29T18:45:48.856041] [FATAL] [VALIDATOR ] FHI: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:45:48.856150] [FATAL] [MAIN ] FHI: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:45:48.856195] [WARN ] [MAIN ] FHI: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:45:48.856239] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-29T18:45:48.856301] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-10-29T18:45:48.856341] [INFO ] [LOCAL ] FHI: Starting deletion of derivative data. [2025-10-29T18:45:48.856532] [DEBUG] [LOCAL ] FHI: Deleted derivative data file. [2025-10-29T18:45:48.856685] [INFO ] [MAIN ] Update Progress: 830/2367 symbols completed. FHI took 30.6s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-29T18:45:49.043489] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:45:49.044446] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-29T18:45:49.044500] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-29T18:45:49.044711] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-29T18:45:49.044766] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-29T18:45:49.044809] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-29T18:45:49.044841] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-29T18:45:49.202454] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-29T18:45:49.288777] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T18:45:49.425497] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:45:49.993556] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-29T18:45:50.271576] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-29T18:45:50.689849] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-29T18:45:50.793523] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-29T18:45:51.172606] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (5.98 seconds). [2025-10-29T18:45:51.593626] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-29T18:45:52.228208] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-29T18:45:52.393572] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-29T18:45:52.478979] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T18:45:53.193590] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-29T18:45:53.907761] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-29T18:45:53.993564] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-29T18:45:54.747502] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T18:45:54.793568] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-29T18:45:55.364823] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T18:45:55.593567] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-29T18:45:56.018808] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T18:45:56.393592] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-29T18:45:56.602766] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-29T18:45:57.193553] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-29T18:45:57.993633] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-29T18:45:58.185572] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T18:45:58.793625] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-29T18:45:58.978538] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.18 seconds). [2025-10-29T18:45:59.598772] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-29T18:45:59.616761] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-29T18:46:00.393557] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-29T18:46:00.514093] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (4.92 seconds). [2025-10-29T18:46:00.524852] [INFO ] [REMOTE ] FHN: Full fetch complete (77093 records). [2025-10-29T18:46:00.524997] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-29T18:46:00.525683] [FATAL] [VALIDATOR ] FHN: Data is stale - most recent date (2025-10-28) is before last completed trading day (2025-10-29). Symbol may be delisted or halted. [2025-10-29T18:46:00.525773] [FATAL] [MAIN ] FHN: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:46:00.525816] [WARN ] [MAIN ] FHN: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:46:00.525854] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-29T18:46:00.525909] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-10-29T18:46:00.525943] [INFO ] [LOCAL ] FHN: Starting deletion of derivative data. [2025-10-29T18:46:00.526240] [DEBUG] [LOCAL ] FHN: Deleted derivative data file. [2025-10-29T18:46:00.526328] [INFO ] [MAIN ] Update Progress: 831/2367 symbols completed. FHN took 32.4s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-29T18:46:00.710404] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:00.757563] [DEBUG] [LOCAL ] FIGS: Loaded 48318 existing records from primary storage. [2025-10-29T18:46:00.757915] [INFO ] [MAIN ] FIGS: Loaded 48318 existing records. [2025-10-29T18:46:00.878494] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-29T18:46:00.957124] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:46:00.957376] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-29T18:46:00.957557] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-29T18:46:00.963502] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-29T18:46:00.971314] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-29T18:46:00.987091] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T18:46:01.198746] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-29T18:46:01.356607] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:46:01.993579] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-29T18:46:02.629146] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-29T18:46:02.793612] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-29T18:46:03.166094] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-29T18:46:03.593575] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-29T18:46:03.656125] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T18:46:04.393603] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-29T18:46:05.193549] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-29T18:46:05.292313] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-29T18:46:05.535725] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T18:46:05.536045] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-29T18:46:05.536135] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:46:05.536233] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-29T18:46:05.536311] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:46:05.536397] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-29T18:46:05.536477] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-29T18:46:05.536529] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-29T18:46:05.536592] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-29T18:46:05.536702] [INFO ] [MAIN ] Update Progress: 832/2367 symbols completed. FIG took 16.7s. Estimated remaining: 3h 15m 40s. Rate: 7.8 symbols/min [2025-10-29T18:46:05.748737] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:05.753409] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T18:46:05.794984] [DEBUG] [LOCAL ] FIHL: Loaded 38617 existing records from primary storage. [2025-10-29T18:46:05.795267] [INFO ] [MAIN ] FIHL: Loaded 38617 existing records. [2025-10-29T18:46:05.972067] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:46:05.972281] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-29T18:46:05.972328] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-29T18:46:05.972993] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-29T18:46:05.973051] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-29T18:46:06.001979] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-29T18:46:06.328259] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:46:06.793610] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-29T18:46:07.136226] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:46:07.593579] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-29T18:46:07.801403] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T18:46:08.393581] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-29T18:46:08.743100] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T18:46:09.193555] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-29T18:46:09.370017] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T18:46:09.852716] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T18:46:09.866799] [INFO ] [REMOTE ] FI: Full fetch complete (77505 records). [2025-10-29T18:46:09.867020] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-29T18:46:09.994044] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-29T18:46:10.335214] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-29T18:46:10.335320] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-29T18:46:10.336853] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-29T18:46:10.337041] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-29T18:46:10.339010] [DEBUG] [LOCAL ] FI: Trimmed 77505 records to 53575 (keeping 200 days of data) [2025-10-29T18:46:10.687245] [DEBUG] [LOCAL ] FI: Primary data saved (53575 records). [2025-10-29T18:46:10.687412] [INFO ] [MAIN ] FI: Full history saved. [2025-10-29T18:46:10.687526] [INFO ] [MAIN ] Update Progress: 833/2367 symbols completed. FI took 39.4s. Estimated remaining: 3h 15m 27s. Rate: 7.8 symbols/min [2025-10-29T18:46:10.797181] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-29T18:46:10.873059] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:10.882490] [DEBUG] [LOCAL ] FINS: Loaded 8142 existing records from primary storage. [2025-10-29T18:46:10.882758] [INFO ] [MAIN ] FINS: Loaded 8142 existing records. [2025-10-29T18:46:11.107049] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:46:11.107432] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-29T18:46:11.107487] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-29T18:46:11.107940] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-29T18:46:11.107998] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-29T18:46:11.501260] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:46:11.541236] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-29T18:46:11.593581] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-29T18:46:11.875218] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T18:46:12.080357] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-29T18:46:12.393580] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-29T18:46:13.193560] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-29T18:46:13.636787] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-29T18:46:13.993553] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-29T18:46:14.793520] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-29T18:46:14.906514] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-29T18:46:15.080300] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-29T18:46:15.593613] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-29T18:46:16.393725] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-29T18:46:16.448912] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-29T18:46:16.857423] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-29T18:46:17.193572] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-29T18:46:17.993583] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-29T18:46:18.262238] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-29T18:46:18.268138] [INFO ] [REMOTE ] FICO: Full fetch complete (30284 records). [2025-10-29T18:46:18.268275] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-29T18:46:18.648610] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-29T18:46:18.690769] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-29T18:46:18.690824] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-29T18:46:18.691337] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-29T18:46:18.691375] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-29T18:46:18.692060] [DEBUG] [LOCAL ] FICO: Trimmed 30284 records to 21851 (keeping 200 days of data) [2025-10-29T18:46:18.795815] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-29T18:46:18.825880] [DEBUG] [LOCAL ] FICO: Primary data saved (21851 records). [2025-10-29T18:46:18.825982] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-29T18:46:18.826046] [INFO ] [MAIN ] Update Progress: 834/2367 symbols completed. FICO took 37.7s. Estimated remaining: 3h 15m 21s. Rate: 7.8 symbols/min [2025-10-29T18:46:18.969087] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (6.58 seconds). [2025-10-29T18:46:19.036857] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:19.073488] [DEBUG] [LOCAL ] FINV: Loaded 45195 existing records from primary storage. [2025-10-29T18:46:19.073802] [INFO ] [MAIN ] FINV: Loaded 45195 existing records. [2025-10-29T18:46:19.253959] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:46:19.254241] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-29T18:46:19.254308] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-29T18:46:19.255120] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-29T18:46:19.255181] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-29T18:46:19.598692] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-29T18:46:19.603883] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:46:19.977112] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T18:46:20.167616] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-29T18:46:20.393554] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-29T18:46:21.193590] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-29T18:46:21.414461] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-29T18:46:21.724834] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T18:46:21.993564] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-29T18:46:22.793601] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-29T18:46:23.116884] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-29T18:46:23.593569] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-29T18:46:23.899557] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:46:24.393563] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-29T18:46:24.783246] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T18:46:24.861000] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-29T18:46:25.193557] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-29T18:46:25.625820] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-29T18:46:25.993569] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-29T18:46:26.793620] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-29T18:46:27.176762] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T18:46:27.384866] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T18:46:27.386636] [INFO ] [REMOTE ] FINS: Full fetch complete (11483 records). [2025-10-29T18:46:27.386731] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-29T18:46:27.601164] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-29T18:46:27.764275] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-29T18:46:27.764375] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-29T18:46:27.764707] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-29T18:46:27.764769] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-29T18:46:27.765242] [DEBUG] [LOCAL ] FINS: Trimmed 11483 records to 8139 (keeping 200 days of data) [2025-10-29T18:46:27.814718] [DEBUG] [LOCAL ] FINS: Primary data saved (8139 records). [2025-10-29T18:46:27.814853] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-29T18:46:27.814929] [INFO ] [MAIN ] Update Progress: 835/2367 symbols completed. FINS took 17.1s. Estimated remaining: 3h 15m 15s. Rate: 7.8 symbols/min [2025-10-29T18:46:27.985074] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:28.032409] [DEBUG] [LOCAL ] FIS: Loaded 53324 existing records from primary storage. [2025-10-29T18:46:28.032851] [INFO ] [MAIN ] FIS: Loaded 53324 existing records. [2025-10-29T18:46:28.214604] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:46:28.214860] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-29T18:46:28.214907] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-29T18:46:28.216037] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-29T18:46:28.216096] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-29T18:46:28.398718] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-29T18:46:28.578819] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:46:28.844711] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T18:46:29.193636] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-29T18:46:29.666898] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T18:46:29.993590] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-29T18:46:30.448095] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T18:46:30.793548] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-29T18:46:30.944789] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T18:46:31.593555] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-29T18:46:31.912214] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T18:46:32.393576] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-29T18:46:32.598754] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T18:46:33.193600] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-29T18:46:33.683586] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T18:46:33.993688] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-29T18:46:34.793621] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-29T18:46:35.056433] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-29T18:46:35.459994] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T18:46:35.571380] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T18:46:35.593546] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-29T18:46:36.393593] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-29T18:46:37.193568] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-29T18:46:37.503588] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T18:46:37.993527] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-29T18:46:38.142930] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T18:46:38.793583] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-29T18:46:39.321955] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T18:46:39.398562] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (3.81 seconds). [2025-10-29T18:46:39.593556] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-29T18:46:40.175773] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T18:46:40.186088] [INFO ] [REMOTE ] FIGS: Full fetch complete (70676 records). [2025-10-29T18:46:40.186264] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-29T18:46:40.401925] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-29T18:46:40.587273] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-29T18:46:40.587423] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-29T18:46:40.588459] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-29T18:46:40.588569] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-29T18:46:40.598590] [DEBUG] [LOCAL ] FIGS: Trimmed 70676 records to 48272 (keeping 200 days of data) [2025-10-29T18:46:40.691193] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T18:46:40.887532] [DEBUG] [LOCAL ] FIGS: Primary data saved (48272 records). [2025-10-29T18:46:40.887702] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-29T18:46:40.887793] [INFO ] [MAIN ] Update Progress: 836/2367 symbols completed. FIGS took 40.4s. Estimated remaining: 3h 15m 18s. Rate: 7.8 symbols/min [2025-10-29T18:46:41.056188] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:41.081532] [DEBUG] [LOCAL ] FIX: Loaded 28232 existing records from primary storage. [2025-10-29T18:46:41.081823] [INFO ] [MAIN ] FIX: Loaded 28232 existing records. [2025-10-29T18:46:41.198742] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-29T18:46:41.256290] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:46:41.257168] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-29T18:46:41.257279] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-29T18:46:41.257929] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-29T18:46:41.257999] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-29T18:46:41.666548] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:46:41.698638] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T18:46:41.993546] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-29T18:46:42.372186] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-29T18:46:42.380255] [INFO ] [REMOTE ] FIHL: Full fetch complete (56350 records). [2025-10-29T18:46:42.380424] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-29T18:46:42.762058] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-29T18:46:42.762135] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-29T18:46:42.762876] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-29T18:46:42.762939] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-29T18:46:42.764060] [DEBUG] [LOCAL ] FIHL: Trimmed 56350 records to 38551 (keeping 200 days of data) [2025-10-29T18:46:42.815516] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-29T18:46:42.997905] [DEBUG] [LOCAL ] FIHL: Primary data saved (38551 records). [2025-10-29T18:46:42.998087] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-29T18:46:42.998174] [INFO ] [MAIN ] Update Progress: 837/2367 symbols completed. FIHL took 37.5s. Estimated remaining: 3h 14m 60s. Rate: 7.8 symbols/min [2025-10-29T18:46:43.236450] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T18:46:43.593610] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-29T18:46:44.393562] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-29T18:46:44.484854] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-29T18:46:44.553630] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T18:46:45.193569] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-29T18:46:45.849214] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T18:46:45.993613] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-29T18:46:46.456033] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T18:46:46.793561] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-29T18:46:47.339132] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T18:46:47.593586] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-29T18:46:47.903689] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-29T18:46:48.393564] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-29T18:46:49.155894] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T18:46:49.166309] [INFO ] [REMOTE ] FINV: Full fetch complete (65106 records). [2025-10-29T18:46:49.166461] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-29T18:46:49.198806] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-29T18:46:49.565227] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-29T18:46:49.565366] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-29T18:46:49.566495] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-29T18:46:49.566587] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-29T18:46:49.568420] [DEBUG] [LOCAL ] FINV: Trimmed 65106 records to 45192 (keeping 200 days of data) [2025-10-29T18:46:49.686834] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T18:46:49.854310] [DEBUG] [LOCAL ] FINV: Primary data saved (45192 records). [2025-10-29T18:46:49.854443] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-29T18:46:49.854523] [INFO ] [MAIN ] Update Progress: 838/2367 symbols completed. FINV took 31.0s. Estimated remaining: 3h 14m 51s. Rate: 7.8 symbols/min [2025-10-29T18:46:49.993590] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-29T18:46:50.552015] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T18:46:50.793551] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-29T18:46:50.980223] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T18:46:51.502541] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-29T18:46:51.514871] [INFO ] [REMOTE ] FIS: Full fetch complete (77403 records). [2025-10-29T18:46:51.515112] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-29T18:46:51.603224] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-29T18:46:51.972880] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-29T18:46:51.973040] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-29T18:46:51.974312] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-29T18:46:51.974379] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-29T18:46:51.976591] [DEBUG] [LOCAL ] FIS: Trimmed 77403 records to 53323 (keeping 200 days of data) [2025-10-29T18:46:52.363542] [DEBUG] [LOCAL ] FIS: Primary data saved (53323 records). [2025-10-29T18:46:52.363900] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-29T18:46:52.364036] [INFO ] [MAIN ] Update Progress: 839/2367 symbols completed. FIS took 24.5s. Estimated remaining: 3h 14m 34s. Rate: 7.9 symbols/min [2025-10-29T18:46:52.696308] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T18:46:52.704149] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-29T18:46:53.700526] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T18:46:53.707252] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-29T18:46:54.446856] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T18:46:54.453155] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-29T18:46:55.491156] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-29T18:46:55.497831] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-29T18:46:56.393865] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-29T18:46:56.399909] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-29T18:46:57.364997] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T18:46:57.371316] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-29T18:46:58.523803] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T18:46:58.530081] [INFO ] [REMOTE ] FIX: Full fetch complete (45686 records). [2025-10-29T18:46:58.530177] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-29T18:46:58.913575] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-29T18:46:58.913697] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-29T18:46:58.914351] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-29T18:46:58.914393] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-29T18:46:58.915298] [DEBUG] [LOCAL ] FIX: Trimmed 45686 records to 28221 (keeping 200 days of data) [2025-10-29T18:46:59.088498] [DEBUG] [LOCAL ] FIX: Primary data saved (28221 records). [2025-10-29T18:46:59.088640] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-29T18:46:59.088775] [INFO ] [MAIN ] Update Progress: 840/2367 symbols completed. FIX took 18.2s. Estimated remaining: 3h 14m 25s. Rate: 7.9 symbols/min [2025-10-29T18:46:59.747449] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:59.808119] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-29T18:46:59.818094] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:59.850394] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:59.870139] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:46:59.871663] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-29T18:46:59.872044] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-29T18:46:59.872447] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-29T18:46:59.872521] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-29T18:46:59.872557] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-29T18:46:59.982534] [DEBUG] [LOCAL ] FLC: Loaded 5080 existing records from primary storage. [2025-10-29T18:46:59.986475] [INFO ] [MAIN ] FLC: Loaded 5080 existing records. [2025-10-29T18:47:00.266293] [DEBUG] [LOCAL ] FLNG: Loaded 32849 existing records from primary storage. [2025-10-29T18:47:00.438257] [DEBUG] [LOCAL ] FLG: Loaded 53316 existing records from primary storage. [2025-10-29T18:47:00.441759] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:47:00.433350] [INFO ] [MAIN ] FLNG: Loaded 32849 existing records. [2025-10-29T18:47:00.442534] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-29T18:47:00.443058] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-29T18:47:00.442939] [INFO ] [MAIN ] FLG: Loaded 53316 existing records. [2025-10-29T18:47:00.485486] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-29T18:47:00.660295] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-29T18:47:00.714589] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:00.787482] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-29T18:47:00.994736] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:47:01.035383] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-29T18:47:01.036165] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T18:47:01.026240] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:47:01.040996] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-29T18:47:01.041223] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-29T18:47:01.041339] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-29T18:47:01.041683] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T18:47:01.040688] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-29T18:47:01.047688] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-29T18:47:01.042342] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-29T18:47:01.068868] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T18:47:01.069107] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-29T18:47:01.069211] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-29T18:47:01.069030] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-29T18:47:01.069343] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-29T18:47:01.100426] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-29T18:47:01.138207] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-29T18:47:01.138310] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-29T18:47:01.220726] [INFO ] [MAIN ] Update Progress: 841/2367 symbols completed. FIXT took 2.1s. Estimated remaining: 3h 14m 7s. Rate: 7.9 symbols/min [2025-10-29T18:47:02.032044] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:02.126013] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-29T18:47:02.202003] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:47:02.361412] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:02.365908] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-29T18:47:02.365433] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:02.367098] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-29T18:47:02.414985] [DEBUG] [LOCAL ] FLO: Loaded 52068 existing records from primary storage. [2025-10-29T18:47:02.415285] [INFO ] [MAIN ] FLO: Loaded 52068 existing records. [2025-10-29T18:47:02.589121] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:47:02.589391] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-29T18:47:02.589441] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-29T18:47:02.589901] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-29T18:47:02.589958] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-29T18:47:02.940134] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:02.940514] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-29T18:47:02.945698] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T18:47:02.947280] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-29T18:47:03.302851] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T18:47:03.304359] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-29T18:47:03.432705] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-29T18:47:03.440155] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-29T18:47:03.667382] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-29T18:47:03.669683] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-29T18:47:04.080197] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-29T18:47:04.171938] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-29T18:47:04.208121] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:47:04.393685] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-29T18:47:04.434378] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T18:47:05.193565] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-29T18:47:05.712922] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-29T18:47:05.731611] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-29T18:47:05.993555] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-29T18:47:06.793591] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-29T18:47:07.137100] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T18:47:07.593590] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-29T18:47:08.051851] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T18:47:08.131874] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T18:47:08.393573] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-29T18:47:09.193541] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-29T18:47:09.619737] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T18:47:09.993586] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-29T18:47:10.299384] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T18:47:10.793624] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-29T18:47:10.819625] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T18:47:11.593583] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-29T18:47:12.243941] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-29T18:47:12.393549] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-29T18:47:12.521784] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T18:47:13.193696] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-29T18:47:13.813432] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T18:47:13.993544] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-29T18:47:14.412627] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-29T18:47:14.790293] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-29T18:47:14.800435] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-29T18:47:15.593577] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-29T18:47:16.025599] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-29T18:47:16.089767] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T18:47:16.393559] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-29T18:47:16.843568] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-29T18:47:17.193552] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-29T18:47:17.993566] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-29T18:47:18.545496] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T18:47:18.561508] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-29T18:47:18.563105] [INFO ] [REMOTE ] FLC: Full fetch complete (7798 records). [2025-10-29T18:47:18.563194] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-29T18:47:18.799399] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-29T18:47:18.967930] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-29T18:47:18.968009] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-29T18:47:18.968212] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-29T18:47:18.968249] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-29T18:47:18.968636] [DEBUG] [LOCAL ] FLC: Trimmed 7798 records to 5050 (keeping 200 days of data) [2025-10-29T18:47:18.998733] [DEBUG] [LOCAL ] FLC: Primary data saved (5050 records). [2025-10-29T18:47:18.998819] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-29T18:47:18.998888] [INFO ] [MAIN ] Update Progress: 842/2367 symbols completed. FLC took 19.9s. Estimated remaining: 3h 14m 18s. Rate: 7.8 symbols/min [2025-10-29T18:47:19.163987] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:47:19.164167] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-29T18:47:19.164205] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-29T18:47:19.164312] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-29T18:47:19.164354] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-29T18:47:19.164394] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-29T18:47:19.164425] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-29T18:47:19.507616] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:19.593535] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-29T18:47:20.263875] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T18:47:20.393568] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-29T18:47:20.920202] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T18:47:21.193526] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-29T18:47:21.232426] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T18:47:21.993561] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-29T18:47:22.793582] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-29T18:47:22.866402] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-29T18:47:23.573163] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-29T18:47:23.593538] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-29T18:47:23.700533] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-29T18:47:24.393596] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-29T18:47:25.091888] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T18:47:25.104355] [INFO ] [REMOTE ] FLO: Full fetch complete (75406 records). [2025-10-29T18:47:25.104561] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-29T18:47:25.210815] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-29T18:47:25.494506] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T18:47:25.582896] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-29T18:47:25.583013] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-29T18:47:25.584471] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-29T18:47:25.584561] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-29T18:47:25.587053] [DEBUG] [LOCAL ] FLO: Trimmed 75406 records to 52090 (keeping 200 days of data) [2025-10-29T18:47:25.929972] [DEBUG] [LOCAL ] FLO: Primary data saved (52090 records). [2025-10-29T18:47:25.930170] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-29T18:47:25.930265] [INFO ] [MAIN ] Update Progress: 843/2367 symbols completed. FLO took 24.6s. Estimated remaining: 3h 14m 9s. Rate: 7.8 symbols/min [2025-10-29T18:47:25.998706] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-29T18:47:26.119670] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:47:26.176313] [DEBUG] [LOCAL ] FLR: Loaded 53241 existing records from primary storage. [2025-10-29T18:47:26.176823] [INFO ] [MAIN ] FLR: Loaded 53241 existing records. [2025-10-29T18:47:26.371748] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:47:26.372204] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-29T18:47:26.372351] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-29T18:47:26.373292] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-29T18:47:26.373352] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-29T18:47:26.670594] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T18:47:26.800170] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-29T18:47:26.802007] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:27.593534] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-29T18:47:27.630144] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-29T18:47:27.784016] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T18:47:28.393631] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-29T18:47:28.685357] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T18:47:29.193596] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-29T18:47:29.802924] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-29T18:47:29.993550] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-29T18:47:30.342936] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T18:47:30.793562] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-29T18:47:31.378927] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T18:47:31.593571] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-29T18:47:32.230514] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T18:47:32.393603] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-29T18:47:32.468849] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T18:47:33.193585] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-29T18:47:33.993544] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-29T18:47:34.063802] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-29T18:47:34.075084] [INFO ] [REMOTE ] FLG: Full fetch complete (77421 records). [2025-10-29T18:47:34.075250] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-29T18:47:34.442436] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T18:47:34.488083] [INFO ] [REMOTE ] FLNG: Full fetch complete (49551 records). [2025-10-29T18:47:34.507712] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-29T18:47:34.507847] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-29T18:47:34.507940] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-29T18:47:34.508854] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-29T18:47:34.508932] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-29T18:47:34.613462] [DEBUG] [LOCAL ] FLG: Trimmed 77421 records to 53311 (keeping 200 days of data) [2025-10-29T18:47:34.794943] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-29T18:47:35.035867] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-29T18:47:35.057086] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-29T18:47:35.061529] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-29T18:47:35.063450] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-29T18:47:35.063065] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T18:47:35.075475] [DEBUG] [LOCAL ] FLNG: Trimmed 49551 records to 32775 (keeping 200 days of data) [2025-10-29T18:47:35.482442] [DEBUG] [LOCAL ] FLNG: Primary data saved (32775 records). [2025-10-29T18:47:35.484639] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-29T18:47:35.486804] [INFO ] [MAIN ] Update Progress: 844/2367 symbols completed. FLNG took 36.4s. Estimated remaining: 3h 14m 5s. Rate: 7.8 symbols/min [2025-10-29T18:47:35.594741] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-29T18:47:35.707253] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:47:35.713107] [DEBUG] [LOCAL ] FLG: Primary data saved (53311 records). [2025-10-29T18:47:35.713499] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-29T18:47:35.713599] [INFO ] [MAIN ] Update Progress: 845/2367 symbols completed. FLG took 36.6s. Estimated remaining: 3h 13m 44s. Rate: 7.9 symbols/min [2025-10-29T18:47:35.886814] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:47:35.931513] [DEBUG] [LOCAL ] FLS: Loaded 50389 existing records from primary storage. [2025-10-29T18:47:35.932374] [INFO ] [MAIN ] FLS: Loaded 50389 existing records. [2025-10-29T18:47:36.171508] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:47:36.172191] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-29T18:47:36.172339] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-29T18:47:36.196101] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-29T18:47:36.196005] [DEBUG] [LOCAL ] FLUT: Loaded 50602 existing records from primary storage. [2025-10-29T18:47:36.196876] [INFO ] [MAIN ] FLUT: Loaded 50602 existing records. [2025-10-29T18:47:36.196726] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-29T18:47:36.456298] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-29T18:47:36.578817] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-29T18:47:36.630698] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:47:36.720129] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-29T18:47:36.719898] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T18:47:36.747753] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-29T18:47:36.781247] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-29T18:47:36.781365] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-29T18:47:37.033683] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:37.198692] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-29T18:47:37.264073] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:37.993602] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-29T18:47:38.140973] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-29T18:47:38.681541] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-29T18:47:38.793528] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-29T18:47:39.604751] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-29T18:47:39.609397] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-29T18:47:39.969173] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-29T18:47:40.389947] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T18:47:40.396445] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-29T18:47:41.193565] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-29T18:47:41.677770] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T18:47:41.993584] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-29T18:47:42.133477] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T18:47:42.793567] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-29T18:47:43.309926] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:47:43.593573] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-29T18:47:44.045529] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T18:47:44.393529] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-29T18:47:44.519578] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T18:47:45.193562] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-29T18:47:45.643025] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T18:47:45.993632] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-29T18:47:46.517141] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:47:46.793740] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-29T18:47:47.158131] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T18:47:47.164265] [INFO ] [REMOTE ] FLOC: Full fetch complete (42055 records). [2025-10-29T18:47:47.164405] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-29T18:47:47.351426] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-29T18:47:47.352195] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:47:47.352291] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:47:47.352346] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-29T18:47:47.352440] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-29T18:47:47.352510] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-29T18:47:47.352586] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-29T18:47:47.352698] [INFO ] [MAIN ] Update Progress: 846/2367 symbols completed. FLOC took 28.4s. Estimated remaining: 3h 13m 43s. Rate: 7.9 symbols/min [2025-10-29T18:47:47.523682] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:47:47.543306] [DEBUG] [LOCAL ] FLXR: Loaded 21694 existing records from primary storage. [2025-10-29T18:47:47.543607] [INFO ] [MAIN ] FLXR: Loaded 21694 existing records. [2025-10-29T18:47:47.608631] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-29T18:47:47.726566] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:47:47.726821] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-29T18:47:47.726867] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-29T18:47:47.727392] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-29T18:47:47.727449] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-29T18:47:48.089898] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:47:48.117177] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-29T18:47:48.393600] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-29T18:47:48.966273] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T18:47:48.983365] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-29T18:47:49.193586] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-29T18:47:49.993610] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-29T18:47:50.481294] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T18:47:50.793574] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-29T18:47:51.297685] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:47:51.593560] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-29T18:47:51.941608] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T18:47:52.393570] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-29T18:47:52.768453] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T18:47:53.193589] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-29T18:47:53.585075] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T18:47:53.993554] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-29T18:47:54.433071] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:47:54.793590] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-29T18:47:55.435245] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T18:47:55.593551] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-29T18:47:56.197469] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-29T18:47:56.393597] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-29T18:47:57.193555] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-29T18:47:57.236703] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-29T18:47:57.706123] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T18:47:57.705788] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T18:47:57.993572] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-29T18:47:58.793560] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-29T18:47:59.396858] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T18:47:59.466358] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T18:47:59.593568] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-29T18:48:00.393580] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-29T18:48:01.193623] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-29T18:48:01.579619] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-29T18:48:01.591830] [INFO ] [REMOTE ] FLR: Full fetch complete (76935 records). [2025-10-29T18:48:01.592197] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-29T18:48:02.002201] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-29T18:48:02.009253] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-29T18:48:02.063507] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-29T18:48:02.064367] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-29T18:48:02.065712] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-29T18:48:02.065815] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-29T18:48:02.068207] [DEBUG] [LOCAL ] FLR: Trimmed 76935 records to 53239 (keeping 200 days of data) [2025-10-29T18:48:02.289163] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T18:48:02.440362] [DEBUG] [LOCAL ] FLR: Primary data saved (53239 records). [2025-10-29T18:48:02.440511] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-29T18:48:02.440592] [INFO ] [MAIN ] Update Progress: 847/2367 symbols completed. FLR took 36.5s. Estimated remaining: 3h 13m 49s. Rate: 7.8 symbols/min [2025-10-29T18:48:02.611276] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:02.657998] [DEBUG] [LOCAL ] FMC: Loaded 51833 existing records from primary storage. [2025-10-29T18:48:02.658319] [INFO ] [MAIN ] FMC: Loaded 51833 existing records. [2025-10-29T18:48:02.798817] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-29T18:48:02.837037] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:02.837285] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-29T18:48:02.837353] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-29T18:48:02.838472] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-29T18:48:02.838534] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-29T18:48:03.203750] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:03.593528] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-29T18:48:03.746679] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T18:48:04.056572] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T18:48:04.262612] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T18:48:04.393595] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-29T18:48:04.983813] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T18:48:05.193598] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-29T18:48:05.898116] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-29T18:48:05.993568] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-29T18:48:06.750834] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T18:48:06.793533] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-29T18:48:07.593577] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-29T18:48:08.144541] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T18:48:08.393171] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-29T18:48:08.398700] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-29T18:48:09.193587] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-29T18:48:09.839052] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T18:48:09.993544] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-29T18:48:10.057874] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-29T18:48:10.064387] [INFO ] [REMOTE ] FLXR: Full fetch complete (28214 records). [2025-10-29T18:48:10.064540] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-29T18:48:10.483040] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-29T18:48:10.483124] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-29T18:48:10.483736] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-29T18:48:10.483800] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-29T18:48:10.484591] [DEBUG] [LOCAL ] FLXR: Trimmed 28214 records to 21799 (keeping 200 days of data) [2025-10-29T18:48:10.621139] [DEBUG] [LOCAL ] FLXR: Primary data saved (21799 records). [2025-10-29T18:48:10.621261] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-29T18:48:10.621356] [INFO ] [MAIN ] Update Progress: 848/2367 symbols completed. FLXR took 23.3s. Estimated remaining: 3h 13m 42s. Rate: 7.8 symbols/min [2025-10-29T18:48:10.786343] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:10.793117] [DEBUG] [LOCAL ] FMN: Loaded 5507 existing records from primary storage. [2025-10-29T18:48:10.793311] [INFO ] [MAIN ] FMN: Loaded 5507 existing records. [2025-10-29T18:48:10.800676] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-29T18:48:10.970005] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:10.970230] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-29T18:48:10.970277] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-29T18:48:10.970563] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-29T18:48:10.970620] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-29T18:48:11.327999] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:11.360499] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T18:48:11.593552] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-29T18:48:12.021976] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-29T18:48:12.326493] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T18:48:12.337350] [INFO ] [REMOTE ] FLUT: Full fetch complete (73432 records). [2025-10-29T18:48:12.337493] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-29T18:48:12.399334] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-29T18:48:12.736267] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-29T18:48:12.736364] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-29T18:48:12.737389] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-29T18:48:12.737453] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-29T18:48:12.738963] [DEBUG] [LOCAL ] FLUT: Trimmed 73432 records to 50592 (keeping 200 days of data) [2025-10-29T18:48:13.036102] [DEBUG] [LOCAL ] FLUT: Primary data saved (50592 records). [2025-10-29T18:48:13.036224] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-29T18:48:13.036296] [INFO ] [MAIN ] Update Progress: 849/2367 symbols completed. FLUT took 37.3s. Estimated remaining: 3h 13m 25s. Rate: 7.8 symbols/min [2025-10-29T18:48:13.202421] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-29T18:48:13.205079] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:13.232930] [DEBUG] [LOCAL ] FMS: Loaded 30062 existing records from primary storage. [2025-10-29T18:48:13.233188] [INFO ] [MAIN ] FMS: Loaded 30062 existing records. [2025-10-29T18:48:13.413970] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:13.414229] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-29T18:48:13.414280] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-29T18:48:13.414840] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-29T18:48:13.414898] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-29T18:48:13.730480] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T18:48:13.785147] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:13.899101] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T18:48:13.911080] [INFO ] [REMOTE ] FLS: Full fetch complete (72682 records). [2025-10-29T18:48:13.911285] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-29T18:48:13.998847] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-29T18:48:14.332006] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-29T18:48:14.332094] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-29T18:48:14.332998] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-29T18:48:14.333067] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-29T18:48:14.334388] [DEBUG] [LOCAL ] FLS: Trimmed 72682 records to 50402 (keeping 200 days of data) [2025-10-29T18:48:14.643980] [DEBUG] [LOCAL ] FLS: Primary data saved (50402 records). [2025-10-29T18:48:14.644151] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-29T18:48:14.644262] [INFO ] [MAIN ] Update Progress: 850/2367 symbols completed. FLS took 39.2s. Estimated remaining: 3h 13m 7s. Rate: 7.9 symbols/min [2025-10-29T18:48:14.794889] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-29T18:48:14.814158] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:14.850295] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-29T18:48:14.869279] [DEBUG] [LOCAL ] FMX: Loaded 39942 existing records from primary storage. [2025-10-29T18:48:14.869568] [INFO ] [MAIN ] FMX: Loaded 39942 existing records. [2025-10-29T18:48:15.062898] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:15.063122] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-29T18:48:15.063168] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-29T18:48:15.064070] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-29T18:48:15.064128] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-29T18:48:15.428316] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:15.593587] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-29T18:48:16.210171] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T18:48:16.393600] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-29T18:48:16.543163] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T18:48:17.081191] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T18:48:17.193552] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-29T18:48:17.993612] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-29T18:48:18.117068] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T18:48:18.502151] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T18:48:18.793564] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-29T18:48:19.593555] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-29T18:48:20.122674] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T18:48:20.393558] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-29T18:48:20.741453] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T18:48:21.193584] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-29T18:48:21.423810] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-29T18:48:21.993593] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-29T18:48:22.084160] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T18:48:22.437682] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-29T18:48:22.793569] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-29T18:48:23.144807] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-29T18:48:23.593556] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-29T18:48:24.393580] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-29T18:48:24.629549] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T18:48:25.193595] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-29T18:48:25.496951] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T18:48:25.553566] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-29T18:48:25.993628] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-29T18:48:26.793540] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-29T18:48:26.857180] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-29T18:48:27.593567] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-29T18:48:28.059037] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-29T18:48:28.393603] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-29T18:48:28.510546] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T18:48:28.828930] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-29T18:48:29.193557] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-29T18:48:29.993552] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-29T18:48:30.404250] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T18:48:30.535154] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-29T18:48:30.793530] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-29T18:48:31.593574] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-29T18:48:31.679609] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T18:48:31.994634] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T18:48:32.393622] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-29T18:48:33.193611] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-29T18:48:33.719072] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T18:48:33.744721] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-29T18:48:33.746993] [INFO ] [REMOTE ] FMN: Full fetch complete (9781 records). [2025-10-29T18:48:33.747069] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-29T18:48:33.998741] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-29T18:48:34.130981] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-29T18:48:34.131057] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-29T18:48:34.131292] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-29T18:48:34.131330] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-29T18:48:34.131754] [DEBUG] [LOCAL ] FMN: Trimmed 9781 records to 5527 (keeping 200 days of data) [2025-10-29T18:48:34.164196] [DEBUG] [LOCAL ] FMN: Primary data saved (5527 records). [2025-10-29T18:48:34.164288] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-29T18:48:34.164363] [INFO ] [MAIN ] Update Progress: 851/2367 symbols completed. FMN took 23.5s. Estimated remaining: 3h 13m 20s. Rate: 7.8 symbols/min [2025-10-29T18:48:34.340059] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:34.343863] [DEBUG] [LOCAL ] FMY: Loaded 1325 existing records from primary storage. [2025-10-29T18:48:34.344081] [INFO ] [MAIN ] FMY: Loaded 1325 existing records. [2025-10-29T18:48:34.540848] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:34.541080] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-29T18:48:34.541128] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-29T18:48:34.541309] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-29T18:48:34.541367] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-29T18:48:34.798824] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-29T18:48:34.923633] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:35.466986] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T18:48:35.593583] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-29T18:48:35.853761] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-29T18:48:35.964356] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-29T18:48:35.971740] [INFO ] [REMOTE ] FMS: Full fetch complete (43220 records). [2025-10-29T18:48:35.971909] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-29T18:48:36.379900] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-29T18:48:36.380024] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-29T18:48:36.381201] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-29T18:48:36.381273] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-29T18:48:36.382775] [DEBUG] [LOCAL ] FMS: Trimmed 43220 records to 30037 (keeping 200 days of data) [2025-10-29T18:48:36.432929] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-29T18:48:36.568623] [DEBUG] [LOCAL ] FMS: Primary data saved (30037 records). [2025-10-29T18:48:36.568838] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-29T18:48:36.568940] [INFO ] [MAIN ] Update Progress: 852/2367 symbols completed. FMS took 23.5s. Estimated remaining: 3h 13m 3s. Rate: 7.8 symbols/min [2025-10-29T18:48:36.760536] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:36.800117] [DEBUG] [LOCAL ] FN: Loaded 36887 existing records from primary storage. [2025-10-29T18:48:36.800547] [INFO ] [MAIN ] FN: Loaded 36887 existing records. [2025-10-29T18:48:36.999059] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:36.999383] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-29T18:48:36.999439] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-29T18:48:37.000413] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-29T18:48:37.000483] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-29T18:48:37.204446] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-29T18:48:37.399432] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:37.904196] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-29T18:48:37.993561] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-29T18:48:38.274578] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-29T18:48:38.474239] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T18:48:38.793561] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-29T18:48:39.593577] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-29T18:48:39.870519] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T18:48:39.919152] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-29T18:48:40.393568] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-29T18:48:41.193608] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-29T18:48:41.993587] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-29T18:48:42.106898] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-29T18:48:42.117886] [INFO ] [REMOTE ] FMC: Full fetch complete (75442 records). [2025-10-29T18:48:42.118005] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-29T18:48:42.298691] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-29T18:48:42.518468] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-29T18:48:42.518585] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-29T18:48:42.519759] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-29T18:48:42.519852] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-29T18:48:42.555976] [DEBUG] [LOCAL ] FMC: Trimmed 75442 records to 51837 (keeping 200 days of data) [2025-10-29T18:48:42.558705] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T18:48:42.793535] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-29T18:48:42.878942] [DEBUG] [LOCAL ] FMC: Primary data saved (51837 records). [2025-10-29T18:48:42.879045] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-29T18:48:42.879119] [INFO ] [MAIN ] Update Progress: 853/2367 symbols completed. FMC took 40.4s. Estimated remaining: 3h 12m 53s. Rate: 7.8 symbols/min [2025-10-29T18:48:43.056236] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:43.103165] [DEBUG] [LOCAL ] FNB: Loaded 52602 existing records from primary storage. [2025-10-29T18:48:43.103450] [INFO ] [MAIN ] FNB: Loaded 52602 existing records. [2025-10-29T18:48:43.278229] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:43.278433] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-29T18:48:43.278479] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-29T18:48:43.279442] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-29T18:48:43.279498] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-29T18:48:43.603824] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-29T18:48:43.633433] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:43.894605] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T18:48:44.393560] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-29T18:48:44.851313] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T18:48:45.193725] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-29T18:48:45.585436] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T18:48:45.993576] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-29T18:48:46.274682] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-29T18:48:46.448623] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T18:48:46.793629] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-29T18:48:47.593712] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-29T18:48:48.393708] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-29T18:48:48.537582] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-29T18:48:48.709563] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-29T18:48:48.836168] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T18:48:49.193625] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-29T18:48:49.528615] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-29T18:48:49.993626] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-29T18:48:50.793693] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-29T18:48:51.369009] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T18:48:51.593687] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-29T18:48:52.186208] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T18:48:52.393564] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-29T18:48:52.717392] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T18:48:52.725237] [INFO ] [REMOTE ] FMX: Full fetch complete (57826 records). [2025-10-29T18:48:52.725384] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-29T18:48:52.841765] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-29T18:48:53.155221] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-29T18:48:53.155330] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-29T18:48:53.156359] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-29T18:48:53.156432] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-29T18:48:53.157894] [DEBUG] [LOCAL ] FMX: Trimmed 57826 records to 39913 (keeping 200 days of data) [2025-10-29T18:48:53.211519] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-29T18:48:53.417796] [DEBUG] [LOCAL ] FMX: Primary data saved (39913 records). [2025-10-29T18:48:53.417969] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-29T18:48:53.418068] [INFO ] [MAIN ] Update Progress: 854/2367 symbols completed. FMX took 38.8s. Estimated remaining: 3h 12m 51s. Rate: 7.8 symbols/min [2025-10-29T18:48:53.604574] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:53.650447] [DEBUG] [LOCAL ] FND: Loaded 52022 existing records from primary storage. [2025-10-29T18:48:53.650826] [INFO ] [MAIN ] FND: Loaded 52022 existing records. [2025-10-29T18:48:53.823876] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:53.824196] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-29T18:48:53.824249] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-29T18:48:53.825042] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-29T18:48:53.825099] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-29T18:48:54.001529] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-29T18:48:54.172022] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:54.588308] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T18:48:54.793557] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-29T18:48:55.425366] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T18:48:55.593616] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-29T18:48:56.049789] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T18:48:56.393557] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-29T18:48:56.771937] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T18:48:56.828321] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-29T18:48:57.193565] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-29T18:48:57.531297] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-29T18:48:57.532127] [INFO ] [REMOTE ] FMY: Full fetch complete (1939 records). [2025-10-29T18:48:57.532195] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-29T18:48:57.883519] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-29T18:48:57.883592] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-29T18:48:57.883696] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-29T18:48:57.883755] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-29T18:48:57.884071] [DEBUG] [LOCAL ] FMY: Trimmed 1939 records to 1327 (keeping 200 days of data) [2025-10-29T18:48:57.892221] [DEBUG] [LOCAL ] FMY: Primary data saved (1327 records). [2025-10-29T18:48:57.892279] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-29T18:48:57.892341] [INFO ] [MAIN ] Update Progress: 855/2367 symbols completed. FMY took 23.7s. Estimated remaining: 3h 12m 37s. Rate: 7.8 symbols/min [2025-10-29T18:48:57.994892] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-29T18:48:58.077361] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:48:58.123729] [DEBUG] [LOCAL ] FNF: Loaded 48424 existing records from primary storage. [2025-10-29T18:48:58.124083] [INFO ] [MAIN ] FNF: Loaded 48424 existing records. [2025-10-29T18:48:58.300750] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:48:58.300955] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-29T18:48:58.301001] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-29T18:48:58.301940] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-29T18:48:58.301998] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-29T18:48:58.706408] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:48:58.793553] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-29T18:48:58.952848] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T18:48:59.593576] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-29T18:48:59.958686] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T18:49:00.393560] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-29T18:49:00.733185] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T18:49:01.193563] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-29T18:49:01.527332] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T18:49:01.993555] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-29T18:49:02.560816] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-29T18:49:02.793566] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-29T18:49:03.035498] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T18:49:03.593585] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-29T18:49:04.118120] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T18:49:04.393604] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-29T18:49:05.032856] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-29T18:49:05.193541] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-29T18:49:05.763067] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-29T18:49:05.993581] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-29T18:49:06.588981] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T18:49:06.793576] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-29T18:49:07.131588] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T18:49:07.593700] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-29T18:49:07.991618] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T18:49:08.393605] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-29T18:49:08.878843] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T18:49:09.193604] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-29T18:49:09.560955] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T18:49:09.993732] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-29T18:49:10.719389] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T18:49:10.793580] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-29T18:49:11.443894] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T18:49:11.593606] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-29T18:49:12.063594] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-29T18:49:12.070864] [INFO ] [REMOTE ] FN: Full fetch complete (56488 records). [2025-10-29T18:49:12.071022] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-29T18:49:12.398718] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-29T18:49:12.484472] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-29T18:49:12.484553] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-29T18:49:12.485411] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-29T18:49:12.485477] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-29T18:49:12.486876] [DEBUG] [LOCAL ] FN: Trimmed 56488 records to 36858 (keeping 200 days of data) [2025-10-29T18:49:12.738798] [DEBUG] [LOCAL ] FN: Primary data saved (36858 records). [2025-10-29T18:49:12.739010] [INFO ] [MAIN ] FN: Full history saved. [2025-10-29T18:49:12.739154] [INFO ] [MAIN ] Update Progress: 856/2367 symbols completed. FN took 36.2s. Estimated remaining: 3h 12m 42s. Rate: 7.8 symbols/min [2025-10-29T18:49:13.029715] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:49:13.075943] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T18:49:13.153069] [DEBUG] [LOCAL ] FNV: Loaded 45877 existing records from primary storage. [2025-10-29T18:49:13.153424] [INFO ] [MAIN ] FNV: Loaded 45877 existing records. [2025-10-29T18:49:13.198849] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-29T18:49:13.396447] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:49:13.396729] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-29T18:49:13.396788] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-29T18:49:13.397845] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-29T18:49:13.397906] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-29T18:49:13.815525] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:49:13.869825] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-29T18:49:13.993538] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-29T18:49:14.793537] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-29T18:49:14.873158] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-29T18:49:14.884261] [INFO ] [REMOTE ] FNB: Full fetch complete (76250 records). [2025-10-29T18:49:14.884381] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-29T18:49:15.269835] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-29T18:49:15.269992] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-29T18:49:15.271006] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-29T18:49:15.271143] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-29T18:49:15.272681] [DEBUG] [LOCAL ] FNB: Trimmed 76250 records to 52599 (keeping 200 days of data) [2025-10-29T18:49:15.600893] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-29T18:49:15.601007] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-29T18:49:15.636513] [DEBUG] [LOCAL ] FNB: Primary data saved (52599 records). [2025-10-29T18:49:15.638341] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-29T18:49:15.638433] [INFO ] [MAIN ] Update Progress: 857/2367 symbols completed. FNB took 32.8s. Estimated remaining: 3h 12m 26s. Rate: 7.8 symbols/min [2025-10-29T18:49:15.811081] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:49:15.824724] [DEBUG] [LOCAL ] FOA: Loaded 12715 existing records from primary storage. [2025-10-29T18:49:15.824975] [INFO ] [MAIN ] FOA: Loaded 12715 existing records. [2025-10-29T18:49:16.003659] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:49:16.003940] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-29T18:49:16.004012] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-29T18:49:16.004379] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-29T18:49:16.004436] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-29T18:49:16.362390] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:49:16.389797] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-29T18:49:16.398944] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-29T18:49:16.868978] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:49:17.193564] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-29T18:49:17.761320] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T18:49:17.993562] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-29T18:49:18.614264] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-29T18:49:18.793611] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-29T18:49:19.344842] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T18:49:19.593580] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-29T18:49:20.075517] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T18:49:20.393577] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-29T18:49:20.830760] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T18:49:21.193594] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-29T18:49:21.816348] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T18:49:21.952735] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T18:49:21.993578] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-29T18:49:22.793627] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-29T18:49:23.278790] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T18:49:23.593561] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-29T18:49:24.171003] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T18:49:24.181951] [INFO ] [REMOTE ] FND: Full fetch complete (75126 records). [2025-10-29T18:49:24.182098] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-29T18:49:24.404841] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-29T18:49:24.581034] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-29T18:49:24.581113] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-29T18:49:24.582099] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-29T18:49:24.582221] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-29T18:49:24.583601] [DEBUG] [LOCAL ] FND: Trimmed 75126 records to 52011 (keeping 200 days of data) [2025-10-29T18:49:24.884626] [DEBUG] [LOCAL ] FND: Primary data saved (52011 records). [2025-10-29T18:49:24.884899] [INFO ] [MAIN ] FND: Full history saved. [2025-10-29T18:49:24.885071] [INFO ] [MAIN ] Update Progress: 858/2367 symbols completed. FND took 31.5s. Estimated remaining: 3h 12m 22s. Rate: 7.8 symbols/min [2025-10-29T18:49:25.058041] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:49:25.093851] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-29T18:49:25.098101] [DEBUG] [LOCAL ] FOF: Loaded 8130 existing records from primary storage. [2025-10-29T18:49:25.113831] [INFO ] [MAIN ] FOF: Loaded 8130 existing records. [2025-10-29T18:49:25.203596] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-29T18:49:25.295169] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:49:25.295364] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-29T18:49:25.295409] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-29T18:49:25.295714] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-29T18:49:25.295772] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-29T18:49:25.657741] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:49:25.786695] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T18:49:25.905276] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-29T18:49:25.993588] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-29T18:49:26.793727] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-29T18:49:27.272897] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T18:49:27.282981] [INFO ] [REMOTE ] FNF: Full fetch complete (69817 records). [2025-10-29T18:49:27.283142] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-29T18:49:27.598702] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-29T18:49:27.685924] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-29T18:49:27.686013] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-29T18:49:27.686881] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-29T18:49:27.686964] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-29T18:49:27.688328] [DEBUG] [LOCAL ] FNF: Trimmed 69817 records to 48378 (keeping 200 days of data) [2025-10-29T18:49:27.990543] [DEBUG] [LOCAL ] FNF: Primary data saved (48378 records). [2025-10-29T18:49:27.990801] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-29T18:49:27.991756] [INFO ] [MAIN ] Update Progress: 859/2367 symbols completed. FNF took 30.1s. Estimated remaining: 3h 12m 6s. Rate: 7.9 symbols/min [2025-10-29T18:49:28.143517] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-29T18:49:28.231136] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:49:28.243019] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-29T18:49:28.263049] [DEBUG] [LOCAL ] FOR: Loaded 18946 existing records from primary storage. [2025-10-29T18:49:28.263307] [INFO ] [MAIN ] FOR: Loaded 18946 existing records. [2025-10-29T18:49:28.398741] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-29T18:49:28.461428] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:49:28.462059] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-29T18:49:28.462199] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-29T18:49:28.462603] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-29T18:49:28.462699] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-29T18:49:28.824904] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:49:29.193673] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-29T18:49:29.699051] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T18:49:29.735341] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-29T18:49:29.993590] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-29T18:49:30.766739] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T18:49:30.793558] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-29T18:49:31.549700] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-29T18:49:31.593533] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-29T18:49:32.359426] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-29T18:49:32.393561] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-29T18:49:33.193585] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-29T18:49:33.231944] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-29T18:49:33.603760] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T18:49:33.993560] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-29T18:49:34.702886] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-29T18:49:34.793571] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-29T18:49:35.392153] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-29T18:49:35.593555] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-29T18:49:36.096550] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-29T18:49:36.393562] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-29T18:49:36.894834] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-29T18:49:37.193555] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-29T18:49:37.671559] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-29T18:49:37.993555] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-29T18:49:38.446031] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T18:49:38.793565] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-29T18:49:39.593559] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-29T18:49:40.016929] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T18:49:40.301089] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-29T18:49:40.393535] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-29T18:49:40.944079] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-29T18:49:41.193583] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-29T18:49:41.640638] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T18:49:41.993566] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-29T18:49:42.755492] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T18:49:42.793543] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-29T18:49:43.496100] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T18:49:43.593516] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-29T18:49:44.130662] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-29T18:49:44.393542] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-29T18:49:44.924734] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T18:49:45.193603] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-29T18:49:45.882557] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T18:49:45.993578] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-29T18:49:46.571502] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-29T18:49:46.793622] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-29T18:49:47.593599] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-29T18:49:47.950916] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T18:49:48.363407] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T18:49:48.368739] [INFO ] [REMOTE ] FOR: Full fetch complete (29418 records). [2025-10-29T18:49:48.368853] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-29T18:49:48.398753] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-29T18:49:48.744627] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-29T18:49:48.744728] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-29T18:49:48.745250] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-29T18:49:48.745289] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-29T18:49:48.745972] [DEBUG] [LOCAL ] FOR: Trimmed 29418 records to 18908 (keeping 200 days of data) [2025-10-29T18:49:48.854791] [DEBUG] [LOCAL ] FOR: Primary data saved (18908 records). [2025-10-29T18:49:48.854926] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-29T18:49:48.855020] [INFO ] [MAIN ] Update Progress: 860/2367 symbols completed. FOR took 20.9s. Estimated remaining: 3h 12m 22s. Rate: 7.8 symbols/min [2025-10-29T18:49:49.021991] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:49:49.065090] [DEBUG] [LOCAL ] FOUR: Loaded 49590 existing records from primary storage. [2025-10-29T18:49:49.065389] [INFO ] [MAIN ] FOUR: Loaded 49590 existing records. [2025-10-29T18:49:49.176883] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T18:49:49.197717] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-29T18:49:49.258638] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:49:49.259006] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-29T18:49:49.259067] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-29T18:49:49.259897] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-29T18:49:49.259958] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-29T18:49:49.645054] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:49:49.993549] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-29T18:49:50.576810] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T18:49:50.594806] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T18:49:50.597840] [INFO ] [REMOTE ] FOA: Full fetch complete (20375 records). [2025-10-29T18:49:50.597910] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-29T18:49:50.798715] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-29T18:49:50.958304] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-29T18:49:50.958375] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-29T18:49:50.958814] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-29T18:49:50.958874] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-29T18:49:50.959425] [DEBUG] [LOCAL ] FOA: Trimmed 20375 records to 12656 (keeping 200 days of data) [2025-10-29T18:49:51.030151] [DEBUG] [LOCAL ] FOA: Primary data saved (12656 records). [2025-10-29T18:49:51.030274] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-29T18:49:51.030347] [INFO ] [MAIN ] Update Progress: 861/2367 symbols completed. FOA took 35.4s. Estimated remaining: 3h 12m 4s. Rate: 7.8 symbols/min [2025-10-29T18:49:51.197777] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:49:51.215214] [DEBUG] [LOCAL ] FPF: Loaded 18437 existing records from primary storage. [2025-10-29T18:49:51.215435] [INFO ] [MAIN ] FPF: Loaded 18437 existing records. [2025-10-29T18:49:51.393011] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:49:51.393239] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-29T18:49:51.393284] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-29T18:49:51.393703] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-29T18:49:51.393760] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-29T18:49:51.598694] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-29T18:49:51.748714] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:49:52.215817] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-29T18:49:52.393561] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-29T18:49:53.178574] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T18:49:53.188678] [INFO ] [REMOTE ] FNV: Full fetch complete (66944 records). [2025-10-29T18:49:53.188816] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-29T18:49:53.200584] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-29T18:49:53.601984] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-29T18:49:53.602204] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-29T18:49:53.603309] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-29T18:49:53.603426] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-29T18:49:53.605130] [DEBUG] [LOCAL ] FNV: Trimmed 66944 records to 45814 (keeping 200 days of data) [2025-10-29T18:49:53.730255] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T18:49:53.928544] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-29T18:49:53.959308] [DEBUG] [LOCAL ] FNV: Primary data saved (45814 records). [2025-10-29T18:49:53.959423] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-29T18:49:53.959491] [INFO ] [MAIN ] Update Progress: 862/2367 symbols completed. FNV took 41.2s. Estimated remaining: 3h 11m 48s. Rate: 7.8 symbols/min [2025-10-29T18:49:53.998843] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-29T18:49:54.128993] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:49:54.145757] [DEBUG] [LOCAL ] FPH: Loaded 19084 existing records from primary storage. [2025-10-29T18:49:54.145984] [INFO ] [MAIN ] FPH: Loaded 19084 existing records. [2025-10-29T18:49:54.322082] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:49:54.322305] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-29T18:49:54.322352] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-29T18:49:54.322734] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-29T18:49:54.322791] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-29T18:49:54.663825] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:49:54.793551] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-29T18:49:55.406993] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T18:49:55.593528] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-29T18:49:55.623746] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-29T18:49:56.228448] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-29T18:49:56.393569] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-29T18:49:56.948547] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T18:49:57.193548] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-29T18:49:57.647680] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-29T18:49:57.993572] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-29T18:49:58.608254] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-29T18:49:58.610534] [INFO ] [REMOTE ] FOF: Full fetch complete (11921 records). [2025-10-29T18:49:58.610615] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-29T18:49:58.794461] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-29T18:49:58.995348] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-29T18:49:58.995442] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-29T18:49:58.995832] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-29T18:49:58.995894] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-29T18:49:58.996411] [DEBUG] [LOCAL ] FOF: Trimmed 11921 records to 8131 (keeping 200 days of data) [2025-10-29T18:49:59.046404] [DEBUG] [LOCAL ] FOF: Primary data saved (8131 records). [2025-10-29T18:49:59.046545] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-29T18:49:59.046629] [INFO ] [MAIN ] Update Progress: 863/2367 symbols completed. FOF took 34.2s. Estimated remaining: 3h 11m 36s. Rate: 7.8 symbols/min [2025-10-29T18:49:59.232638] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:49:59.263885] [DEBUG] [LOCAL ] FPI: Loaded 30983 existing records from primary storage. [2025-10-29T18:49:59.264193] [INFO ] [MAIN ] FPI: Loaded 30983 existing records. [2025-10-29T18:49:59.453755] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:49:59.453965] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-29T18:49:59.454014] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-29T18:49:59.454597] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-29T18:49:59.454693] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-29T18:49:59.610559] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-29T18:49:59.794670] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-29T18:49:59.863816] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:50:00.393709] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-29T18:50:00.936142] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T18:50:01.193524] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-29T18:50:01.328776] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T18:50:01.902429] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T18:50:01.993571] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-29T18:50:02.668245] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T18:50:02.793548] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-29T18:50:03.552850] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-29T18:50:03.593528] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-29T18:50:04.272701] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-29T18:50:04.393607] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-29T18:50:05.193575] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-29T18:50:05.781591] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T18:50:05.946715] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-29T18:50:05.993540] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-29T18:50:06.713090] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T18:50:06.793533] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-29T18:50:07.494987] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-29T18:50:07.593564] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-29T18:50:08.393530] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-29T18:50:08.423983] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-29T18:50:08.968248] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-29T18:50:09.193555] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-29T18:50:09.993568] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-29T18:50:10.448018] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T18:50:10.673630] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T18:50:10.793562] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-29T18:50:11.593579] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-29T18:50:11.764636] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-29T18:50:11.770412] [INFO ] [REMOTE ] FPF: Full fetch complete (26583 records). [2025-10-29T18:50:11.770516] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-29T18:50:12.172439] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-29T18:50:12.172516] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-29T18:50:12.173103] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-29T18:50:12.173200] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-29T18:50:12.173908] [DEBUG] [LOCAL ] FPF: Trimmed 26583 records to 18458 (keeping 200 days of data) [2025-10-29T18:50:12.283853] [DEBUG] [LOCAL ] FPF: Primary data saved (18458 records). [2025-10-29T18:50:12.283986] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-29T18:50:12.284063] [INFO ] [MAIN ] Update Progress: 864/2367 symbols completed. FPF took 21.3s. Estimated remaining: 3h 11m 38s. Rate: 7.8 symbols/min [2025-10-29T18:50:12.395768] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-29T18:50:12.478870] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:50:12.501596] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T18:50:12.550105] [DEBUG] [LOCAL ] FR: Loaded 46483 existing records from primary storage. [2025-10-29T18:50:12.550438] [INFO ] [MAIN ] FR: Loaded 46483 existing records. [2025-10-29T18:50:12.746770] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:50:12.746980] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-29T18:50:12.747026] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-29T18:50:12.747206] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-29T18:50:12.747243] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-29T18:50:13.126006] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T18:50:13.153289] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:50:13.193519] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-29T18:50:13.993537] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-29T18:50:14.301588] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T18:50:14.793544] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-29T18:50:14.824257] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T18:50:15.593582] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-29T18:50:15.982740] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:50:16.339254] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T18:50:16.393539] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-29T18:50:17.047580] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-29T18:50:17.193571] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-29T18:50:17.911414] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-29T18:50:17.993570] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-29T18:50:18.793580] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-29T18:50:18.934204] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T18:50:18.938473] [INFO ] [REMOTE ] FPH: Full fetch complete (30781 records). [2025-10-29T18:50:18.938592] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-29T18:50:19.303781] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-29T18:50:19.303863] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-29T18:50:19.304405] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-29T18:50:19.304448] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-29T18:50:19.305270] [DEBUG] [LOCAL ] FPH: Trimmed 30781 records to 19121 (keeping 200 days of data) [2025-10-29T18:50:19.408348] [DEBUG] [LOCAL ] FPH: Primary data saved (19121 records). [2025-10-29T18:50:19.408486] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-29T18:50:19.408564] [INFO ] [MAIN ] Update Progress: 865/2367 symbols completed. FPH took 25.4s. Estimated remaining: 3h 11m 30s. Rate: 7.8 symbols/min [2025-10-29T18:50:19.578355] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:50:19.591929] [DEBUG] [LOCAL ] FRA: Loaded 13295 existing records from primary storage. [2025-10-29T18:50:19.592144] [INFO ] [MAIN ] FRA: Loaded 13295 existing records. [2025-10-29T18:50:19.603678] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-29T18:50:19.794829] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:50:19.795062] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-29T18:50:19.795110] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-29T18:50:19.795576] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-29T18:50:19.795696] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-29T18:50:20.175710] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:50:20.206261] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T18:50:20.393600] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-29T18:50:20.871630] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T18:50:21.193538] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-29T18:50:21.383742] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T18:50:21.993632] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-29T18:50:22.744884] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T18:50:22.793565] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-29T18:50:23.024554] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-29T18:50:23.593613] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-29T18:50:24.294019] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-29T18:50:24.393570] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-29T18:50:24.569765] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T18:50:25.193599] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-29T18:50:25.993597] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-29T18:50:26.114631] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-29T18:50:26.125467] [INFO ] [REMOTE ] FOUR: Full fetch complete (72296 records). [2025-10-29T18:50:26.125699] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-29T18:50:26.551008] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-29T18:50:26.547364] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T18:50:26.561022] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-29T18:50:26.562598] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-29T18:50:26.563155] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-29T18:50:26.564486] [DEBUG] [LOCAL ] FOUR: Trimmed 72296 records to 49615 (keeping 200 days of data) [2025-10-29T18:50:26.779277] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T18:50:26.794767] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-29T18:50:26.893678] [DEBUG] [LOCAL ] FOUR: Primary data saved (49615 records). [2025-10-29T18:50:26.893829] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-29T18:50:26.894773] [INFO ] [MAIN ] Update Progress: 866/2367 symbols completed. FOUR took 38.0s. Estimated remaining: 3h 11m 22s. Rate: 7.8 symbols/min [2025-10-29T18:50:27.075007] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:50:27.093041] [DEBUG] [LOCAL ] FRGE: Loaded 15273 existing records from primary storage. [2025-10-29T18:50:27.093296] [INFO ] [MAIN ] FRGE: Loaded 15273 existing records. [2025-10-29T18:50:27.279864] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:50:27.280070] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-29T18:50:27.280116] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-29T18:50:27.280542] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-29T18:50:27.280599] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-29T18:50:27.523161] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T18:50:27.601920] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-29T18:50:27.680933] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:50:28.301602] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T18:50:28.393583] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-29T18:50:28.991250] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T18:50:29.193614] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-29T18:50:29.993576] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-29T18:50:30.358237] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T18:50:30.793622] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-29T18:50:31.216310] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T18:50:31.593623] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-29T18:50:31.852276] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T18:50:32.220345] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T18:50:32.393573] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-29T18:50:32.926723] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T18:50:33.193546] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-29T18:50:33.993540] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-29T18:50:34.349252] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T18:50:34.491757] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-29T18:50:34.793685] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-29T18:50:35.593573] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-29T18:50:35.870177] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-29T18:50:36.131474] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T18:50:36.393766] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-29T18:50:37.193531] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-29T18:50:37.341785] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-29T18:50:37.993591] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-29T18:50:38.162337] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T18:50:38.793539] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-29T18:50:38.920154] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-29T18:50:39.520611] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-29T18:50:39.523853] [INFO ] [REMOTE ] FRA: Full fetch complete (22773 records). [2025-10-29T18:50:39.523951] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-29T18:50:39.598848] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-29T18:50:39.892387] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-29T18:50:39.892469] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-29T18:50:39.892959] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-29T18:50:39.893022] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-29T18:50:39.893710] [DEBUG] [LOCAL ] FRA: Trimmed 22773 records to 13241 (keeping 200 days of data) [2025-10-29T18:50:39.972135] [DEBUG] [LOCAL ] FRA: Primary data saved (13241 records). [2025-10-29T18:50:39.972278] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-29T18:50:39.972357] [INFO ] [MAIN ] Update Progress: 867/2367 symbols completed. FRA took 20.6s. Estimated remaining: 3h 11m 24s. Rate: 7.8 symbols/min [2025-10-29T18:50:40.150933] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:50:40.200743] [DEBUG] [LOCAL ] FRO: Loaded 51591 existing records from primary storage. [2025-10-29T18:50:40.201035] [INFO ] [MAIN ] FRO: Loaded 51591 existing records. [2025-10-29T18:50:40.381791] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:50:40.382030] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-29T18:50:40.382088] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-29T18:50:40.382531] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-29T18:50:40.382590] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-29T18:50:40.403129] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-29T18:50:40.750746] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:50:40.770537] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T18:50:41.193546] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-29T18:50:41.238389] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T18:50:41.993592] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-29T18:50:42.793526] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-29T18:50:42.955115] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T18:50:42.954518] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-29T18:50:42.971398] [INFO ] [REMOTE ] FPI: Full fetch complete (43639 records). [2025-10-29T18:50:42.971601] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-29T18:50:43.337486] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-29T18:50:43.337563] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-29T18:50:43.338247] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-29T18:50:43.338337] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-29T18:50:43.339258] [DEBUG] [LOCAL ] FPI: Trimmed 43639 records to 30948 (keeping 200 days of data) [2025-10-29T18:50:43.521215] [DEBUG] [LOCAL ] FPI: Primary data saved (30948 records). [2025-10-29T18:50:43.521346] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-29T18:50:43.521423] [INFO ] [MAIN ] Update Progress: 868/2367 symbols completed. FPI took 44.5s. Estimated remaining: 3h 11m 9s. Rate: 7.8 symbols/min [2025-10-29T18:50:43.598703] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-29T18:50:43.695694] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:50:43.733260] [DEBUG] [LOCAL ] FRT: Loaded 41037 existing records from primary storage. [2025-10-29T18:50:43.733563] [INFO ] [MAIN ] FRT: Loaded 41037 existing records. [2025-10-29T18:50:43.917168] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:50:43.917358] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-29T18:50:43.917473] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-29T18:50:43.917866] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-29T18:50:43.917982] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-29T18:50:44.080218] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T18:50:44.312673] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:50:44.393515] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-29T18:50:44.992462] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-29T18:50:45.193569] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-29T18:50:45.534675] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T18:50:45.993620] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-29T18:50:46.644085] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T18:50:46.793570] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-29T18:50:47.190154] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T18:50:47.593581] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-29T18:50:48.215870] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T18:50:48.393588] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-29T18:50:48.647286] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T18:50:49.193595] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-29T18:50:49.738871] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-29T18:50:49.940601] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T18:50:49.993544] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-29T18:50:50.793559] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-29T18:50:51.385202] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T18:50:51.593565] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-29T18:50:51.746047] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T18:50:52.138601] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-29T18:50:52.393603] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-29T18:50:53.074765] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T18:50:53.193588] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-29T18:50:53.731637] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T18:50:53.993559] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-29T18:50:54.793594] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-29T18:50:55.231171] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T18:50:55.593600] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-29T18:50:56.083689] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T18:50:56.393552] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-29T18:50:56.666420] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-29T18:50:57.193593] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-29T18:50:57.619221] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T18:50:57.827327] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T18:50:57.830631] [INFO ] [REMOTE ] FRGE: Full fetch complete (29608 records). [2025-10-29T18:50:57.830742] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-29T18:50:57.999452] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-29T18:50:58.195768] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-29T18:50:58.195846] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-29T18:50:58.196370] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-29T18:50:58.196408] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-29T18:50:58.197083] [DEBUG] [LOCAL ] FRGE: Trimmed 29608 records to 15222 (keeping 200 days of data) [2025-10-29T18:50:58.283582] [DEBUG] [LOCAL ] FRGE: Primary data saved (15222 records). [2025-10-29T18:50:58.283738] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-29T18:50:58.283825] [INFO ] [MAIN ] Update Progress: 869/2367 symbols completed. FRGE took 31.4s. Estimated remaining: 3h 11m 13s. Rate: 7.8 symbols/min [2025-10-29T18:50:58.450486] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:50:58.487921] [DEBUG] [LOCAL ] FSCO: Loaded 38332 existing records from primary storage. [2025-10-29T18:50:58.488183] [INFO ] [MAIN ] FSCO: Loaded 38332 existing records. [2025-10-29T18:50:58.661813] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:50:58.662072] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-29T18:50:58.662119] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-29T18:50:58.662305] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-29T18:50:58.662359] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-29T18:50:58.802053] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-29T18:50:59.024403] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:50:59.263487] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T18:50:59.593581] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-29T18:51:00.148171] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T18:51:00.393616] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-29T18:51:00.546859] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T18:51:01.193565] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-29T18:51:01.833263] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-29T18:51:01.845234] [INFO ] [REMOTE ] FR: Full fetch complete (67521 records). [2025-10-29T18:51:01.845407] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-29T18:51:02.003240] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-29T18:51:02.261978] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-29T18:51:02.262063] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-29T18:51:02.262903] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-29T18:51:02.262967] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-29T18:51:02.264285] [DEBUG] [LOCAL ] FR: Trimmed 67521 records to 46442 (keeping 200 days of data) [2025-10-29T18:51:02.568915] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T18:51:02.586401] [DEBUG] [LOCAL ] FR: Primary data saved (46442 records). [2025-10-29T18:51:02.586503] [INFO ] [MAIN ] FR: Full history saved. [2025-10-29T18:51:02.586574] [INFO ] [MAIN ] Update Progress: 870/2367 symbols completed. FR took 50.3s. Estimated remaining: 3h 11m 0s. Rate: 7.8 symbols/min [2025-10-29T18:51:02.755668] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:51:02.798206] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-29T18:51:02.801315] [DEBUG] [LOCAL ] FSK: Loaded 49374 existing records from primary storage. [2025-10-29T18:51:02.801800] [INFO ] [MAIN ] FSK: Loaded 49374 existing records. [2025-10-29T18:51:02.990309] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:51:02.990738] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-29T18:51:02.990895] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-29T18:51:02.997380] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-29T18:51:03.008232] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-29T18:51:03.053366] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T18:51:03.368079] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:51:03.593587] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-29T18:51:04.014302] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T18:51:04.393563] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-29T18:51:04.822471] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T18:51:05.193553] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-29T18:51:05.583520] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T18:51:05.993519] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-29T18:51:06.153404] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-29T18:51:06.793632] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-29T18:51:07.593595] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-29T18:51:07.689230] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-29T18:51:07.701251] [INFO ] [REMOTE ] FRO: Full fetch complete (75303 records). [2025-10-29T18:51:07.701498] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-29T18:51:08.128263] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T18:51:08.197440] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-29T18:51:08.197543] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-29T18:51:08.198566] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-29T18:51:08.198666] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-29T18:51:08.200433] [DEBUG] [LOCAL ] FRO: Trimmed 75303 records to 51579 (keeping 200 days of data) [2025-10-29T18:51:08.411237] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-29T18:51:08.542483] [DEBUG] [LOCAL ] FRO: Primary data saved (51579 records). [2025-10-29T18:51:08.542692] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-29T18:51:08.542816] [INFO ] [MAIN ] Update Progress: 871/2367 symbols completed. FRO took 28.6s. Estimated remaining: 3h 10m 49s. Rate: 7.8 symbols/min [2025-10-29T18:51:08.820560] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:51:08.865511] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T18:51:08.929903] [DEBUG] [LOCAL ] FSLY: Loaded 51200 existing records from primary storage. [2025-10-29T18:51:08.930374] [INFO ] [MAIN ] FSLY: Loaded 51200 existing records. [2025-10-29T18:51:09.203485] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-29T18:51:09.237872] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:51:09.238865] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-29T18:51:09.238933] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-29T18:51:09.239379] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-29T18:51:09.239423] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-29T18:51:09.465067] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-29T18:51:09.798119] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:51:09.993576] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-29T18:51:10.427128] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T18:51:10.793605] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-29T18:51:11.593566] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-29T18:51:12.134465] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T18:51:12.372493] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T18:51:12.398725] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-29T18:51:12.403954] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-29T18:51:13.193592] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-29T18:51:13.423728] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-29T18:51:13.993639] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-29T18:51:14.540426] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T18:51:14.793620] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-29T18:51:15.092068] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-29T18:51:15.593604] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-29T18:51:16.233782] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-29T18:51:16.393617] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-29T18:51:16.677112] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T18:51:17.193558] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-29T18:51:17.786613] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-29T18:51:17.993607] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-29T18:51:18.435944] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T18:51:18.793619] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-29T18:51:19.279205] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T18:51:19.593591] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-29T18:51:20.084202] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T18:51:20.094177] [INFO ] [REMOTE ] FSCO: Full fetch complete (55319 records). [2025-10-29T18:51:20.094285] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-29T18:51:20.398834] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-29T18:51:20.586439] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-29T18:51:20.586586] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-29T18:51:20.588385] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-29T18:51:20.588491] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-29T18:51:20.590600] [DEBUG] [LOCAL ] FSCO: Trimmed 55319 records to 38302 (keeping 200 days of data) [2025-10-29T18:51:20.857771] [DEBUG] [LOCAL ] FSCO: Primary data saved (38302 records). [2025-10-29T18:51:20.857971] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-29T18:51:20.858932] [INFO ] [MAIN ] Update Progress: 872/2367 symbols completed. FSCO took 22.6s. Estimated remaining: 3h 10m 50s. Rate: 7.8 symbols/min [2025-10-29T18:51:21.089618] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:51:21.128670] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T18:51:21.194339] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-29T18:51:21.196890] [DEBUG] [LOCAL ] FSM: Loaded 53298 existing records from primary storage. [2025-10-29T18:51:21.197334] [INFO ] [MAIN ] FSM: Loaded 53298 existing records. [2025-10-29T18:51:21.397783] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:51:21.398196] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-29T18:51:21.398255] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-29T18:51:21.398584] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-29T18:51:21.398633] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-29T18:51:21.813751] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:51:21.843779] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-29T18:51:21.993598] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-29T18:51:22.459801] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-29T18:51:22.468926] [INFO ] [REMOTE ] FRT: Full fetch complete (60397 records). [2025-10-29T18:51:22.469119] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-29T18:51:22.798823] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-29T18:51:22.886965] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-29T18:51:22.887092] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-29T18:51:22.888515] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-29T18:51:22.888598] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-29T18:51:22.890494] [DEBUG] [LOCAL ] FRT: Trimmed 60397 records to 41004 (keeping 200 days of data) [2025-10-29T18:51:23.189396] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T18:51:23.220307] [DEBUG] [LOCAL ] FRT: Primary data saved (41004 records). [2025-10-29T18:51:23.220974] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-29T18:51:23.221098] [INFO ] [MAIN ] Update Progress: 873/2367 symbols completed. FRT took 39.7s. Estimated remaining: 3h 10m 33s. Rate: 7.8 symbols/min [2025-10-29T18:51:23.416048] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:51:23.454363] [DEBUG] [LOCAL ] FSS: Loaded 32538 existing records from primary storage. [2025-10-29T18:51:23.454750] [INFO ] [MAIN ] FSS: Loaded 32538 existing records. [2025-10-29T18:51:23.598772] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-29T18:51:23.645486] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:51:23.645969] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-29T18:51:23.646045] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-29T18:51:23.646366] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-29T18:51:23.646424] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-29T18:51:24.035140] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:51:24.138369] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T18:51:24.393593] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-29T18:51:25.023736] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T18:51:25.193543] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-29T18:51:25.993580] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-29T18:51:26.186856] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-29T18:51:26.542728] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T18:51:26.793559] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-29T18:51:27.218763] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T18:51:27.593564] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-29T18:51:28.283610] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T18:51:28.393555] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-29T18:51:28.882910] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T18:51:29.193574] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-29T18:51:29.791154] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T18:51:29.993557] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-29T18:51:30.486401] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T18:51:30.793554] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-29T18:51:31.291265] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T18:51:31.593571] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-29T18:51:32.157980] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T18:51:32.393536] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-29T18:51:32.492111] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T18:51:33.193569] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-29T18:51:34.004551] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-29T18:51:34.010617] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-29T18:51:34.022104] [INFO ] [REMOTE ] FSLY: Full fetch complete (74844 records). [2025-10-29T18:51:34.022259] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-29T18:51:34.418213] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-29T18:51:34.418337] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-29T18:51:34.419272] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-29T18:51:34.419352] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-29T18:51:34.420870] [DEBUG] [LOCAL ] FSLY: Trimmed 74844 records to 51196 (keeping 200 days of data) [2025-10-29T18:51:34.531719] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T18:51:34.743623] [DEBUG] [LOCAL ] FSLY: Primary data saved (51196 records). [2025-10-29T18:51:34.743774] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-29T18:51:34.743851] [INFO ] [MAIN ] Update Progress: 874/2367 symbols completed. FSLY took 26.2s. Estimated remaining: 3h 10m 32s. Rate: 7.8 symbols/min [2025-10-29T18:51:34.806760] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-29T18:51:34.917527] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:51:34.926272] [DEBUG] [LOCAL ] FT: Loaded 6758 existing records from primary storage. [2025-10-29T18:51:34.926476] [INFO ] [MAIN ] FT: Loaded 6758 existing records. [2025-10-29T18:51:35.103506] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:51:35.103754] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-29T18:51:35.103817] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-29T18:51:35.103957] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-29T18:51:35.103994] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-29T18:51:35.462493] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:51:35.593515] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-29T18:51:35.712776] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-29T18:51:35.724334] [INFO ] [REMOTE ] FSK: Full fetch complete (72148 records). [2025-10-29T18:51:35.724581] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-29T18:51:35.996131] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:51:36.138151] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-29T18:51:36.138223] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-29T18:51:36.139069] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-29T18:51:36.139130] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-29T18:51:36.140432] [DEBUG] [LOCAL ] FSK: Trimmed 72148 records to 49354 (keeping 200 days of data) [2025-10-29T18:51:36.393864] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-29T18:51:36.455908] [DEBUG] [LOCAL ] FSK: Primary data saved (49354 records). [2025-10-29T18:51:36.456043] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-29T18:51:36.456118] [INFO ] [MAIN ] Update Progress: 875/2367 symbols completed. FSK took 33.9s. Estimated remaining: 3h 10m 14s. Rate: 7.8 symbols/min [2025-10-29T18:51:36.625291] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:51:36.639080] [DEBUG] [LOCAL ] FTHY: Loaded 11966 existing records from primary storage. [2025-10-29T18:51:36.639303] [INFO ] [MAIN ] FTHY: Loaded 11966 existing records. [2025-10-29T18:51:36.817229] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:51:36.817700] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-29T18:51:36.817912] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-29T18:51:36.818467] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-29T18:51:36.818526] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-29T18:51:37.105943] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T18:51:37.199442] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-29T18:51:37.206176] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:51:37.243572] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-29T18:51:37.993599] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-29T18:51:38.357092] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T18:51:38.732320] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-29T18:51:38.793573] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-29T18:51:39.157142] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T18:51:39.593587] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-29T18:51:40.393603] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-29T18:51:40.901107] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T18:51:41.056831] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T18:51:41.193580] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-29T18:51:41.554142] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T18:51:41.993599] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-29T18:51:42.712033] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T18:51:42.793606] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-29T18:51:43.294786] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T18:51:43.593627] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-29T18:51:44.393575] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-29T18:51:45.064842] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T18:51:45.193568] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-29T18:51:45.548514] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T18:51:45.648712] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T18:51:45.993595] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-29T18:51:46.488472] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-29T18:51:46.793574] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-29T18:51:47.593565] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-29T18:51:48.064628] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-29T18:51:48.198270] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T18:51:48.393564] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-29T18:51:49.193591] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-29T18:51:49.840031] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T18:51:49.851309] [INFO ] [REMOTE ] FSM: Full fetch complete (77236 records). [2025-10-29T18:51:49.851471] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-29T18:51:49.998716] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-29T18:51:50.269375] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-29T18:51:50.269535] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-29T18:51:50.270808] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-29T18:51:50.270957] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-29T18:51:50.273067] [DEBUG] [LOCAL ] FSM: Trimmed 77236 records to 53294 (keeping 200 days of data) [2025-10-29T18:51:50.402035] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T18:51:50.606030] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-29T18:51:50.629994] [DEBUG] [LOCAL ] FSM: Primary data saved (53294 records). [2025-10-29T18:51:50.630106] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-29T18:51:50.631149] [INFO ] [MAIN ] Update Progress: 876/2367 symbols completed. FSM took 29.8s. Estimated remaining: 3h 10m 18s. Rate: 7.8 symbols/min [2025-10-29T18:51:50.800508] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-29T18:51:50.803918] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:51:50.857779] [DEBUG] [LOCAL ] FTI: Loaded 53291 existing records from primary storage. [2025-10-29T18:51:50.858108] [INFO ] [MAIN ] FTI: Loaded 53291 existing records. [2025-10-29T18:51:51.047583] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:51:51.047822] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-29T18:51:51.047870] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-29T18:51:51.048256] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-29T18:51:51.048296] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-29T18:51:51.389141] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T18:51:51.460736] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:51:51.593554] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-29T18:51:52.393560] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-29T18:51:52.831281] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T18:51:52.850016] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-29T18:51:53.193555] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-29T18:51:53.666096] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T18:51:53.993587] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-29T18:51:54.653450] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T18:51:54.657194] [INFO ] [REMOTE ] FTHY: Full fetch complete (17252 records). [2025-10-29T18:51:54.657500] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-29T18:51:54.801738] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-29T18:51:55.047018] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-29T18:51:55.047126] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-29T18:51:55.047561] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-29T18:51:55.047605] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-29T18:51:55.048352] [DEBUG] [LOCAL ] FTHY: Trimmed 17252 records to 11953 (keeping 200 days of data) [2025-10-29T18:51:55.120830] [DEBUG] [LOCAL ] FTHY: Primary data saved (11953 records). [2025-10-29T18:51:55.120968] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-29T18:51:55.121059] [INFO ] [MAIN ] Update Progress: 877/2367 symbols completed. FTHY took 18.7s. Estimated remaining: 3h 10m 5s. Rate: 7.8 symbols/min [2025-10-29T18:51:55.593614] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-29T18:51:55.815341] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T18:51:55.938215] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-29T18:51:56.393600] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-29T18:51:57.193558] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-29T18:51:57.571935] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T18:51:57.663750] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T18:51:57.993567] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-29T18:51:58.793584] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-29T18:51:59.230283] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:51:59.262348] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-29T18:51:59.593536] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-29T18:52:00.162954] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-29T18:52:00.393560] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-29T18:52:01.193629] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-29T18:52:01.797390] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T18:52:01.869149] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-29T18:52:01.872130] [INFO ] [REMOTE ] FT: Full fetch complete (9376 records). [2025-10-29T18:52:01.872235] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-29T18:52:01.998789] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-29T18:52:02.290704] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-29T18:52:02.290816] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-29T18:52:02.291167] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-29T18:52:02.291230] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-29T18:52:02.291776] [DEBUG] [LOCAL ] FT: Trimmed 9376 records to 6709 (keeping 200 days of data) [2025-10-29T18:52:02.331885] [DEBUG] [LOCAL ] FT: Primary data saved (6709 records). [2025-10-29T18:52:02.332024] [INFO ] [MAIN ] FT: Full history saved. [2025-10-29T18:52:02.332103] [INFO ] [MAIN ] Update Progress: 878/2367 symbols completed. FT took 27.6s. Estimated remaining: 3h 9m 56s. Rate: 7.8 symbols/min [2025-10-29T18:52:02.793696] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-29T18:52:02.888618] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:52:03.593766] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-29T18:52:04.334127] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T18:52:04.393589] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-29T18:52:04.471805] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-29T18:52:05.193581] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-29T18:52:05.977289] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-29T18:52:05.993531] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-29T18:52:06.584627] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-29T18:52:06.591081] [INFO ] [REMOTE ] FSS: Full fetch complete (48475 records). [2025-10-29T18:52:06.591201] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-29T18:52:06.971382] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-29T18:52:06.971460] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-29T18:52:06.972151] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-29T18:52:06.972211] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-29T18:52:06.973224] [DEBUG] [LOCAL ] FSS: Trimmed 48475 records to 32549 (keeping 200 days of data) [2025-10-29T18:52:07.179903] [DEBUG] [LOCAL ] FSS: Primary data saved (32549 records). [2025-10-29T18:52:07.180067] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-29T18:52:07.180779] [INFO ] [MAIN ] Update Progress: 879/2367 symbols completed. FSS took 44.0s. Estimated remaining: 3h 9m 44s. Rate: 7.8 symbols/min [2025-10-29T18:52:07.724986] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-29T18:52:07.735839] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-29T18:52:09.330775] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-29T18:52:09.342191] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-29T18:52:10.761756] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-29T18:52:10.774115] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-29T18:52:12.107633] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T18:52:12.119348] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-29T18:52:13.956132] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-29T18:52:13.967497] [INFO ] [REMOTE ] FTI: Full fetch complete (77336 records). [2025-10-29T18:52:13.967684] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-29T18:52:14.384872] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-29T18:52:14.384958] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-29T18:52:14.385906] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-29T18:52:14.385970] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-29T18:52:14.387399] [DEBUG] [LOCAL ] FTI: Trimmed 77336 records to 53289 (keeping 200 days of data) [2025-10-29T18:52:14.703335] [DEBUG] [LOCAL ] FTI: Primary data saved (53289 records). [2025-10-29T18:52:14.703461] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-29T18:52:14.704453] [INFO ] [MAIN ] Update Progress: 880/2367 symbols completed. FTI took 24.1s. Estimated remaining: 3h 9m 36s. Rate: 7.8 symbols/min [2025-10-29T18:52:15.278220] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:52:15.415310] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:52:15.429580] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:52:15.452348] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:52:15.459678] [DEBUG] [LOCAL ] FTWO: Loaded 1923 existing records from primary storage. [2025-10-29T18:52:15.460294] [INFO ] [MAIN ] FTWO: Loaded 1923 existing records. [2025-10-29T18:52:15.645153] [DEBUG] [LOCAL ] FTK: Loaded 33060 existing records from primary storage. [2025-10-29T18:52:15.677581] [INFO ] [MAIN ] FTK: Loaded 33060 existing records. [2025-10-29T18:52:15.747738] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:52:15.749131] [DEBUG] [LOCAL ] FTS: Loaded 42265 existing records from primary storage. [2025-10-29T18:52:15.761441] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-29T18:52:15.784281] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-29T18:52:15.767589] [INFO ] [MAIN ] FTS: Loaded 42265 existing records. [2025-10-29T18:52:15.808519] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-29T18:52:15.841444] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-29T18:52:15.878052] [DEBUG] [LOCAL ] FTV: Loaded 52998 existing records from primary storage. [2025-10-29T18:52:15.905886] [INFO ] [MAIN ] FTV: Loaded 52998 existing records. [2025-10-29T18:52:16.117611] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:52:16.166115] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-29T18:52:16.175037] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-29T18:52:16.196152] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-29T18:52:16.232411] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-29T18:52:16.455544] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:52:16.629536] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-29T18:52:16.721452] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:52:16.763035] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-29T18:52:16.763221] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-29T18:52:16.796399] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-29T18:52:16.829585] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-29T18:52:16.808677] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-29T18:52:16.833267] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-29T18:52:16.878919] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-29T18:52:17.213670] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:52:17.247074] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-29T18:52:17.516305] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:52:17.609568] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-29T18:52:17.854676] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-29T18:52:17.873607] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-29T18:52:17.988583] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:52:18.032833] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:52:18.034374] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-29T18:52:18.033929] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-29T18:52:18.312071] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-29T18:52:18.313433] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-29T18:52:18.523589] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-29T18:52:18.528838] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-29T18:52:18.591131] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-29T18:52:18.592238] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-29T18:52:18.857626] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-29T18:52:18.858728] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-29T18:52:19.005310] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T18:52:19.013436] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-29T18:52:19.068950] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-29T18:52:19.070159] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-29T18:52:19.082786] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T18:52:19.087359] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-29T18:52:19.380114] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-29T18:52:19.593596] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-29T18:52:19.817418] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-29T18:52:19.895995] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-29T18:52:20.003157] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T18:52:20.065538] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T18:52:20.393554] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-29T18:52:21.193606] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-29T18:52:21.517708] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-29T18:52:21.587334] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T18:52:21.993569] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-29T18:52:22.326828] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T18:52:22.793588] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-29T18:52:23.593630] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-29T18:52:24.152207] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T18:52:24.393551] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-29T18:52:24.453098] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-29T18:52:25.193556] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-29T18:52:25.427046] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T18:52:25.993519] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-29T18:52:26.204780] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T18:52:26.793535] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-29T18:52:27.118328] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T18:52:27.593587] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-29T18:52:27.901077] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T18:52:28.393567] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-29T18:52:28.787166] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-29T18:52:28.789065] [INFO ] [REMOTE ] FTWO: Full fetch complete (3284 records). [2025-10-29T18:52:28.791674] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T18:52:28.800448] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-29T18:52:29.155061] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-29T18:52:29.155148] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-29T18:52:29.155280] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-29T18:52:29.155318] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-29T18:52:29.155751] [DEBUG] [LOCAL ] FTWO: Trimmed 3284 records to 1933 (keeping 200 days of data) [2025-10-29T18:52:29.167368] [DEBUG] [LOCAL ] FTWO: Primary data saved (1933 records). [2025-10-29T18:52:29.167436] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-29T18:52:29.167518] [INFO ] [MAIN ] Update Progress: 881/2367 symbols completed. FTWO took 14.5s. Estimated remaining: 3h 9m 40s. Rate: 7.8 symbols/min [2025-10-29T18:52:29.198697] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-29T18:52:29.338576] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:52:29.393061] [DEBUG] [LOCAL ] FUBO: Loaded 53714 existing records from primary storage. [2025-10-29T18:52:29.393392] [INFO ] [MAIN ] FUBO: Loaded 53714 existing records. [2025-10-29T18:52:29.567530] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:52:29.567786] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-29T18:52:29.567848] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-29T18:52:29.568402] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-29T18:52:29.568459] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-29T18:52:29.934467] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:52:29.993551] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-29T18:52:30.180524] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T18:52:30.793564] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-29T18:52:31.593542] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-29T18:52:31.738989] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T18:52:31.775742] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-29T18:52:32.393603] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-29T18:52:32.796876] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T18:52:33.193703] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-29T18:52:33.993520] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-29T18:52:34.088029] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-29T18:52:34.116476] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T18:52:34.793590] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-29T18:52:34.882320] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:52:35.593571] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-29T18:52:36.050754] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T18:52:36.393588] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-29T18:52:36.446517] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-29T18:52:37.193586] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-29T18:52:37.993637] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-29T18:52:38.151483] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-29T18:52:38.294505] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-29T18:52:38.305044] [INFO ] [REMOTE ] FTK: Full fetch complete (44087 records). [2025-10-29T18:52:38.305228] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-29T18:52:38.694757] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-29T18:52:38.694854] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-29T18:52:38.695528] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-29T18:52:38.695588] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-29T18:52:38.696942] [DEBUG] [LOCAL ] FTK: Trimmed 44087 records to 33149 (keeping 200 days of data) [2025-10-29T18:52:38.793695] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-29T18:52:38.902280] [DEBUG] [LOCAL ] FTK: Primary data saved (33149 records). [2025-10-29T18:52:38.902411] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-29T18:52:38.902489] [INFO ] [MAIN ] Update Progress: 882/2367 symbols completed. FTK took 24.2s. Estimated remaining: 3h 9m 36s. Rate: 7.8 symbols/min [2025-10-29T18:52:39.075957] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:52:39.107218] [DEBUG] [LOCAL ] FUL: Loaded 31642 existing records from primary storage. [2025-10-29T18:52:39.107519] [INFO ] [MAIN ] FUL: Loaded 31642 existing records. [2025-10-29T18:52:39.290029] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:52:39.290239] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-29T18:52:39.290429] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-29T18:52:39.290872] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-29T18:52:39.290936] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-29T18:52:39.468934] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T18:52:39.594571] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-29T18:52:39.701711] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:52:40.393585] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-29T18:52:40.545931] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-29T18:52:40.922428] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T18:52:40.932035] [INFO ] [REMOTE ] FTS: Full fetch complete (60972 records). [2025-10-29T18:52:40.932201] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-29T18:52:41.193822] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-29T18:52:41.354379] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-29T18:52:41.354478] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-29T18:52:41.355297] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-29T18:52:41.355358] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-29T18:52:41.356718] [DEBUG] [LOCAL ] FTS: Trimmed 60972 records to 42262 (keeping 200 days of data) [2025-10-29T18:52:41.606692] [DEBUG] [LOCAL ] FTS: Primary data saved (42262 records). [2025-10-29T18:52:41.606818] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-29T18:52:41.606896] [INFO ] [MAIN ] Update Progress: 883/2367 symbols completed. FTS took 26.9s. Estimated remaining: 3h 9m 20s. Rate: 7.8 symbols/min [2025-10-29T18:52:41.779527] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:52:41.829285] [DEBUG] [LOCAL ] FUN: Loaded 52036 existing records from primary storage. [2025-10-29T18:52:41.829609] [INFO ] [MAIN ] FUN: Loaded 52036 existing records. [2025-10-29T18:52:42.008599] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-29T18:52:42.013791] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:52:42.028856] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-29T18:52:42.028961] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-29T18:52:42.034769] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-29T18:52:42.051637] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-29T18:52:42.154148] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-29T18:52:42.432161] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:52:42.793576] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-29T18:52:42.969762] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T18:52:43.041385] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-29T18:52:43.593576] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-29T18:52:43.743608] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T18:52:44.393607] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-29T18:52:44.492925] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T18:52:45.193576] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-29T18:52:45.789887] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T18:52:45.993564] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-29T18:52:46.793570] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-29T18:52:46.832053] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-29T18:52:47.167577] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T18:52:47.593606] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-29T18:52:47.960120] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T18:52:48.393691] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-29T18:52:49.193616] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-29T18:52:49.318677] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-29T18:52:49.524704] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T18:52:49.993576] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-29T18:52:50.100160] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-29T18:52:50.793587] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-29T18:52:51.084291] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T18:52:51.593578] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-29T18:52:52.393597] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-29T18:52:52.591041] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-29T18:52:53.193562] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-29T18:52:53.334290] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-29T18:52:53.347850] [INFO ] [REMOTE ] FTV: Full fetch complete (76625 records). [2025-10-29T18:52:53.347996] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-29T18:52:53.772156] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-29T18:52:53.772268] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-29T18:52:53.773426] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-29T18:52:53.773551] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-29T18:52:53.775067] [DEBUG] [LOCAL ] FTV: Trimmed 76625 records to 53001 (keeping 200 days of data) [2025-10-29T18:52:53.917012] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-29T18:52:54.012033] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-29T18:52:54.182723] [DEBUG] [LOCAL ] FTV: Primary data saved (53001 records). [2025-10-29T18:52:54.183071] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-29T18:52:54.183307] [INFO ] [MAIN ] Update Progress: 884/2367 symbols completed. FTV took 39.5s. Estimated remaining: 3h 9m 20s. Rate: 7.8 symbols/min [2025-10-29T18:52:54.331850] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T18:52:54.409239] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:52:54.434431] [DEBUG] [LOCAL ] FVR: Loaded 20491 existing records from primary storage. [2025-10-29T18:52:54.434857] [INFO ] [MAIN ] FVR: Loaded 20491 existing records. [2025-10-29T18:52:54.683051] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:52:54.683394] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-29T18:52:54.683462] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-29T18:52:54.683851] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-29T18:52:54.683937] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-29T18:52:54.801469] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-29T18:52:55.094546] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:52:55.593531] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-29T18:52:55.741481] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-29T18:52:56.111480] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T18:52:56.153634] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-29T18:52:56.393606] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-29T18:52:57.193736] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-29T18:52:57.656146] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T18:52:57.993534] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-29T18:52:58.076696] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T18:52:58.527621] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T18:52:58.793535] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-29T18:52:59.593530] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-29T18:52:59.662396] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T18:53:00.393559] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-29T18:53:01.193565] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-29T18:53:01.447612] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T18:53:01.486440] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-29T18:53:01.497834] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-10-29T18:53:01.497998] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-29T18:53:01.902469] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-29T18:53:01.902627] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-29T18:53:01.904600] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-29T18:53:01.904785] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-29T18:53:01.907178] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 53714 (keeping 200 days of data) [2025-10-29T18:53:01.993554] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-29T18:53:02.232196] [DEBUG] [LOCAL ] FUBO: Primary data saved (53714 records). [2025-10-29T18:53:02.232570] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-29T18:53:02.233487] [INFO ] [MAIN ] Update Progress: 885/2367 symbols completed. FUBO took 33.1s. Estimated remaining: 3h 9m 13s. Rate: 7.8 symbols/min [2025-10-29T18:53:02.428185] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:02.473485] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T18:53:02.526219] [DEBUG] [LOCAL ] FVRR: Loaded 40391 existing records from primary storage. [2025-10-29T18:53:02.526676] [INFO ] [MAIN ] FVRR: Loaded 40391 existing records. [2025-10-29T18:53:02.714006] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:53:02.714346] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-29T18:53:02.714405] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-29T18:53:02.714845] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-29T18:53:02.714907] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-29T18:53:02.794040] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-29T18:53:03.096777] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:03.116484] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T18:53:03.593541] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-29T18:53:03.793346] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-29T18:53:04.393598] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-29T18:53:04.700479] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T18:53:05.193546] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-29T18:53:05.374821] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-29T18:53:05.993547] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-29T18:53:06.245477] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T18:53:06.793687] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-29T18:53:06.973419] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T18:53:06.980900] [INFO ] [REMOTE ] FUL: Full fetch complete (47858 records). [2025-10-29T18:53:06.981182] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-29T18:53:07.368114] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-29T18:53:07.368298] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-29T18:53:07.369212] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-29T18:53:07.369414] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-29T18:53:07.370980] [DEBUG] [LOCAL ] FUL: Trimmed 47858 records to 31580 (keeping 200 days of data) [2025-10-29T18:53:07.480446] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-29T18:53:07.580468] [DEBUG] [LOCAL ] FUL: Primary data saved (31580 records). [2025-10-29T18:53:07.580608] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-29T18:53:07.580721] [INFO ] [MAIN ] Update Progress: 886/2367 symbols completed. FUL took 28.7s. Estimated remaining: 3h 9m 2s. Rate: 7.8 symbols/min [2025-10-29T18:53:07.603735] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-29T18:53:07.766728] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:07.771313] [DEBUG] [LOCAL ] FXED: Loaded 1212 existing records from primary storage. [2025-10-29T18:53:07.771536] [INFO ] [MAIN ] FXED: Loaded 1212 existing records. [2025-10-29T18:53:07.962483] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:53:07.962761] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-29T18:53:07.962814] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-29T18:53:07.962945] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-29T18:53:07.962984] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-29T18:53:08.341904] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:08.393598] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-29T18:53:08.775500] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T18:53:09.193621] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-29T18:53:09.631076] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T18:53:09.810762] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T18:53:09.993584] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-29T18:53:10.763577] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-29T18:53:10.793624] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-29T18:53:11.593583] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-29T18:53:12.119931] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T18:53:12.393596] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-29T18:53:12.587495] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T18:53:13.167611] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T18:53:13.193532] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-29T18:53:13.949129] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T18:53:13.993574] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-29T18:53:14.793633] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-29T18:53:15.097598] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T18:53:15.593591] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-29T18:53:15.870016] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-29T18:53:16.148267] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T18:53:16.393546] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-29T18:53:17.193568] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-29T18:53:17.816453] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-29T18:53:17.861719] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-29T18:53:17.873159] [INFO ] [REMOTE ] FUN: Full fetch complete (73731 records). [2025-10-29T18:53:17.873313] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-29T18:53:17.998753] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-29T18:53:18.273512] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-29T18:53:18.273604] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-29T18:53:18.274527] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-29T18:53:18.274595] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-29T18:53:18.276106] [DEBUG] [LOCAL ] FUN: Trimmed 73731 records to 52108 (keeping 200 days of data) [2025-10-29T18:53:18.390832] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-29T18:53:18.637394] [DEBUG] [LOCAL ] FUN: Primary data saved (52108 records). [2025-10-29T18:53:18.637560] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-29T18:53:18.637680] [INFO ] [MAIN ] Update Progress: 887/2367 symbols completed. FUN took 37.0s. Estimated remaining: 3h 8m 60s. Rate: 7.8 symbols/min [2025-10-29T18:53:18.798783] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-29T18:53:18.861073] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:18.905112] [DEBUG] [LOCAL ] G: Loaded 50000 existing records from primary storage. [2025-10-29T18:53:18.905403] [INFO ] [MAIN ] G: Loaded 50000 existing records. [2025-10-29T18:53:19.083427] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:53:19.083609] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-29T18:53:19.083680] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-29T18:53:19.084066] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-29T18:53:19.084124] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-29T18:53:19.177246] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T18:53:19.443756] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:19.593587] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-29T18:53:20.393555] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-29T18:53:20.701111] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-29T18:53:21.031931] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-29T18:53:21.193526] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-29T18:53:21.936726] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-29T18:53:21.940546] [INFO ] [REMOTE ] FVR: Full fetch complete (29147 records). [2025-10-29T18:53:21.940676] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-29T18:53:21.996677] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-29T18:53:22.307805] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-29T18:53:22.307941] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-29T18:53:22.308574] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-29T18:53:22.308637] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-29T18:53:22.309428] [DEBUG] [LOCAL ] FVR: Trimmed 29147 records to 20489 (keeping 200 days of data) [2025-10-29T18:53:22.433871] [DEBUG] [LOCAL ] FVR: Primary data saved (20489 records). [2025-10-29T18:53:22.433988] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-29T18:53:22.434059] [INFO ] [MAIN ] Update Progress: 888/2367 symbols completed. FVR took 28.3s. Estimated remaining: 3h 8m 46s. Rate: 7.8 symbols/min [2025-10-29T18:53:22.598258] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:22.623827] [DEBUG] [LOCAL ] GAB: Loaded 26834 existing records from primary storage. [2025-10-29T18:53:22.624093] [INFO ] [MAIN ] GAB: Loaded 26834 existing records. [2025-10-29T18:53:22.799623] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:53:22.795937] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-29T18:53:22.799967] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-29T18:53:22.800056] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-29T18:53:22.801184] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-29T18:53:22.801247] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-29T18:53:23.137021] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-29T18:53:23.168505] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:23.199637] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T18:53:23.593579] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-29T18:53:23.869432] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-29T18:53:24.393561] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-29T18:53:24.669708] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-29T18:53:25.193560] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-29T18:53:25.993564] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-29T18:53:26.332018] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-29T18:53:26.424580] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T18:53:26.793552] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-29T18:53:27.593581] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-29T18:53:27.886346] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-29T18:53:27.937264] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T18:53:28.393567] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-29T18:53:29.193562] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-29T18:53:29.440472] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T18:53:29.989730] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-29T18:53:29.994726] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-29T18:53:30.793557] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-29T18:53:31.277896] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T18:53:31.540550] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T18:53:31.593625] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-29T18:53:32.393545] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-29T18:53:32.473179] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T18:53:33.193575] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-29T18:53:33.628080] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T18:53:33.631561] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T18:53:33.629561] [INFO ] [REMOTE ] FXED: Full fetch complete (1768 records). [2025-10-29T18:53:33.631797] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-29T18:53:34.000498] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-29T18:53:34.033363] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-29T18:53:34.033444] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-29T18:53:34.033533] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-29T18:53:34.033572] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-29T18:53:34.033948] [DEBUG] [LOCAL ] FXED: Trimmed 1768 records to 1213 (keeping 200 days of data) [2025-10-29T18:53:34.041633] [DEBUG] [LOCAL ] FXED: Primary data saved (1213 records). [2025-10-29T18:53:34.041745] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-29T18:53:34.041825] [INFO ] [MAIN ] Update Progress: 889/2367 symbols completed. FXED took 26.5s. Estimated remaining: 3h 8m 45s. Rate: 7.8 symbols/min [2025-10-29T18:53:34.212290] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:34.218499] [DEBUG] [LOCAL ] GAM: Loaded 3674 existing records from primary storage. [2025-10-29T18:53:34.218774] [INFO ] [MAIN ] GAM: Loaded 3674 existing records. [2025-10-29T18:53:34.406663] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:53:34.406880] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-29T18:53:34.406936] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-29T18:53:34.407074] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-29T18:53:34.407112] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-29T18:53:34.754862] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:34.793534] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-29T18:53:35.218605] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T18:53:35.507150] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T18:53:35.593600] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-29T18:53:35.968466] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T18:53:36.393577] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-29T18:53:36.842599] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T18:53:37.193559] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-29T18:53:37.646511] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-29T18:53:37.993598] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-29T18:53:38.268436] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-29T18:53:38.793582] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-29T18:53:39.593604] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-29T18:53:39.822685] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-29T18:53:39.979611] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T18:53:40.393576] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-29T18:53:41.193556] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-29T18:53:41.486309] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-29T18:53:41.547293] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T18:53:41.993554] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-29T18:53:42.793531] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-29T18:53:42.878368] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T18:53:43.218872] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-29T18:53:43.593610] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-29T18:53:44.393548] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-29T18:53:44.799334] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T18:53:45.198185] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-29T18:53:45.200294] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T18:53:45.993605] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-29T18:53:46.379108] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T18:53:46.793553] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-29T18:53:46.851895] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-29T18:53:47.421611] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T18:53:47.593540] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-29T18:53:48.393571] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-29T18:53:48.486314] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T18:53:49.193557] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-29T18:53:49.727084] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T18:53:49.736177] [INFO ] [REMOTE ] FVRR: Full fetch complete (59307 records). [2025-10-29T18:53:49.736292] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-29T18:53:50.001962] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-29T18:53:50.144975] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-29T18:53:50.145082] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-29T18:53:50.146002] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-29T18:53:50.146123] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-29T18:53:50.167778] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T18:53:50.167970] [DEBUG] [LOCAL ] FVRR: Trimmed 59307 records to 40488 (keeping 200 days of data) [2025-10-29T18:53:50.402837] [DEBUG] [LOCAL ] FVRR: Primary data saved (40488 records). [2025-10-29T18:53:50.402954] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-29T18:53:50.403807] [INFO ] [MAIN ] Update Progress: 890/2367 symbols completed. FVRR took 48.2s. Estimated remaining: 3h 8m 51s. Rate: 7.8 symbols/min [2025-10-29T18:53:50.580638] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:50.639381] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-29T18:53:50.639874] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-29T18:53:50.808590] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-29T18:53:50.848948] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:53:50.849244] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-29T18:53:50.849303] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-29T18:53:50.850069] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-29T18:53:50.850128] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-29T18:53:51.227858] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:51.260080] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T18:53:51.593563] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-29T18:53:51.860521] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-29T18:53:51.868794] [INFO ] [REMOTE ] GAB: Full fetch complete (39129 records). [2025-10-29T18:53:51.868963] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-29T18:53:52.255032] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-29T18:53:52.255108] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-29T18:53:52.255824] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-29T18:53:52.255895] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-29T18:53:52.256756] [DEBUG] [LOCAL ] GAB: Trimmed 39129 records to 26753 (keeping 200 days of data) [2025-10-29T18:53:52.399435] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-29T18:53:52.411564] [DEBUG] [LOCAL ] GAB: Primary data saved (26753 records). [2025-10-29T18:53:52.411718] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-29T18:53:52.411816] [INFO ] [MAIN ] Update Progress: 891/2367 symbols completed. GAB took 30.0s. Estimated remaining: 3h 8m 34s. Rate: 7.8 symbols/min [2025-10-29T18:53:52.584125] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:52.602631] [DEBUG] [LOCAL ] GATX: Loaded 17729 existing records from primary storage. [2025-10-29T18:53:52.602878] [INFO ] [MAIN ] GATX: Loaded 17729 existing records. [2025-10-29T18:53:52.777463] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:53:52.782011] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-29T18:53:52.782187] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-29T18:53:52.783662] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-29T18:53:52.784214] [INFO ] [REMOTE ] GAM: Full fetch complete (6403 records). [2025-10-29T18:53:52.784410] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-29T18:53:52.784494] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-29T18:53:52.784695] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-29T18:53:53.211705] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-29T18:53:53.496994] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:53.691530] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-29T18:53:53.747048] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-29T18:53:53.747116] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-29T18:53:53.747349] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-29T18:53:53.747393] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-29T18:53:53.747793] [DEBUG] [LOCAL ] GAM: Trimmed 6403 records to 3691 (keeping 200 days of data) [2025-10-29T18:53:53.768698] [DEBUG] [LOCAL ] GAM: Primary data saved (3691 records). [2025-10-29T18:53:53.768788] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-29T18:53:53.768857] [INFO ] [MAIN ] Update Progress: 892/2367 symbols completed. GAM took 19.7s. Estimated remaining: 3h 8m 16s. Rate: 7.8 symbols/min [2025-10-29T18:53:53.932502] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:53.932709] [DEBUG] [LOCAL ] GBAB: No existing data file found in primary storage. [2025-10-29T18:53:53.932758] [WARN ] [MAIN ] GBAB: No existing data found, performing full refresh instead. [2025-10-29T18:53:53.932869] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-29T18:53:53.932909] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-29T18:53:53.932948] [DEBUG] [LOCAL ] GBAB: No primary data file found to delete. [2025-10-29T18:53:53.932980] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-29T18:53:53.998766] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-29T18:53:54.277196] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:54.609775] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T18:53:54.793562] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-29T18:53:55.305560] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T18:53:55.593610] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-29T18:53:56.136104] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T18:53:56.155829] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-29T18:53:56.159695] [INFO ] [REMOTE ] G: Full fetch complete (72334 records). [2025-10-29T18:53:56.159826] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-29T18:53:56.401532] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-29T18:53:56.581718] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-29T18:53:56.581807] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-29T18:53:56.582700] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-29T18:53:56.582763] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-29T18:53:56.584226] [DEBUG] [LOCAL ] G: Trimmed 72334 records to 50029 (keeping 200 days of data) [2025-10-29T18:53:56.880810] [DEBUG] [LOCAL ] G: Primary data saved (50029 records). [2025-10-29T18:53:56.880933] [INFO ] [MAIN ] G: Full history saved. [2025-10-29T18:53:56.881008] [INFO ] [MAIN ] Update Progress: 893/2367 symbols completed. G took 38.2s. Estimated remaining: 3h 8m 1s. Rate: 7.8 symbols/min [2025-10-29T18:53:57.063390] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:53:57.074431] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T18:53:57.113598] [DEBUG] [LOCAL ] GBCI: Loaded 41010 existing records from primary storage. [2025-10-29T18:53:57.113929] [INFO ] [MAIN ] GBCI: Loaded 41010 existing records. [2025-10-29T18:53:57.198720] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-29T18:53:57.319947] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:53:57.320196] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-29T18:53:57.320249] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-29T18:53:57.320460] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-29T18:53:57.320499] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-29T18:53:57.695147] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:53:57.869943] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-29T18:53:57.993579] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-29T18:53:58.793629] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-29T18:53:59.373008] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-29T18:53:59.410016] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T18:53:59.593587] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-29T18:54:00.393634] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-29T18:54:01.062742] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T18:54:01.193601] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-29T18:54:01.916526] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T18:54:01.993592] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-29T18:54:02.096592] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-29T18:54:02.793561] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-29T18:54:03.121891] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T18:54:03.593541] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-29T18:54:03.946728] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T18:54:04.393596] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-29T18:54:04.989898] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T18:54:05.193603] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-29T18:54:05.591313] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T18:54:05.993544] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-29T18:54:06.585333] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T18:54:06.793548] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-29T18:54:06.961163] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-29T18:54:07.593591] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-29T18:54:08.242993] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-29T18:54:08.381126] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-29T18:54:08.393525] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-29T18:54:09.148770] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T18:54:09.193603] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-29T18:54:09.993553] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-29T18:54:10.687795] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T18:54:10.727873] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-29T18:54:10.793511] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-29T18:54:11.342464] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-29T18:54:11.593543] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-29T18:54:12.393602] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-29T18:54:13.085131] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T18:54:13.086343] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T18:54:13.193567] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-29T18:54:13.876942] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-29T18:54:13.993525] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-29T18:54:14.690295] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T18:54:14.793590] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-29T18:54:15.507507] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T18:54:15.593687] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-29T18:54:16.231743] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-29T18:54:16.393567] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-29T18:54:17.193560] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-29T18:54:17.808443] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-29T18:54:17.993548] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-29T18:54:18.228588] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-29T18:54:18.240839] [INFO ] [REMOTE ] GAP: Full fetch complete (77815 records). [2025-10-29T18:54:18.240994] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-29T18:54:18.632014] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-29T18:54:18.632100] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-29T18:54:18.633038] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-29T18:54:18.633128] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-29T18:54:18.634559] [DEBUG] [LOCAL ] GAP: Trimmed 77815 records to 53653 (keeping 200 days of data) [2025-10-29T18:54:18.807925] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-29T18:54:18.965273] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-29T18:54:18.965674] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-29T18:54:18.966830] [INFO ] [MAIN ] Update Progress: 894/2367 symbols completed. GAP took 28.6s. Estimated remaining: 3h 8m 17s. Rate: 7.8 symbols/min [2025-10-29T18:54:19.137905] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:54:19.138259] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-29T18:54:19.145745] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-29T18:54:19.158613] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-29T18:54:19.159575] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-29T18:54:19.159434] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T18:54:19.167115] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-29T18:54:19.167684] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-29T18:54:19.452086] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T18:54:19.533938] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:54:19.593523] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-29T18:54:19.799727] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.21 seconds). [2025-10-29T18:54:20.393553] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-29T18:54:20.583768] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.19 seconds). [2025-10-29T18:54:21.193560] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-29T18:54:21.443239] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-29T18:54:21.993575] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-29T18:54:22.793539] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-29T18:54:22.949097] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T18:54:23.496791] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-29T18:54:23.501169] [INFO ] [REMOTE ] GATX: Full fetch complete (25120 records). [2025-10-29T18:54:23.501302] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-29T18:54:23.598980] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-29T18:54:23.896525] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-29T18:54:23.896602] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-29T18:54:23.897160] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-29T18:54:23.897221] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-29T18:54:23.897880] [DEBUG] [LOCAL ] GATX: Trimmed 25120 records to 17718 (keeping 200 days of data) [2025-10-29T18:54:24.007018] [DEBUG] [LOCAL ] GATX: Primary data saved (17718 records). [2025-10-29T18:54:24.007148] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-29T18:54:24.007224] [INFO ] [MAIN ] Update Progress: 895/2367 symbols completed. GATX took 31.6s. Estimated remaining: 3h 8m 5s. Rate: 7.8 symbols/min [2025-10-29T18:54:24.181984] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:54:24.219092] [DEBUG] [LOCAL ] GBTG: Loaded 39877 existing records from primary storage. [2025-10-29T18:54:24.219381] [INFO ] [MAIN ] GBTG: Loaded 39877 existing records. [2025-10-29T18:54:24.398692] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-29T18:54:24.443731] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:54:24.444105] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-29T18:54:24.444166] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-29T18:54:24.444377] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-29T18:54:24.444437] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-29T18:54:24.726212] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-29T18:54:24.866905] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:54:24.904282] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T18:54:25.193552] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-29T18:54:25.993542] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-29T18:54:26.076976] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T18:54:26.793550] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-29T18:54:27.140890] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T18:54:27.593521] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-29T18:54:27.627915] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T18:54:28.393528] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-29T18:54:28.610074] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-29T18:54:28.647401] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-29T18:54:29.193574] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-29T18:54:29.728207] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T18:54:29.993574] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-29T18:54:30.222668] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-29T18:54:30.793576] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-29T18:54:31.385040] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T18:54:31.387879] [INFO ] [REMOTE ] GBAB: Full fetch complete (18437 records). [2025-10-29T18:54:31.387971] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-29T18:54:31.598809] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-29T18:54:31.750015] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-29T18:54:31.750085] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-29T18:54:31.750479] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-29T18:54:31.750517] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-29T18:54:31.751046] [DEBUG] [LOCAL ] GBAB: Trimmed 18437 records to 12258 (keeping 200 days of data) [2025-10-29T18:54:31.824568] [DEBUG] [LOCAL ] GBAB: Primary data saved (12258 records). [2025-10-29T18:54:31.824728] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-29T18:54:31.824806] [INFO ] [MAIN ] Update Progress: 896/2367 symbols completed. GBAB took 38.1s. Estimated remaining: 3h 7m 58s. Rate: 7.8 symbols/min [2025-10-29T18:54:31.994130] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:54:32.020450] [DEBUG] [LOCAL ] GBX: Loaded 27555 existing records from primary storage. [2025-10-29T18:54:32.020720] [INFO ] [MAIN ] GBX: Loaded 27555 existing records. [2025-10-29T18:54:32.228447] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:54:32.228701] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-29T18:54:32.228761] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-29T18:54:32.228951] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-29T18:54:32.229005] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-29T18:54:32.399023] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-29T18:54:32.579232] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:54:33.047803] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T18:54:33.058457] [INFO ] [REMOTE ] GBCI: Full fetch complete (59513 records). [2025-10-29T18:54:33.058591] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-29T18:54:33.198772] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-29T18:54:33.540122] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-29T18:54:33.540279] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-29T18:54:33.541322] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-29T18:54:33.541438] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-29T18:54:33.552026] [DEBUG] [LOCAL ] GBCI: Trimmed 59513 records to 41030 (keeping 200 days of data) [2025-10-29T18:54:33.569614] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T18:54:33.820166] [DEBUG] [LOCAL ] GBCI: Primary data saved (41030 records). [2025-10-29T18:54:33.820285] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-29T18:54:33.820360] [INFO ] [MAIN ] Update Progress: 897/2367 symbols completed. GBCI took 36.9s. Estimated remaining: 3h 7m 41s. Rate: 7.8 symbols/min [2025-10-29T18:54:33.990046] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:54:33.993556] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-29T18:54:34.028822] [DEBUG] [LOCAL ] GCI: Loaded 43464 existing records from primary storage. [2025-10-29T18:54:34.029093] [INFO ] [MAIN ] GCI: Loaded 43464 existing records. [2025-10-29T18:54:34.204495] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T18:54:34.239943] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:54:34.240143] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-29T18:54:34.240190] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-29T18:54:34.240381] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-29T18:54:34.240437] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-29T18:54:34.592557] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:54:34.793573] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-29T18:54:35.174942] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-29T18:54:35.207285] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T18:54:35.593604] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-29T18:54:35.900427] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:54:36.393572] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-29T18:54:37.193570] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-29T18:54:37.443322] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T18:54:37.993601] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-29T18:54:38.268012] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T18:54:38.793597] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-29T18:54:38.933165] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T18:54:39.025682] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-29T18:54:39.593553] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-29T18:54:39.904581] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-29T18:54:39.905319] [INFO ] [REMOTE ] GBLI: Full fetch complete (1259 records). [2025-10-29T18:54:39.905385] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-29T18:54:40.089887] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-29T18:54:40.090100] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-29T18:54:40.090171] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-29T18:54:40.090242] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-29T18:54:40.090305] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-29T18:54:40.090341] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-29T18:54:40.090379] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-29T18:54:40.090470] [INFO ] [MAIN ] Update Progress: 898/2367 symbols completed. GBLI took 21.1s. Estimated remaining: 3h 7m 31s. Rate: 7.8 symbols/min [2025-10-29T18:54:40.267467] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:54:40.296616] [DEBUG] [LOCAL ] GCO: Loaded 21977 existing records from primary storage. [2025-10-29T18:54:40.296960] [INFO ] [MAIN ] GCO: Loaded 21977 existing records. [2025-10-29T18:54:40.398799] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-29T18:54:40.478992] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:54:40.479224] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-29T18:54:40.479271] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-29T18:54:40.479540] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-29T18:54:40.479597] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-29T18:54:40.874293] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:54:41.193615] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-29T18:54:41.479243] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T18:54:41.993557] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-29T18:54:42.053787] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T18:54:42.793534] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-29T18:54:43.138238] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T18:54:43.564033] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T18:54:43.593570] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-29T18:54:44.393592] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-29T18:54:44.730355] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T18:54:45.193586] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-29T18:54:45.520493] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T18:54:45.993635] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-29T18:54:46.138112] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T18:54:46.773407] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T18:54:46.793583] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-29T18:54:47.590971] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-29T18:54:47.597142] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-29T18:54:48.393564] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-29T18:54:48.711112] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-29T18:54:49.120096] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T18:54:49.193545] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-29T18:54:49.993557] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-29T18:54:50.238913] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T18:54:50.793555] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-29T18:54:51.017411] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T18:54:51.593565] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-29T18:54:51.864864] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T18:54:52.393559] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-29T18:54:52.652327] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T18:54:53.193632] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-29T18:54:53.531893] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T18:54:53.993532] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-29T18:54:54.013231] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T18:54:54.793591] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-29T18:54:55.162025] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T18:54:55.594339] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-29T18:54:55.602478] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-29T18:54:56.393630] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-29T18:54:56.741718] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T18:54:57.198674] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-29T18:54:57.209461] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T18:54:57.993541] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-29T18:54:58.293698] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T18:54:58.793536] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-29T18:54:58.818156] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T18:54:59.593567] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-29T18:55:00.050787] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-29T18:55:00.060150] [INFO ] [REMOTE ] GBTG: Full fetch complete (56857 records). [2025-10-29T18:55:00.060271] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-29T18:55:00.398757] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-29T18:55:00.532279] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-29T18:55:00.532769] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-29T18:55:00.534758] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-29T18:55:00.533549] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-29T18:55:00.540333] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-29T18:55:00.541953] [DEBUG] [LOCAL ] GBTG: Trimmed 56857 records to 39866 (keeping 200 days of data) [2025-10-29T18:55:00.757188] [DEBUG] [LOCAL ] GBTG: Primary data saved (39866 records). [2025-10-29T18:55:00.757319] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-29T18:55:00.757394] [INFO ] [MAIN ] Update Progress: 899/2367 symbols completed. GBTG took 36.8s. Estimated remaining: 3h 7m 44s. Rate: 7.8 symbols/min [2025-10-29T18:55:00.923238] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:00.944585] [DEBUG] [LOCAL ] GCTS: Loaded 20155 existing records from primary storage. [2025-10-29T18:55:00.944880] [INFO ] [MAIN ] GCTS: Loaded 20155 existing records. [2025-10-29T18:55:01.149313] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:01.149607] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-29T18:55:01.149712] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-29T18:55:01.150005] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-29T18:55:01.150073] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-29T18:55:01.199266] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-29T18:55:01.582104] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:01.636944] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T18:55:01.993531] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-29T18:55:02.043095] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T18:55:02.737013] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-29T18:55:02.793568] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-29T18:55:03.420182] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T18:55:03.593547] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-29T18:55:04.263709] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T18:55:04.393550] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-29T18:55:05.114247] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-29T18:55:05.193585] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-29T18:55:05.993601] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-29T18:55:06.303609] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T18:55:06.310389] [INFO ] [REMOTE ] GBX: Full fetch complete (42533 records). [2025-10-29T18:55:06.310521] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-29T18:55:06.752684] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-29T18:55:06.752856] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-29T18:55:06.754748] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-29T18:55:06.755483] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-29T18:55:06.755371] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-29T18:55:06.761515] [DEBUG] [LOCAL ] GBX: Trimmed 42533 records to 27535 (keeping 200 days of data) [2025-10-29T18:55:06.816734] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-29T18:55:06.948089] [DEBUG] [LOCAL ] GBX: Primary data saved (27535 records). [2025-10-29T18:55:06.948283] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-29T18:55:06.948386] [INFO ] [MAIN ] Update Progress: 900/2367 symbols completed. GBX took 35.1s. Estimated remaining: 3h 7m 34s. Rate: 7.8 symbols/min [2025-10-29T18:55:07.149112] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:07.163215] [DEBUG] [LOCAL ] GCV: Loaded 7933 existing records from primary storage. [2025-10-29T18:55:07.163493] [INFO ] [MAIN ] GCV: Loaded 7933 existing records. [2025-10-29T18:55:07.346486] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:07.346776] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-29T18:55:07.346825] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-29T18:55:07.346993] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-29T18:55:07.347031] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-29T18:55:07.598756] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-29T18:55:07.748577] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:07.762272] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T18:55:08.351047] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T18:55:08.393609] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-29T18:55:09.193574] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-29T18:55:09.390421] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T18:55:09.631943] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T18:55:09.993638] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-29T18:55:10.789691] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T18:55:10.793250] [INFO ] [REMOTE ] GCO: Full fetch complete (34336 records). [2025-10-29T18:55:10.793359] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-29T18:55:10.793619] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-29T18:55:11.184173] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-29T18:55:11.184257] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-29T18:55:11.184881] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-29T18:55:11.184945] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-29T18:55:11.185952] [DEBUG] [LOCAL ] GCO: Trimmed 34336 records to 21760 (keeping 200 days of data) [2025-10-29T18:55:11.325187] [DEBUG] [LOCAL ] GCO: Primary data saved (21760 records). [2025-10-29T18:55:11.325314] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-29T18:55:11.325390] [INFO ] [MAIN ] Update Progress: 901/2367 symbols completed. GCO took 31.2s. Estimated remaining: 3h 7m 21s. Rate: 7.8 symbols/min [2025-10-29T18:55:11.503072] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:11.545166] [DEBUG] [LOCAL ] GD: Loaded 46355 existing records from primary storage. [2025-10-29T18:55:11.545477] [INFO ] [MAIN ] GD: Loaded 46355 existing records. [2025-10-29T18:55:11.599220] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-29T18:55:11.721820] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:11.722049] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-29T18:55:11.722097] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-29T18:55:11.722771] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-29T18:55:11.722829] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-29T18:55:12.089719] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:12.090215] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T18:55:12.141887] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T18:55:12.151224] [INFO ] [REMOTE ] GCI: Full fetch complete (63286 records). [2025-10-29T18:55:12.151353] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-29T18:55:12.398687] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-29T18:55:12.558619] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-29T18:55:12.558734] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-29T18:55:12.559558] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-29T18:55:12.559603] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-29T18:55:12.560944] [DEBUG] [LOCAL ] GCI: Trimmed 63286 records to 43520 (keeping 200 days of data) [2025-10-29T18:55:12.798787] [DEBUG] [LOCAL ] GCI: Primary data saved (43520 records). [2025-10-29T18:55:12.798911] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-29T18:55:12.798986] [INFO ] [MAIN ] Update Progress: 902/2367 symbols completed. GCI took 39.0s. Estimated remaining: 3h 7m 4s. Rate: 7.8 symbols/min [2025-10-29T18:55:12.968412] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:13.013635] [DEBUG] [LOCAL ] GDDY: Loaded 49387 existing records from primary storage. [2025-10-29T18:55:13.013939] [INFO ] [MAIN ] GDDY: Loaded 49387 existing records. [2025-10-29T18:55:13.204418] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-29T18:55:13.213751] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:13.215293] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-29T18:55:13.215442] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-29T18:55:13.215921] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-29T18:55:13.216222] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-29T18:55:13.306160] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-29T18:55:13.620715] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:13.993565] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-29T18:55:14.525518] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T18:55:14.793566] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-29T18:55:15.228166] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T18:55:15.593567] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-29T18:55:16.009374] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T18:55:16.393584] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-29T18:55:16.836154] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:55:17.090451] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T18:55:17.193539] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-29T18:55:17.940474] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T18:55:17.993527] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-29T18:55:18.793535] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-29T18:55:18.833757] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-29T18:55:18.839758] [INFO ] [REMOTE ] GCTS: Full fetch complete (26661 records). [2025-10-29T18:55:18.839865] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-29T18:55:19.216248] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T18:55:19.249266] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-29T18:55:19.249352] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-29T18:55:19.250000] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-29T18:55:19.250064] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-29T18:55:19.250831] [DEBUG] [LOCAL ] GCTS: Trimmed 26661 records to 20176 (keeping 200 days of data) [2025-10-29T18:55:19.361484] [DEBUG] [LOCAL ] GCTS: Primary data saved (20176 records). [2025-10-29T18:55:19.361616] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-29T18:55:19.361726] [INFO ] [MAIN ] Update Progress: 903/2367 symbols completed. GCTS took 18.6s. Estimated remaining: 3h 6m 54s. Rate: 7.8 symbols/min [2025-10-29T18:55:19.526614] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:19.532332] [DEBUG] [LOCAL ] GDIV: Loaded 3395 existing records from primary storage. [2025-10-29T18:55:19.532491] [INFO ] [MAIN ] GDIV: Loaded 3395 existing records. [2025-10-29T18:55:19.598797] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-29T18:55:19.710675] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:19.710906] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-29T18:55:19.710953] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-29T18:55:19.711104] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-29T18:55:19.711159] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-29T18:55:20.053068] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:20.393555] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-29T18:55:20.761219] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-29T18:55:21.012418] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T18:55:21.193559] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-29T18:55:21.507077] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-29T18:55:21.993554] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-29T18:55:22.793575] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-29T18:55:23.125099] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T18:55:23.593561] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-29T18:55:23.939376] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-29T18:55:24.166193] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T18:55:24.393568] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-29T18:55:24.776977] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-29T18:55:25.193552] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-29T18:55:25.746586] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-29T18:55:25.993589] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-29T18:55:26.322026] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T18:55:26.793631] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-29T18:55:27.593571] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-29T18:55:28.044323] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-29T18:55:28.073576] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T18:55:28.393565] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-29T18:55:28.784770] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T18:55:29.193620] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-29T18:55:29.993622] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-29T18:55:30.454128] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-29T18:55:30.498253] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T18:55:30.793691] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-29T18:55:31.593556] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-29T18:55:32.039754] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-29T18:55:32.258053] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T18:55:32.393567] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-29T18:55:33.193607] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-29T18:55:33.624425] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T18:55:33.993589] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-29T18:55:34.609317] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T18:55:34.793552] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-29T18:55:35.304117] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T18:55:35.593555] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-29T18:55:36.170854] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T18:55:36.393599] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-29T18:55:36.854786] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T18:55:36.962078] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-29T18:55:37.193617] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-29T18:55:37.847118] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-29T18:55:37.850135] [INFO ] [REMOTE ] GCV: Full fetch complete (10311 records). [2025-10-29T18:55:37.850253] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-29T18:55:37.995431] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-29T18:55:38.405137] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-29T18:55:38.408525] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-29T18:55:38.408626] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-29T18:55:38.409099] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-29T18:55:38.409156] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-29T18:55:38.409969] [DEBUG] [LOCAL ] GCV: Trimmed 10311 records to 8000 (keeping 200 days of data) [2025-10-29T18:55:38.480863] [DEBUG] [LOCAL ] GCV: Primary data saved (8000 records). [2025-10-29T18:55:38.481048] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-29T18:55:38.481164] [INFO ] [MAIN ] Update Progress: 904/2367 symbols completed. GCV took 31.5s. Estimated remaining: 3h 7m 5s. Rate: 7.8 symbols/min [2025-10-29T18:55:38.741629] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:38.747426] [DEBUG] [LOCAL ] GDL: Loaded 2505 existing records from primary storage. [2025-10-29T18:55:38.747713] [INFO ] [MAIN ] GDL: Loaded 2505 existing records. [2025-10-29T18:55:38.798771] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-29T18:55:39.035826] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:39.036075] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-29T18:55:39.036126] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-29T18:55:39.036293] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-29T18:55:39.036352] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-29T18:55:39.403472] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:39.593583] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-29T18:55:40.139363] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T18:55:40.393569] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-29T18:55:40.732588] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-29T18:55:40.860490] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T18:55:41.193563] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-29T18:55:41.993560] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-29T18:55:42.422046] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-29T18:55:42.460753] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T18:55:42.793573] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-29T18:55:43.593598] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-29T18:55:43.899671] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:55:44.194712] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-29T18:55:44.206129] [INFO ] [REMOTE ] GDDY: Full fetch complete (72040 records). [2025-10-29T18:55:44.206310] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-29T18:55:44.403039] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-29T18:55:44.598267] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-29T18:55:44.598346] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-29T18:55:44.599230] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-29T18:55:44.599292] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-29T18:55:44.600724] [DEBUG] [LOCAL ] GDDY: Trimmed 72040 records to 49363 (keeping 200 days of data) [2025-10-29T18:55:44.811869] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T18:55:44.898387] [DEBUG] [LOCAL ] GDDY: Primary data saved (49363 records). [2025-10-29T18:55:44.898530] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-29T18:55:44.898607] [INFO ] [MAIN ] Update Progress: 905/2367 symbols completed. GDDY took 32.1s. Estimated remaining: 3h 6m 55s. Rate: 7.8 symbols/min [2025-10-29T18:55:45.073474] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:45.082315] [DEBUG] [LOCAL ] GDO: Loaded 5703 existing records from primary storage. [2025-10-29T18:55:45.082540] [INFO ] [MAIN ] GDO: Loaded 5703 existing records. [2025-10-29T18:55:45.193835] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-29T18:55:45.272616] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:45.272872] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-29T18:55:45.272919] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-29T18:55:45.273268] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-29T18:55:45.273325] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-29T18:55:45.628763] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:45.644454] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-29T18:55:45.993595] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-29T18:55:46.444213] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T18:55:46.793590] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-29T18:55:47.318233] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-29T18:55:47.319433] [INFO ] [REMOTE ] GDIV: Full fetch complete (5393 records). [2025-10-29T18:55:47.319500] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-29T18:55:47.598693] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-29T18:55:47.669779] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-29T18:55:47.669853] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-29T18:55:47.670017] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-29T18:55:47.670055] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-29T18:55:47.670425] [DEBUG] [LOCAL ] GDIV: Trimmed 5393 records to 3395 (keeping 200 days of data) [2025-10-29T18:55:47.691968] [DEBUG] [LOCAL ] GDIV: Primary data saved (3395 records). [2025-10-29T18:55:47.692088] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-29T18:55:47.692168] [INFO ] [MAIN ] Update Progress: 906/2367 symbols completed. GDIV took 28.3s. Estimated remaining: 3h 6m 40s. Rate: 7.8 symbols/min [2025-10-29T18:55:47.857674] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:47.896483] [DEBUG] [LOCAL ] GDOT: Loaded 37323 existing records from primary storage. [2025-10-29T18:55:47.896794] [INFO ] [MAIN ] GDOT: Loaded 37323 existing records. [2025-10-29T18:55:48.069940] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:48.070141] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-29T18:55:48.070186] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-29T18:55:48.070372] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-29T18:55:48.070427] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-29T18:55:48.417803] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:48.413124] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-29T18:55:48.737039] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-29T18:55:49.139023] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T18:55:49.152760] [INFO ] [REMOTE ] GD: Full fetch complete (69559 records). [2025-10-29T18:55:49.152939] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-29T18:55:49.198727] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-29T18:55:49.637936] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-29T18:55:49.638030] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-29T18:55:49.639029] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-29T18:55:49.639112] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-29T18:55:49.640437] [DEBUG] [LOCAL ] GD: Trimmed 69559 records to 46319 (keeping 200 days of data) [2025-10-29T18:55:49.709377] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-29T18:55:49.986929] [DEBUG] [LOCAL ] GD: Primary data saved (46319 records). [2025-10-29T18:55:49.987054] [INFO ] [MAIN ] GD: Full history saved. [2025-10-29T18:55:49.987909] [INFO ] [MAIN ] Update Progress: 907/2367 symbols completed. GD took 38.7s. Estimated remaining: 3h 6m 23s. Rate: 7.8 symbols/min [2025-10-29T18:55:49.998905] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-29T18:55:50.157734] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:55:50.177032] [DEBUG] [LOCAL ] GDV: Loaded 18696 existing records from primary storage. [2025-10-29T18:55:50.177282] [INFO ] [MAIN ] GDV: Loaded 18696 existing records. [2025-10-29T18:55:50.349867] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:55:50.350070] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-29T18:55:50.350115] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-29T18:55:50.350281] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-29T18:55:50.350320] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-29T18:55:50.721254] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:55:50.793515] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-29T18:55:50.924489] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T18:55:51.543987] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-29T18:55:51.593540] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-29T18:55:52.235062] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T18:55:52.393574] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-29T18:55:53.122683] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T18:55:53.193608] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-29T18:55:53.556716] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-29T18:55:53.993575] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-29T18:55:54.373276] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T18:55:54.793545] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-29T18:55:55.222294] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-29T18:55:55.593569] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-29T18:55:56.011700] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-29T18:55:56.393563] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-29T18:55:56.676909] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-29T18:55:57.193611] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-29T18:55:57.552723] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-29T18:55:57.993595] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-29T18:55:58.368723] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-29T18:55:58.793589] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-29T18:55:59.544940] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-29T18:55:59.593593] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-29T18:56:00.368580] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-29T18:56:00.393527] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-29T18:56:01.146159] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-29T18:56:01.193595] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-29T18:56:01.993588] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-29T18:56:02.034159] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T18:56:02.517732] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-29T18:56:02.793608] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-29T18:56:03.493747] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T18:56:03.593594] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-29T18:56:04.391291] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-29T18:56:04.396767] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-29T18:56:04.729899] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-29T18:56:05.193593] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-29T18:56:05.653427] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-29T18:56:05.993580] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-29T18:56:06.523783] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T18:56:06.525411] [INFO ] [REMOTE ] GDO: Full fetch complete (8322 records). [2025-10-29T18:56:06.525479] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-29T18:56:06.798799] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-29T18:56:06.880304] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-29T18:56:06.880378] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-29T18:56:06.880595] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-29T18:56:06.880673] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-29T18:56:06.881096] [DEBUG] [LOCAL ] GDO: Trimmed 8322 records to 5713 (keeping 200 days of data) [2025-10-29T18:56:06.914674] [DEBUG] [LOCAL ] GDO: Primary data saved (5713 records). [2025-10-29T18:56:06.914769] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-29T18:56:06.914841] [INFO ] [MAIN ] Update Progress: 908/2367 symbols completed. GDO took 22.0s. Estimated remaining: 3h 6m 31s. Rate: 7.8 symbols/min [2025-10-29T18:56:07.097306] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:56:07.147953] [DEBUG] [LOCAL ] GE: Loaded 53688 existing records from primary storage. [2025-10-29T18:56:07.148305] [INFO ] [MAIN ] GE: Loaded 53688 existing records. [2025-10-29T18:56:07.338762] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:56:07.339023] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-29T18:56:07.339100] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-29T18:56:07.340251] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-29T18:56:07.340313] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-29T18:56:07.609007] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-29T18:56:07.699483] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T18:56:07.745444] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:56:08.393678] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-29T18:56:08.721299] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T18:56:09.193551] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-29T18:56:09.223786] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T18:56:09.227920] [INFO ] [REMOTE ] GDV: Full fetch complete (28101 records). [2025-10-29T18:56:09.228016] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-29T18:56:09.629276] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-29T18:56:09.629382] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-29T18:56:09.630023] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-29T18:56:09.630085] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-29T18:56:09.630996] [DEBUG] [LOCAL ] GDV: Trimmed 28101 records to 18697 (keeping 200 days of data) [2025-10-29T18:56:09.757774] [DEBUG] [LOCAL ] GDV: Primary data saved (18697 records). [2025-10-29T18:56:09.757909] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-29T18:56:09.757986] [INFO ] [MAIN ] Update Progress: 909/2367 symbols completed. GDV took 19.8s. Estimated remaining: 3h 6m 15s. Rate: 7.8 symbols/min [2025-10-29T18:56:09.953673] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:56:09.973473] [DEBUG] [LOCAL ] GEF: Loaded 20496 existing records from primary storage. [2025-10-29T18:56:09.973734] [INFO ] [MAIN ] GEF: Loaded 20496 existing records. [2025-10-29T18:56:10.002031] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-29T18:56:10.168703] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:56:10.168965] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-29T18:56:10.169183] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-29T18:56:10.169550] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-29T18:56:10.169634] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-29T18:56:10.314911] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T18:56:10.622115] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:56:10.793562] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-29T18:56:11.565450] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T18:56:11.593532] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-29T18:56:11.733992] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-29T18:56:12.393571] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-29T18:56:12.684982] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T18:56:12.723529] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-29T18:56:13.193547] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-29T18:56:13.503750] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:56:13.993551] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-29T18:56:14.634330] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-29T18:56:14.793604] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-29T18:56:15.552032] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T18:56:15.593514] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-29T18:56:16.303130] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T18:56:16.393572] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-29T18:56:16.996191] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T18:56:17.193589] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-29T18:56:17.993553] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-29T18:56:18.770100] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-29T18:56:18.793528] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-29T18:56:18.957904] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T18:56:19.593552] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-29T18:56:19.596863] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T18:56:19.945073] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-29T18:56:20.393613] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-29T18:56:20.848025] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-29T18:56:20.849043] [INFO ] [REMOTE ] GDL: Full fetch complete (3448 records). [2025-10-29T18:56:20.849129] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-29T18:56:21.198794] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-29T18:56:21.230963] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-29T18:56:21.231023] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-29T18:56:21.231153] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-29T18:56:21.231194] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-29T18:56:21.231529] [DEBUG] [LOCAL ] GDL: Trimmed 3448 records to 2518 (keeping 200 days of data) [2025-10-29T18:56:21.246341] [DEBUG] [LOCAL ] GDL: Primary data saved (2518 records). [2025-10-29T18:56:21.246452] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-29T18:56:21.246526] [INFO ] [MAIN ] Update Progress: 910/2367 symbols completed. GDL took 42.8s. Estimated remaining: 3h 6m 14s. Rate: 7.8 symbols/min [2025-10-29T18:56:21.425980] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:56:21.454118] [DEBUG] [LOCAL ] GEL: Loaded 30623 existing records from primary storage. [2025-10-29T18:56:21.454372] [INFO ] [MAIN ] GEL: Loaded 30623 existing records. [2025-10-29T18:56:21.644082] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:56:21.644327] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-29T18:56:21.644376] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-29T18:56:21.644976] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-29T18:56:21.645035] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-29T18:56:22.000367] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-29T18:56:22.025416] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:56:22.210918] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T18:56:22.793546] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-29T18:56:22.866636] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T18:56:23.593546] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-29T18:56:23.818182] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T18:56:24.252530] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T18:56:24.393535] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-29T18:56:25.161783] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T18:56:25.193828] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-29T18:56:25.993610] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-29T18:56:26.787031] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-29T18:56:26.797335] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-29T18:56:26.949534] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-29T18:56:27.593568] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-29T18:56:27.874330] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T18:56:28.393589] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-29T18:56:29.193544] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-29T18:56:29.409580] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-29T18:56:29.545028] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T18:56:29.929123] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-29T18:56:29.934338] [INFO ] [REMOTE ] GEF: Full fetch complete (29356 records). [2025-10-29T18:56:29.934435] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-29T18:56:29.998773] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-29T18:56:30.304582] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-29T18:56:30.304687] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-29T18:56:30.305291] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-29T18:56:30.305332] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-29T18:56:30.306087] [DEBUG] [LOCAL ] GEF: Trimmed 29356 records to 20555 (keeping 200 days of data) [2025-10-29T18:56:30.428721] [DEBUG] [LOCAL ] GEF: Primary data saved (20555 records). [2025-10-29T18:56:30.428858] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-29T18:56:30.428937] [INFO ] [MAIN ] Update Progress: 911/2367 symbols completed. GEF took 20.7s. Estimated remaining: 3h 6m 9s. Rate: 7.8 symbols/min [2025-10-29T18:56:30.599049] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:56:30.648598] [DEBUG] [LOCAL ] GENI: Loaded 52850 existing records from primary storage. [2025-10-29T18:56:30.648958] [INFO ] [MAIN ] GENI: Loaded 52850 existing records. [2025-10-29T18:56:30.798678] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-29T18:56:30.825660] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:56:30.825895] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-29T18:56:30.825969] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-29T18:56:30.826866] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-29T18:56:30.826924] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-29T18:56:31.178595] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:56:31.279466] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T18:56:31.287862] [INFO ] [REMOTE ] GDOT: Full fetch complete (53675 records). [2025-10-29T18:56:31.288012] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-29T18:56:31.598724] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-29T18:56:31.669566] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-29T18:56:31.669636] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-29T18:56:31.670515] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-29T18:56:31.670572] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-29T18:56:31.671811] [DEBUG] [LOCAL ] GDOT: Trimmed 53675 records to 37273 (keeping 200 days of data) [2025-10-29T18:56:31.890140] [DEBUG] [LOCAL ] GDOT: Primary data saved (37273 records). [2025-10-29T18:56:31.890304] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-29T18:56:31.890386] [INFO ] [MAIN ] Update Progress: 912/2367 symbols completed. GDOT took 44.2s. Estimated remaining: 3h 5m 51s. Rate: 7.8 symbols/min [2025-10-29T18:56:32.060776] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:56:32.128534] [DEBUG] [LOCAL ] GEO: Loaded 51534 existing records from primary storage. [2025-10-29T18:56:32.128986] [INFO ] [MAIN ] GEO: Loaded 51534 existing records. [2025-10-29T18:56:32.313994] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:56:32.314197] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-29T18:56:32.314242] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-29T18:56:32.315079] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-29T18:56:32.315135] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-29T18:56:32.404214] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-29T18:56:32.670547] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:56:32.711372] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-29T18:56:32.881030] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T18:56:33.193565] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-29T18:56:33.595329] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T18:56:33.993576] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-29T18:56:34.747511] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T18:56:34.793521] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-29T18:56:34.889243] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-29T18:56:35.593620] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-29T18:56:36.209766] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T18:56:36.393570] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-29T18:56:36.724213] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T18:56:37.193625] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-29T18:56:37.759234] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T18:56:37.993567] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-29T18:56:38.659542] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-29T18:56:38.793551] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-29T18:56:39.377295] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T18:56:39.593568] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-29T18:56:39.798849] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T18:56:40.393599] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-29T18:56:40.856405] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T18:56:41.193689] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-29T18:56:41.717560] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T18:56:41.993610] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-29T18:56:42.793549] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-29T18:56:42.880612] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-29T18:56:43.372169] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T18:56:43.593566] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-29T18:56:43.960556] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T18:56:44.393561] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-29T18:56:44.841334] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T18:56:45.193622] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-29T18:56:46.007013] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-29T18:56:46.032476] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-29T18:56:46.474765] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T18:56:46.793561] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-29T18:56:47.061677] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T18:56:47.593606] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-29T18:56:48.258875] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T18:56:48.393569] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-29T18:56:49.193599] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-29T18:56:49.197437] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-29T18:56:49.861582] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-29T18:56:49.993573] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-29T18:56:50.167004] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-29T18:56:50.793607] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-29T18:56:51.149270] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T18:56:51.593612] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-29T18:56:51.998692] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T18:56:52.393732] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-29T18:56:53.193595] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-29T18:56:53.633629] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-29T18:56:53.645542] [INFO ] [REMOTE ] GE: Full fetch complete (77857 records). [2025-10-29T18:56:53.645745] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-29T18:56:54.004127] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-29T18:56:54.053580] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-29T18:56:54.053804] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-29T18:56:54.055004] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-29T18:56:54.055101] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-29T18:56:54.086996] [DEBUG] [LOCAL ] GE: Trimmed 77857 records to 53688 (keeping 200 days of data) [2025-10-29T18:56:54.089005] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-29T18:56:54.434436] [DEBUG] [LOCAL ] GE: Primary data saved (53688 records). [2025-10-29T18:56:54.434636] [INFO ] [MAIN ] GE: Full history saved. [2025-10-29T18:56:54.434776] [INFO ] [MAIN ] Update Progress: 913/2367 symbols completed. GE took 47.5s. Estimated remaining: 3h 6m 7s. Rate: 7.8 symbols/min [2025-10-29T18:56:54.637281] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T18:56:54.639785] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:56:54.682770] [DEBUG] [LOCAL ] GES: Loaded 37330 existing records from primary storage. [2025-10-29T18:56:54.683051] [INFO ] [MAIN ] GES: Loaded 37330 existing records. [2025-10-29T18:56:54.798837] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-29T18:56:54.871360] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:56:54.871608] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-29T18:56:54.871702] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-29T18:56:54.872404] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-29T18:56:54.872464] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-29T18:56:55.243045] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:56:55.264856] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T18:56:55.593557] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-29T18:56:56.400103] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-29T18:56:56.402245] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-29T18:56:56.743494] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-29T18:56:56.754446] [INFO ] [REMOTE ] GENI: Full fetch complete (76084 records). [2025-10-29T18:56:56.754567] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-29T18:56:57.158033] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-29T18:56:57.158109] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-29T18:56:57.159017] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-29T18:56:57.159078] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-29T18:56:57.160377] [DEBUG] [LOCAL ] GENI: Trimmed 76084 records to 52857 (keeping 200 days of data) [2025-10-29T18:56:57.207029] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-29T18:56:57.458914] [DEBUG] [LOCAL ] GENI: Primary data saved (52857 records). [2025-10-29T18:56:57.459061] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-29T18:56:57.460031] [INFO ] [MAIN ] Update Progress: 914/2367 symbols completed. GENI took 27.0s. Estimated remaining: 3h 5m 52s. Rate: 7.8 symbols/min [2025-10-29T18:56:57.625369] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:56:57.661074] [DEBUG] [LOCAL ] GETY: Loaded 34895 existing records from primary storage. [2025-10-29T18:56:57.661327] [INFO ] [MAIN ] GETY: Loaded 34895 existing records. [2025-10-29T18:56:57.839257] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:56:57.839544] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-29T18:56:57.839665] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-29T18:56:57.840284] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-29T18:56:57.840356] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-29T18:56:57.996224] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-29T18:56:58.108332] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-29T18:56:58.172466] [INFO ] [REMOTE ] GEO: Full fetch complete (75368 records). [2025-10-29T18:56:58.193253] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-29T18:56:58.268718] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:56:58.302408] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-29T18:56:58.355509] [INFO ] [REMOTE ] GEL: Full fetch complete (47834 records). [2025-10-29T18:56:58.363831] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-29T18:56:58.795486] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-29T18:56:58.972755] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-29T18:56:58.977964] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-29T18:56:58.990040] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-29T18:56:58.990122] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-29T18:56:59.022552] [DEBUG] [LOCAL ] GEO: Trimmed 75368 records to 51526 (keeping 200 days of data) [2025-10-29T18:56:59.055941] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-29T18:56:59.056277] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-29T18:56:59.056895] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-29T18:56:59.057066] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-29T18:56:59.147383] [DEBUG] [LOCAL ] GEL: Trimmed 47834 records to 30604 (keeping 200 days of data) [2025-10-29T18:56:59.467120] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T18:56:59.487485] [DEBUG] [LOCAL ] GEL: Primary data saved (30604 records). [2025-10-29T18:56:59.487798] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-29T18:56:59.488715] [INFO ] [MAIN ] Update Progress: 915/2367 symbols completed. GEL took 38.2s. Estimated remaining: 3h 5m 35s. Rate: 7.8 symbols/min [2025-10-29T18:56:59.601864] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-29T18:56:59.711680] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:56:59.808801] [DEBUG] [LOCAL ] GEO: Primary data saved (51526 records). [2025-10-29T18:56:59.808969] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-29T18:56:59.809058] [INFO ] [MAIN ] Update Progress: 916/2367 symbols completed. GEO took 27.9s. Estimated remaining: 3h 5m 16s. Rate: 7.8 symbols/min [2025-10-29T18:56:59.998493] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:57:00.015842] [DEBUG] [LOCAL ] GEV: Loaded 52982 existing records from primary storage. [2025-10-29T18:57:00.017228] [INFO ] [MAIN ] GEV: Loaded 52982 existing records. [2025-10-29T18:57:00.067174] [DEBUG] [LOCAL ] GF: Loaded 2523 existing records from primary storage. [2025-10-29T18:57:00.081292] [INFO ] [MAIN ] GF: Loaded 2523 existing records. [2025-10-29T18:57:00.428711] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:57:00.435356] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-29T18:57:00.435545] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-29T18:57:00.434906] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:57:00.436217] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-29T18:57:00.436357] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-29T18:57:00.436584] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-29T18:57:00.436787] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-29T18:57:00.448308] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-29T18:57:00.448507] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-29T18:57:00.799245] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-29T18:57:00.952820] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-29T18:57:01.215787] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:57:01.258014] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:57:01.258344] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-29T18:57:01.306191] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-29T18:57:01.636310] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T18:57:01.993585] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-29T18:57:02.256269] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T18:57:02.793593] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-29T18:57:03.194391] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-29T18:57:03.293093] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T18:57:03.593578] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-29T18:57:04.393597] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-29T18:57:04.821428] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T18:57:04.925354] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-29T18:57:05.193560] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-29T18:57:05.993607] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-29T18:57:06.793704] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-29T18:57:06.958065] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-29T18:57:07.080380] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T18:57:07.140687] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-29T18:57:07.593569] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-29T18:57:08.393595] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-29T18:57:08.721813] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T18:57:09.193579] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-29T18:57:09.560985] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T18:57:09.993612] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-29T18:57:10.185517] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T18:57:10.360249] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-29T18:57:10.793690] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-29T18:57:11.163550] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-29T18:57:11.593571] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-29T18:57:12.393569] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-29T18:57:13.193606] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-29T18:57:13.305887] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-29T18:57:13.489707] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T18:57:13.993545] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-29T18:57:14.252062] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T18:57:14.793600] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-29T18:57:15.593599] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-29T18:57:15.636186] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-29T18:57:15.668433] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-29T18:57:16.393537] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-29T18:57:16.470108] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-29T18:57:17.193575] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-29T18:57:17.993524] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-29T18:57:18.186390] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-29T18:57:18.220576] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T18:57:18.793553] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-29T18:57:19.097234] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-29T18:57:19.104581] [INFO ] [REMOTE ] GES: Full fetch complete (58032 records). [2025-10-29T18:57:19.104733] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-29T18:57:19.475751] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-29T18:57:19.475852] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-29T18:57:19.476600] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-29T18:57:19.476660] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-29T18:57:19.477771] [DEBUG] [LOCAL ] GES: Trimmed 58032 records to 37291 (keeping 200 days of data) [2025-10-29T18:57:19.593893] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-29T18:57:19.695444] [DEBUG] [LOCAL ] GES: Primary data saved (37291 records). [2025-10-29T18:57:19.695568] [INFO ] [MAIN ] GES: Full history saved. [2025-10-29T18:57:19.695687] [INFO ] [MAIN ] Update Progress: 917/2367 symbols completed. GES took 25.3s. Estimated remaining: 3h 5m 28s. Rate: 7.8 symbols/min [2025-10-29T18:57:20.393579] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-29T18:57:20.736710] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-29T18:57:20.758736] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-29T18:57:20.782615] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T18:57:21.193545] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-29T18:57:21.993571] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-29T18:57:22.258003] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-29T18:57:22.793554] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-29T18:57:23.593585] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-29T18:57:23.695088] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-29T18:57:23.727456] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T18:57:23.894701] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-29T18:57:24.393615] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-29T18:57:24.686515] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-29T18:57:25.193624] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-29T18:57:25.539138] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-29T18:57:25.540094] [INFO ] [REMOTE ] GF: Full fetch complete (4837 records). [2025-10-29T18:57:25.540162] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-29T18:57:25.921360] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-29T18:57:25.921455] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-29T18:57:25.921674] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-29T18:57:25.921744] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-29T18:57:25.922447] [DEBUG] [LOCAL ] GF: Trimmed 4837 records to 2514 (keeping 200 days of data) [2025-10-29T18:57:25.938943] [DEBUG] [LOCAL ] GF: Primary data saved (2514 records). [2025-10-29T18:57:25.939054] [INFO ] [MAIN ] GF: Full history saved. [2025-10-29T18:57:25.939330] [INFO ] [MAIN ] Update Progress: 918/2367 symbols completed. GF took 26.1s. Estimated remaining: 3h 5m 18s. Rate: 7.8 symbols/min [2025-10-29T18:57:25.993556] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-29T18:57:26.793588] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-29T18:57:27.869319] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-29T18:57:27.880950] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-29T18:57:27.949895] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T18:57:27.959601] [INFO ] [REMOTE ] GETY: Full fetch complete (55061 records). [2025-10-29T18:57:27.959830] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-29T18:57:28.412402] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-29T18:57:28.412534] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-29T18:57:28.413444] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-29T18:57:28.413511] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-29T18:57:28.414663] [DEBUG] [LOCAL ] GETY: Trimmed 55061 records to 34916 (keeping 200 days of data) [2025-10-29T18:57:28.618231] [DEBUG] [LOCAL ] GETY: Primary data saved (34916 records). [2025-10-29T18:57:28.618369] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-29T18:57:28.618446] [INFO ] [MAIN ] Update Progress: 919/2367 symbols completed. GETY took 31.2s. Estimated remaining: 3h 5m 2s. Rate: 7.8 symbols/min [2025-10-29T18:57:29.711448] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-29T18:57:29.723140] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-29T18:57:31.593205] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-29T18:57:31.604437] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-29T18:57:33.839677] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-29T18:57:33.852170] [INFO ] [REMOTE ] GEV: Full fetch complete (77059 records). [2025-10-29T18:57:33.852359] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-29T18:57:34.452886] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-29T18:57:34.453009] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-29T18:57:34.454639] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-29T18:57:34.454748] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-29T18:57:34.456777] [DEBUG] [LOCAL ] GEV: Trimmed 77059 records to 52978 (keeping 200 days of data) [2025-10-29T18:57:34.859892] [DEBUG] [LOCAL ] GEV: Primary data saved (52978 records). [2025-10-29T18:57:34.860033] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-29T18:57:34.861513] [INFO ] [MAIN ] Update Progress: 920/2367 symbols completed. GEV took 35.4s. Estimated remaining: 3h 4m 52s. Rate: 7.8 symbols/min [2025-10-29T18:57:35.533233] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:57:35.539012] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:57:35.573101] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:57:35.591793] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:57:35.600992] [DEBUG] [LOCAL ] GFR: Loaded 6871 existing records from primary storage. [2025-10-29T18:57:35.601344] [INFO ] [MAIN ] GFR: Loaded 6871 existing records. [2025-10-29T18:57:35.734456] [DEBUG] [LOCAL ] GFF: Loaded 28815 existing records from primary storage. [2025-10-29T18:57:35.750346] [INFO ] [MAIN ] GFF: Loaded 28815 existing records. [2025-10-29T18:57:35.834312] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:57:35.905934] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-29T18:57:35.940232] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-29T18:57:35.957958] [DEBUG] [LOCAL ] GFL: Loaded 47208 existing records from primary storage. [2025-10-29T18:57:35.958817] [DEBUG] [LOCAL ] GFI: Loaded 53115 existing records from primary storage. [2025-10-29T18:57:35.958900] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-29T18:57:35.980354] [INFO ] [MAIN ] GFI: Loaded 53115 existing records. [2025-10-29T18:57:35.975056] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-29T18:57:35.964771] [INFO ] [MAIN ] GFL: Loaded 47208 existing records. [2025-10-29T18:57:36.091230] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:57:36.140097] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-29T18:57:36.262149] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-29T18:57:36.352621] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-29T18:57:36.414573] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-29T18:57:36.498103] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:57:36.607959] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-29T18:57:36.658847] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-29T18:57:36.649781] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:57:36.709259] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-29T18:57:36.719624] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-29T18:57:36.776439] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-29T18:57:36.839587] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-29T18:57:36.869704] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-29T18:57:36.890276] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-29T18:57:37.227011] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:57:37.320824] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-29T18:57:37.666421] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:57:37.698192] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-29T18:57:37.801482] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:57:37.813085] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-29T18:57:37.897110] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:57:37.897588] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-29T18:57:37.906518] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-29T18:57:37.909224] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-29T18:57:38.361375] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-29T18:57:38.363604] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-29T18:57:38.707542] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T18:57:38.714171] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-29T18:57:38.879800] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-29T18:57:38.883702] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-29T18:57:39.064544] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T18:57:39.074028] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-29T18:57:39.320880] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-29T18:57:39.331343] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-29T18:57:39.403609] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-29T18:57:39.410395] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-29T18:57:39.608883] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T18:57:39.615038] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-29T18:57:39.907370] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T18:57:39.910431] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-29T18:57:40.116370] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T18:57:40.393539] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-29T18:57:40.427014] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T18:57:40.447999] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-29T18:57:40.619549] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T18:57:41.193604] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-29T18:57:41.552676] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T18:57:41.570902] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-29T18:57:41.993591] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-29T18:57:42.793595] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-29T18:57:43.288445] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T18:57:43.593621] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-29T18:57:44.234250] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-29T18:57:44.393564] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-29T18:57:44.775886] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T18:57:45.193573] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-29T18:57:45.943997] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T18:57:45.974459] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-29T18:57:45.993555] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-29T18:57:46.793540] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-29T18:57:47.176672] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-29T18:57:47.392860] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T18:57:47.593565] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-29T18:57:48.393556] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-29T18:57:48.901406] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-29T18:57:49.050630] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-29T18:57:49.193569] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-29T18:57:49.993625] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-29T18:57:50.708335] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T18:57:50.793567] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-29T18:57:51.237829] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T18:57:51.593551] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-29T18:57:52.326603] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T18:57:52.393529] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-29T18:57:52.469277] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T18:57:53.193555] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-29T18:57:53.993543] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-29T18:57:54.095953] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-29T18:57:54.237136] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T18:57:54.796399] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-29T18:57:54.800927] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T18:57:55.593592] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-29T18:57:55.917510] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T18:57:55.984120] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-29T18:57:55.985851] [INFO ] [REMOTE ] GFR: Full fetch complete (11814 records). [2025-10-29T18:57:55.985925] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-29T18:57:56.399101] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-29T18:57:56.399265] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-29T18:57:56.398724] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-29T18:57:56.399748] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-29T18:57:56.400126] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-29T18:57:56.401578] [DEBUG] [LOCAL ] GFR: Trimmed 11814 records to 6839 (keeping 200 days of data) [2025-10-29T18:57:56.440916] [DEBUG] [LOCAL ] GFR: Primary data saved (6839 records). [2025-10-29T18:57:56.441088] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-29T18:57:56.441178] [INFO ] [MAIN ] Update Progress: 921/2367 symbols completed. GFR took 21.6s. Estimated remaining: 3h 5m 6s. Rate: 7.8 symbols/min [2025-10-29T18:57:56.634393] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:57:56.680921] [DEBUG] [LOCAL ] GGB: Loaded 51530 existing records from primary storage. [2025-10-29T18:57:56.681304] [INFO ] [MAIN ] GGB: Loaded 51530 existing records. [2025-10-29T18:57:56.894471] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:57:56.895903] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-29T18:57:56.895964] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-29T18:57:56.897535] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-29T18:57:56.897613] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-29T18:57:57.200466] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-29T18:57:57.288170] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:57:57.596798] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T18:57:57.993616] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-29T18:57:58.793597] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-29T18:57:59.165785] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-29T18:57:59.177622] [INFO ] [REMOTE ] GFI: Full fetch complete (77031 records). [2025-10-29T18:57:59.177800] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-29T18:57:59.383022] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T18:57:59.599002] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-29T18:57:59.618719] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-29T18:57:59.618800] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-29T18:57:59.619749] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-29T18:57:59.619940] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-29T18:57:59.621374] [DEBUG] [LOCAL ] GFI: Trimmed 77031 records to 53112 (keeping 200 days of data) [2025-10-29T18:57:59.939491] [DEBUG] [LOCAL ] GFI: Primary data saved (53112 records). [2025-10-29T18:57:59.939679] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-29T18:57:59.939848] [INFO ] [MAIN ] Update Progress: 922/2367 symbols completed. GFI took 25.1s. Estimated remaining: 3h 4m 52s. Rate: 7.8 symbols/min [2025-10-29T18:58:00.117763] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:58:00.160242] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T18:58:00.201791] [DEBUG] [LOCAL ] GGG: Loaded 40372 existing records from primary storage. [2025-10-29T18:58:00.202070] [INFO ] [MAIN ] GGG: Loaded 40372 existing records. [2025-10-29T18:58:00.386807] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:58:00.387576] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-29T18:58:00.387626] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-29T18:58:00.388386] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-29T18:58:00.388446] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-29T18:58:00.400079] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-29T18:58:00.782342] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:58:00.802601] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T18:58:01.193593] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-29T18:58:01.994930] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-29T18:58:02.012897] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-29T18:58:02.024215] [INFO ] [REMOTE ] GFL: Full fetch complete (69626 records). [2025-10-29T18:58:02.024396] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-29T18:58:02.227577] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-29T18:58:02.450918] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-29T18:58:02.451005] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-29T18:58:02.452034] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-29T18:58:02.452104] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-29T18:58:02.453550] [DEBUG] [LOCAL ] GFL: Trimmed 69626 records to 47219 (keeping 200 days of data) [2025-10-29T18:58:02.739993] [DEBUG] [LOCAL ] GFL: Primary data saved (47219 records). [2025-10-29T18:58:02.740155] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-29T18:58:02.740244] [INFO ] [MAIN ] Update Progress: 923/2367 symbols completed. GFL took 27.8s. Estimated remaining: 3h 4m 37s. Rate: 7.8 symbols/min [2025-10-29T18:58:02.799721] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-29T18:58:02.919416] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:58:02.934304] [DEBUG] [LOCAL ] GGT: Loaded 14413 existing records from primary storage. [2025-10-29T18:58:02.934542] [INFO ] [MAIN ] GGT: Loaded 14413 existing records. [2025-10-29T18:58:03.111272] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:58:03.111571] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-29T18:58:03.111695] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-29T18:58:03.112079] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-29T18:58:03.112155] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-29T18:58:03.381163] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T18:58:03.503906] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:58:03.593531] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-29T18:58:03.741468] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T18:58:03.747258] [INFO ] [REMOTE ] GFF: Full fetch complete (43355 records). [2025-10-29T18:58:03.747378] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-29T18:58:04.124171] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-29T18:58:04.124244] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-29T18:58:04.125432] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-29T18:58:04.125496] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-29T18:58:04.126583] [DEBUG] [LOCAL ] GFF: Trimmed 43355 records to 28765 (keeping 200 days of data) [2025-10-29T18:58:04.232422] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-29T18:58:04.318780] [DEBUG] [LOCAL ] GFF: Primary data saved (28765 records). [2025-10-29T18:58:04.318933] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-29T18:58:04.319019] [INFO ] [MAIN ] Update Progress: 924/2367 symbols completed. GFF took 29.5s. Estimated remaining: 3h 4m 20s. Rate: 7.8 symbols/min [2025-10-29T18:58:04.398700] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-29T18:58:04.516528] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:58:04.521753] [DEBUG] [LOCAL ] GGZ: Loaded 2283 existing records from primary storage. [2025-10-29T18:58:04.521957] [INFO ] [MAIN ] GGZ: Loaded 2283 existing records. [2025-10-29T18:58:04.719872] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:58:04.720101] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-29T18:58:04.720185] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-29T18:58:04.720319] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-29T18:58:04.720356] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-29T18:58:05.071414] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:58:05.193556] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-29T18:58:05.481353] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T18:58:05.605749] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-29T18:58:05.993685] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-29T18:58:06.341212] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-29T18:58:06.793593] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-29T18:58:07.593555] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-29T18:58:07.881683] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T18:58:07.913966] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-29T18:58:08.393552] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-29T18:58:08.780503] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-29T18:58:09.193609] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-29T18:58:09.594350] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-29T18:58:09.993596] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-29T18:58:10.793556] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-29T18:58:11.092810] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-29T18:58:11.203435] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T18:58:11.593551] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-29T18:58:11.846928] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-29T18:58:12.393569] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-29T18:58:12.947824] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T18:58:13.193559] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-29T18:58:13.773599] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T18:58:13.993551] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-29T18:58:14.519110] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T18:58:14.793579] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-29T18:58:15.593562] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-29T18:58:15.901183] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-29T18:58:15.989594] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T18:58:16.393553] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-29T18:58:16.763683] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-29T18:58:17.193557] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-29T18:58:17.862893] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-29T18:58:17.993557] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-29T18:58:18.627367] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T18:58:18.793618] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-29T18:58:19.593626] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-29T18:58:20.105406] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T18:58:20.262318] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-29T18:58:20.393594] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-29T18:58:21.193565] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-29T18:58:21.804802] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-29T18:58:21.820991] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T18:58:21.993609] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-29T18:58:22.793592] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-29T18:58:23.200740] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T18:58:23.305987] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-29T18:58:23.593574] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-29T18:58:24.393581] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-29T18:58:24.826972] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-29T18:58:24.828317] [INFO ] [REMOTE ] GGZ: Full fetch complete (3764 records). [2025-10-29T18:58:24.828394] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-29T18:58:25.201801] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-29T18:58:25.198005] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-29T18:58:25.293969] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-29T18:58:25.294065] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-29T18:58:25.294207] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-29T18:58:25.294267] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-29T18:58:25.294666] [DEBUG] [LOCAL ] GGZ: Trimmed 3764 records to 2287 (keeping 200 days of data) [2025-10-29T18:58:25.308308] [DEBUG] [LOCAL ] GGZ: Primary data saved (2287 records). [2025-10-29T18:58:25.308373] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-29T18:58:25.308437] [INFO ] [MAIN ] Update Progress: 925/2367 symbols completed. GGZ took 21.0s. Estimated remaining: 3h 4m 33s. Rate: 7.8 symbols/min [2025-10-29T18:58:25.475760] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:58:25.480158] [DEBUG] [LOCAL ] GHC: Loaded 2943 existing records from primary storage. [2025-10-29T18:58:25.480325] [INFO ] [MAIN ] GHC: Loaded 2943 existing records. [2025-10-29T18:58:25.654850] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:58:25.655071] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-29T18:58:25.655119] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-29T18:58:25.655358] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-29T18:58:25.655425] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-29T18:58:26.003358] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-29T18:58:26.012883] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:58:26.075409] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-29T18:58:26.079255] [INFO ] [REMOTE ] GGT: Full fetch complete (19169 records). [2025-10-29T18:58:26.079372] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-29T18:58:26.465533] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-29T18:58:26.465673] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-29T18:58:26.466169] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-29T18:58:26.466211] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-29T18:58:26.466932] [DEBUG] [LOCAL ] GGT: Trimmed 19169 records to 14466 (keeping 200 days of data) [2025-10-29T18:58:26.551606] [DEBUG] [LOCAL ] GGT: Primary data saved (14466 records). [2025-10-29T18:58:26.551778] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-29T18:58:26.551865] [INFO ] [MAIN ] Update Progress: 926/2367 symbols completed. GGT took 23.8s. Estimated remaining: 3h 4m 15s. Rate: 7.8 symbols/min [2025-10-29T18:58:26.732793] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:58:26.737259] [DEBUG] [LOCAL ] GHG: Loaded 3266 existing records from primary storage. [2025-10-29T18:58:26.737401] [INFO ] [MAIN ] GHG: Loaded 3266 existing records. [2025-10-29T18:58:26.799457] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-29T18:58:26.914448] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:58:26.914659] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-29T18:58:26.914719] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-29T18:58:26.914890] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-29T18:58:26.914928] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-29T18:58:27.285797] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:58:27.593577] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-29T18:58:28.025328] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-29T18:58:28.044576] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T18:58:28.082222] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T18:58:28.393614] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-29T18:58:28.758251] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T18:58:29.193597] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-29T18:58:29.536173] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-29T18:58:29.993710] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-29T18:58:30.244422] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-29T18:58:30.793595] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-29T18:58:31.593593] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-29T18:58:31.993387] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T18:58:31.993585] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-29T18:58:32.393560] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-29T18:58:32.728168] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T18:58:33.193556] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-29T18:58:33.619144] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-29T18:58:33.993604] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-29T18:58:34.793529] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-29T18:58:35.593515] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-29T18:58:35.671922] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-29T18:58:35.836123] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-29T18:58:35.958386] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T18:58:36.393586] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-29T18:58:37.193577] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-29T18:58:37.882869] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T18:58:37.894292] [INFO ] [REMOTE ] GGB: Full fetch complete (74374 records). [2025-10-29T18:58:37.894432] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-29T18:58:37.997944] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-29T18:58:38.298010] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-29T18:58:38.298115] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-29T18:58:38.299148] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-29T18:58:38.299260] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-29T18:58:38.300976] [DEBUG] [LOCAL ] GGB: Trimmed 74374 records to 51537 (keeping 200 days of data) [2025-10-29T18:58:38.495733] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T18:58:38.496013] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-29T18:58:38.642926] [DEBUG] [LOCAL ] GGB: Primary data saved (51537 records). [2025-10-29T18:58:38.643072] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-29T18:58:38.643151] [INFO ] [MAIN ] Update Progress: 927/2367 symbols completed. GGB took 42.2s. Estimated remaining: 3h 4m 14s. Rate: 7.8 symbols/min [2025-10-29T18:58:38.805442] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-29T18:58:38.808129] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:58:38.818127] [DEBUG] [LOCAL ] GHI: Loaded 8022 existing records from primary storage. [2025-10-29T18:58:38.818334] [INFO ] [MAIN ] GHI: Loaded 8022 existing records. [2025-10-29T18:58:38.996739] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:58:38.996999] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-29T18:58:38.997048] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-29T18:58:38.997315] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-29T18:58:38.997371] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-29T18:58:39.176431] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-29T18:58:39.358545] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:58:39.593635] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-29T18:58:39.972535] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-29T18:58:40.393619] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-29T18:58:40.799912] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-29T18:58:41.193603] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-29T18:58:41.699225] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-29T18:58:41.701069] [INFO ] [REMOTE ] GHC: Full fetch complete (3722 records). [2025-10-29T18:58:41.701161] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-29T18:58:41.998775] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-29T18:58:42.071389] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-29T18:58:42.071466] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-29T18:58:42.071617] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-29T18:58:42.071719] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-29T18:58:42.072074] [DEBUG] [LOCAL ] GHC: Trimmed 3722 records to 2946 (keeping 200 days of data) [2025-10-29T18:58:42.094941] [DEBUG] [LOCAL ] GHC: Primary data saved (2946 records). [2025-10-29T18:58:42.095038] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-29T18:58:42.095150] [INFO ] [MAIN ] Update Progress: 928/2367 symbols completed. GHC took 16.8s. Estimated remaining: 3h 4m 0s. Rate: 7.8 symbols/min [2025-10-29T18:58:42.260424] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:58:42.267294] [DEBUG] [LOCAL ] GHLD: Loaded 4340 existing records from primary storage. [2025-10-29T18:58:42.267478] [INFO ] [MAIN ] GHLD: Loaded 4340 existing records. [2025-10-29T18:58:42.442167] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:58:42.442408] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-29T18:58:42.442494] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-29T18:58:42.445676] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-29T18:58:42.445745] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-29T18:58:42.509810] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T18:58:42.796393] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-29T18:58:42.796327] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:58:43.307215] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-29T18:58:43.593556] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-29T18:58:44.393624] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-29T18:58:44.609013] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T18:58:44.814487] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-29T18:58:45.193577] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-29T18:58:45.692717] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-29T18:58:45.993532] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-29T18:58:46.793590] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-29T18:58:47.090408] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-29T18:58:47.134973] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T18:58:47.593714] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-29T18:58:48.146979] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-29T18:58:48.393601] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-29T18:58:49.193636] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-29T18:58:49.636734] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-29T18:58:49.713985] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T18:58:49.722615] [INFO ] [REMOTE ] GGG: Full fetch complete (59621 records). [2025-10-29T18:58:49.722755] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-29T18:58:49.998711] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-29T18:58:50.099112] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-29T18:58:50.099186] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-29T18:58:50.099959] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-29T18:58:50.100021] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-29T18:58:50.101285] [DEBUG] [LOCAL ] GGG: Trimmed 59621 records to 40336 (keeping 200 days of data) [2025-10-29T18:58:50.339579] [DEBUG] [LOCAL ] GGG: Primary data saved (40336 records). [2025-10-29T18:58:50.339722] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-29T18:58:50.339803] [INFO ] [MAIN ] Update Progress: 929/2367 symbols completed. GGG took 50.4s. Estimated remaining: 3h 3m 53s. Rate: 7.8 symbols/min [2025-10-29T18:58:50.460778] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-29T18:58:50.541151] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:58:50.556459] [DEBUG] [LOCAL ] GHM: Loaded 14314 existing records from primary storage. [2025-10-29T18:58:50.556695] [INFO ] [MAIN ] GHM: Loaded 14314 existing records. [2025-10-29T18:58:50.735791] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:58:50.735996] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-29T18:58:50.736044] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-29T18:58:50.736218] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-29T18:58:50.736258] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-29T18:58:50.800512] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-29T18:58:51.114353] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:58:51.264112] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T18:58:51.593574] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-29T18:58:52.124900] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T18:58:52.393599] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-29T18:58:52.679178] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-29T18:58:53.193552] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-29T18:58:53.617197] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T18:58:53.993567] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-29T18:58:54.720026] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-29T18:58:54.793558] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-29T18:58:55.499449] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T18:58:55.593549] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-29T18:58:55.865335] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-29T18:58:56.393557] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-29T18:58:56.762755] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-29T18:58:57.193594] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-29T18:58:57.587211] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-29T18:58:57.993574] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-29T18:58:58.521377] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T18:58:58.793567] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-29T18:58:59.149342] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T18:58:59.593574] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-29T18:59:00.007598] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-29T18:59:00.393563] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-29T18:59:00.842576] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-29T18:59:01.193560] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-29T18:59:01.484984] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-29T18:59:01.993630] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-29T18:59:02.404367] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-29T18:59:02.793576] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-29T18:59:03.321336] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T18:59:03.322670] [INFO ] [REMOTE ] GHG: Full fetch complete (4233 records). [2025-10-29T18:59:03.322743] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-29T18:59:03.600575] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-29T18:59:03.766523] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-29T18:59:03.766602] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-29T18:59:03.766770] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-29T18:59:03.766832] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-29T18:59:03.767191] [DEBUG] [LOCAL ] GHG: Trimmed 4233 records to 3270 (keeping 200 days of data) [2025-10-29T18:59:03.785579] [DEBUG] [LOCAL ] GHG: Primary data saved (3270 records). [2025-10-29T18:59:03.785761] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-29T18:59:03.785881] [INFO ] [MAIN ] Update Progress: 930/2367 symbols completed. GHG took 37.2s. Estimated remaining: 3h 3m 55s. Rate: 7.8 symbols/min [2025-10-29T18:59:03.968003] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:59:03.990812] [DEBUG] [LOCAL ] GHY: Loaded 20622 existing records from primary storage. [2025-10-29T18:59:03.991136] [INFO ] [MAIN ] GHY: Loaded 20622 existing records. [2025-10-29T18:59:04.182357] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:59:04.182636] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-29T18:59:04.182721] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-29T18:59:04.182970] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-29T18:59:04.183030] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-29T18:59:04.397731] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-29T18:59:04.433725] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-29T18:59:04.617729] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:59:05.193567] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-29T18:59:05.380279] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T18:59:05.721310] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T18:59:05.993552] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-29T18:59:06.604365] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-29T18:59:06.793542] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-29T18:59:07.549794] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T18:59:07.553100] [INFO ] [REMOTE ] GHI: Full fetch complete (11376 records). [2025-10-29T18:59:07.553173] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-29T18:59:07.598754] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-29T18:59:07.909228] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-29T18:59:07.909304] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-29T18:59:07.909556] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-29T18:59:07.909593] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-29T18:59:07.910035] [DEBUG] [LOCAL ] GHI: Trimmed 11376 records to 8098 (keeping 200 days of data) [2025-10-29T18:59:07.960530] [DEBUG] [LOCAL ] GHI: Primary data saved (8098 records). [2025-10-29T18:59:07.960760] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-29T18:59:07.960920] [INFO ] [MAIN ] Update Progress: 931/2367 symbols completed. GHI took 29.3s. Estimated remaining: 3h 3m 41s. Rate: 7.8 symbols/min [2025-10-29T18:59:08.132929] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:59:08.162678] [DEBUG] [LOCAL ] GIB: Loaded 30851 existing records from primary storage. [2025-10-29T18:59:08.162938] [INFO ] [MAIN ] GIB: Loaded 30851 existing records. [2025-10-29T18:59:08.285802] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-29T18:59:08.366742] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:59:08.366932] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-29T18:59:08.366981] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-29T18:59:08.367546] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-29T18:59:08.367604] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-29T18:59:08.398697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-29T18:59:08.747729] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:59:08.785007] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T18:59:09.193564] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-29T18:59:09.993569] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-29T18:59:10.135093] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T18:59:10.501442] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-29T18:59:10.503007] [INFO ] [REMOTE ] GHLD: Full fetch complete (5226 records). [2025-10-29T18:59:10.503077] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-29T18:59:10.796844] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-29T18:59:10.876708] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-29T18:59:10.876801] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-29T18:59:10.876961] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-29T18:59:10.877002] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-29T18:59:10.877355] [DEBUG] [LOCAL ] GHLD: Trimmed 5226 records to 4368 (keeping 200 days of data) [2025-10-29T18:59:10.902859] [DEBUG] [LOCAL ] GHLD: Primary data saved (4368 records). [2025-10-29T18:59:10.902971] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-29T18:59:10.903044] [INFO ] [MAIN ] Update Progress: 932/2367 symbols completed. GHLD took 28.8s. Estimated remaining: 3h 3m 26s. Rate: 7.8 symbols/min [2025-10-29T18:59:11.076359] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:59:11.091863] [DEBUG] [LOCAL ] GIC: Loaded 12937 existing records from primary storage. [2025-10-29T18:59:11.092158] [INFO ] [MAIN ] GIC: Loaded 12937 existing records. [2025-10-29T18:59:11.269109] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:59:11.269339] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-29T18:59:11.269397] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-29T18:59:11.269567] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-29T18:59:11.269622] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-29T18:59:11.600024] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-29T18:59:11.633308] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:59:11.939628] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T18:59:12.393545] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-29T18:59:12.721880] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T18:59:12.984639] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-29T18:59:13.193550] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-29T18:59:13.898701] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T18:59:13.993600] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-29T18:59:14.771890] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T18:59:14.793553] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-29T18:59:15.593537] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-29T18:59:15.723548] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-29T18:59:16.213506] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-29T18:59:16.393539] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-29T18:59:17.124385] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-29T18:59:17.193553] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-29T18:59:17.750391] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-29T18:59:17.993535] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-29T18:59:18.792401] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T18:59:18.797918] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-29T18:59:19.390902] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T18:59:19.593595] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-29T18:59:20.122335] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T18:59:20.393570] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-29T18:59:21.193617] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-29T18:59:21.492579] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T18:59:21.749848] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-29T18:59:21.993608] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-29T18:59:22.763738] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-29T18:59:22.793512] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-29T18:59:23.460824] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T18:59:23.593563] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-29T18:59:24.207796] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T18:59:24.393533] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-29T18:59:25.193592] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-29T18:59:25.603861] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T18:59:25.815249] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-29T18:59:25.993577] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-29T18:59:26.704629] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T18:59:26.793553] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-29T18:59:27.593531] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-29T18:59:27.676858] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-29T18:59:27.679853] [INFO ] [REMOTE ] GIC: Full fetch complete (19683 records). [2025-10-29T18:59:27.679949] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-29T18:59:28.051524] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-29T18:59:28.051623] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-29T18:59:28.052171] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-29T18:59:28.052234] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-29T18:59:28.052836] [DEBUG] [LOCAL ] GIC: Trimmed 19683 records to 13041 (keeping 200 days of data) [2025-10-29T18:59:28.129036] [DEBUG] [LOCAL ] GIC: Primary data saved (13041 records). [2025-10-29T18:59:28.129150] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-29T18:59:28.129223] [INFO ] [MAIN ] Update Progress: 933/2367 symbols completed. GIC took 17.2s. Estimated remaining: 3h 3m 33s. Rate: 7.8 symbols/min [2025-10-29T18:59:28.306755] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:59:28.311261] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T18:59:28.350696] [DEBUG] [LOCAL ] GIL: Loaded 43779 existing records from primary storage. [2025-10-29T18:59:28.350989] [INFO ] [MAIN ] GIL: Loaded 43779 existing records. [2025-10-29T18:59:28.398721] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-29T18:59:28.538333] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:59:28.538553] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-29T18:59:28.538690] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-29T18:59:28.539538] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-29T18:59:28.539598] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-29T18:59:28.901195] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:59:29.151637] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T18:59:29.193534] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-29T18:59:29.993548] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-29T18:59:30.171350] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-29T18:59:30.793585] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-29T18:59:30.814246] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T18:59:31.593541] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-29T18:59:31.704298] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T18:59:31.711411] [INFO ] [REMOTE ] GHY: Full fetch complete (32062 records). [2025-10-29T18:59:31.711558] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-29T18:59:32.097113] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-29T18:59:32.097201] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-29T18:59:32.097808] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-29T18:59:32.097870] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-29T18:59:32.098770] [DEBUG] [LOCAL ] GHY: Trimmed 32062 records to 20611 (keeping 200 days of data) [2025-10-29T18:59:32.223777] [DEBUG] [LOCAL ] GHY: Primary data saved (20611 records). [2025-10-29T18:59:32.224000] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-29T18:59:32.224093] [INFO ] [MAIN ] Update Progress: 934/2367 symbols completed. GHY took 28.4s. Estimated remaining: 3h 3m 20s. Rate: 7.8 symbols/min [2025-10-29T18:59:32.399049] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:59:32.396180] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-29T18:59:32.417498] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T18:59:32.476679] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-29T18:59:32.477088] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-10-29T18:59:32.685847] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:59:32.686085] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-29T18:59:32.686141] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-29T18:59:32.687135] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-29T18:59:32.687215] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-29T18:59:33.111896] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:59:33.193559] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-29T18:59:33.486176] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T18:59:33.993607] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-29T18:59:34.432548] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T18:59:34.706031] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T18:59:34.793535] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-29T18:59:35.330839] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-29T18:59:35.593568] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-29T18:59:36.393530] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-29T18:59:36.495598] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-29T18:59:37.193597] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-29T18:59:37.747062] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T18:59:37.993562] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-29T18:59:38.239154] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T18:59:38.575401] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-29T18:59:38.793569] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-29T18:59:39.593559] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-29T18:59:39.717201] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-29T18:59:40.393570] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-29T18:59:41.017137] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T18:59:41.193544] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-29T18:59:41.339540] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T18:59:41.343311] [INFO ] [REMOTE ] GHM: Full fetch complete (21927 records). [2025-10-29T18:59:41.343383] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-29T18:59:41.731995] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-29T18:59:41.732073] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-29T18:59:41.732590] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-29T18:59:41.732633] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-29T18:59:41.733254] [DEBUG] [LOCAL ] GHM: Trimmed 21927 records to 14332 (keeping 200 days of data) [2025-10-29T18:59:41.835811] [DEBUG] [LOCAL ] GHM: Primary data saved (14332 records). [2025-10-29T18:59:41.835956] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-29T18:59:41.836035] [INFO ] [MAIN ] Update Progress: 935/2367 symbols completed. GHM took 51.5s. Estimated remaining: 3h 3m 16s. Rate: 7.8 symbols/min [2025-10-29T18:59:42.003765] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-29T18:59:42.011057] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:59:42.056479] [DEBUG] [LOCAL ] GKOS: Loaded 42280 existing records from primary storage. [2025-10-29T18:59:42.056778] [INFO ] [MAIN ] GKOS: Loaded 42280 existing records. [2025-10-29T18:59:42.245921] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:59:42.246209] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-29T18:59:42.246258] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-29T18:59:42.246996] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-29T18:59:42.247056] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-29T18:59:42.625821] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:59:42.661598] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T18:59:42.793572] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-29T18:59:43.367872] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T18:59:43.593570] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-29T18:59:43.802471] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-29T18:59:44.393610] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-29T18:59:45.136248] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T18:59:45.193553] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-29T18:59:45.630231] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T18:59:45.993520] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-29T18:59:46.446291] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T18:59:46.793558] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-29T18:59:47.143701] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T18:59:47.593576] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-29T18:59:48.148272] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T18:59:48.393599] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-29T18:59:48.736728] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T18:59:49.193566] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-29T18:59:49.427135] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T18:59:49.993709] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-29T18:59:50.793553] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-29T18:59:50.950287] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-29T18:59:51.141684] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T18:59:51.593564] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-29T18:59:52.060190] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-29T18:59:52.066844] [INFO ] [REMOTE ] GIB: Full fetch complete (46546 records). [2025-10-29T18:59:52.066956] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-29T18:59:52.394087] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-29T18:59:52.444692] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-29T18:59:52.444776] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-29T18:59:52.445475] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-29T18:59:52.445514] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-29T18:59:52.446519] [DEBUG] [LOCAL ] GIB: Trimmed 46546 records to 30857 (keeping 200 days of data) [2025-10-29T18:59:52.631326] [DEBUG] [LOCAL ] GIB: Primary data saved (30857 records). [2025-10-29T18:59:52.631451] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-29T18:59:52.631527] [INFO ] [MAIN ] Update Progress: 936/2367 symbols completed. GIB took 44.7s. Estimated remaining: 3h 3m 13s. Rate: 7.8 symbols/min [2025-10-29T18:59:52.804139] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T18:59:52.830692] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T18:59:52.869290] [DEBUG] [LOCAL ] GL: Loaded 37187 existing records from primary storage. [2025-10-29T18:59:52.869560] [INFO ] [MAIN ] GL: Loaded 37187 existing records. [2025-10-29T18:59:53.046237] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T18:59:53.046485] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-29T18:59:53.046534] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-29T18:59:53.047565] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-29T18:59:53.047625] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-29T18:59:53.219883] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-29T18:59:53.409215] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T18:59:53.471277] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T18:59:53.993568] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-29T18:59:54.793523] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-29T18:59:55.094303] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-29T18:59:55.135367] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T18:59:55.593598] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-29T18:59:56.057556] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T18:59:56.393579] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-29T18:59:56.867756] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T18:59:57.193552] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-29T18:59:57.555963] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T18:59:57.993569] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-29T18:59:58.793546] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-29T18:59:58.933955] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T18:59:59.171941] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-29T18:59:59.593596] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-29T18:59:59.877239] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T19:00:00.393560] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-29T19:00:00.585542] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T19:00:01.128445] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-29T19:00:01.142372] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-29T19:00:01.142577] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-29T19:00:01.198796] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-29T19:00:01.781751] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-29T19:00:01.781868] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-29T19:00:01.783546] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-29T19:00:01.783690] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-29T19:00:01.785501] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-29T19:00:02.019712] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-29T19:00:02.224469] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-29T19:00:02.225146] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-29T19:00:02.226565] [INFO ] [MAIN ] Update Progress: 937/2367 symbols completed. GIS took 30.0s. Estimated remaining: 3h 3m 8s. Rate: 7.8 symbols/min [2025-10-29T19:00:02.411162] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:00:02.465123] [DEBUG] [LOCAL ] GLOB: Loaded 48028 existing records from primary storage. [2025-10-29T19:00:02.465737] [INFO ] [MAIN ] GLOB: Loaded 48028 existing records. [2025-10-29T19:00:02.679443] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:00:02.679788] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-29T19:00:02.679860] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-29T19:00:02.691696] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-29T19:00:02.711092] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-29T19:00:02.729503] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-29T19:00:02.800614] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-29T19:00:03.123800] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:00:03.527366] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T19:00:03.593581] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-29T19:00:04.305560] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-29T19:00:04.393556] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-29T19:00:05.193559] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-29T19:00:05.286801] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-29T19:00:05.296721] [INFO ] [REMOTE ] GIL: Full fetch complete (62765 records). [2025-10-29T19:00:05.296855] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-29T19:00:05.699783] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-29T19:00:05.699859] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-29T19:00:05.700719] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-29T19:00:05.700782] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-29T19:00:05.701946] [DEBUG] [LOCAL ] GIL: Trimmed 62765 records to 43812 (keeping 200 days of data) [2025-10-29T19:00:05.956280] [DEBUG] [LOCAL ] GIL: Primary data saved (43812 records). [2025-10-29T19:00:05.956403] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-29T19:00:05.956480] [INFO ] [MAIN ] Update Progress: 938/2367 symbols completed. GIL took 37.8s. Estimated remaining: 3h 2m 54s. Rate: 7.8 symbols/min [2025-10-29T19:00:05.999374] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-29T19:00:06.140584] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:00:06.173086] [DEBUG] [LOCAL ] GLP: Loaded 9089 existing records from primary storage. [2025-10-29T19:00:06.173612] [INFO ] [MAIN ] GLP: Loaded 9089 existing records. [2025-10-29T19:00:06.207845] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-29T19:00:06.279604] [INFO ] [REMOTE ] GKOS: Full fetch complete (60837 records). [2025-10-29T19:00:06.279760] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-29T19:00:06.471862] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:00:06.588918] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-29T19:00:06.622872] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-29T19:00:06.655482] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-29T19:00:06.662039] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-29T19:00:06.897193] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-29T19:00:06.912705] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-29T19:00:06.914314] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-29T19:00:06.928700] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-29T19:00:07.010618] [DEBUG] [LOCAL ] GKOS: Trimmed 60837 records to 42391 (keeping 200 days of data) [2025-10-29T19:00:07.050085] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-29T19:00:07.154246] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-29T19:00:07.295098] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:00:07.327184] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T19:00:07.484988] [DEBUG] [LOCAL ] GKOS: Primary data saved (42391 records). [2025-10-29T19:00:07.485108] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-29T19:00:07.485181] [INFO ] [MAIN ] Update Progress: 939/2367 symbols completed. GKOS took 25.6s. Estimated remaining: 3h 2m 37s. Rate: 7.8 symbols/min [2025-10-29T19:00:07.598661] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-29T19:00:07.653198] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:00:07.700543] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-29T19:00:07.700908] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-29T19:00:07.873011] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:00:07.873178] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-29T19:00:07.873223] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-29T19:00:07.873499] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-29T19:00:07.873555] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-29T19:00:08.230727] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:00:08.241098] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-29T19:00:08.393571] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-29T19:00:08.491913] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:00:09.193603] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-29T19:00:09.993626] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-29T19:00:10.196710] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-29T19:00:10.240082] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T19:00:10.793585] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-29T19:00:11.243835] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T19:00:11.593588] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-29T19:00:11.944357] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:00:12.393565] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-29T19:00:12.637339] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T19:00:13.193593] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-29T19:00:13.861573] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-29T19:00:13.993582] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-29T19:00:14.293878] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T19:00:14.793563] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-29T19:00:15.489243] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-29T19:00:15.593558] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-29T19:00:16.116230] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T19:00:16.125125] [INFO ] [REMOTE ] GL: Full fetch complete (54738 records). [2025-10-29T19:00:16.125332] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-29T19:00:16.402248] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-29T19:00:16.525269] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-29T19:00:16.525411] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-29T19:00:16.526273] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-29T19:00:16.526341] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-29T19:00:16.527578] [DEBUG] [LOCAL ] GL: Trimmed 54738 records to 37138 (keeping 200 days of data) [2025-10-29T19:00:16.758835] [DEBUG] [LOCAL ] GL: Primary data saved (37138 records). [2025-10-29T19:00:16.758974] [INFO ] [MAIN ] GL: Full history saved. [2025-10-29T19:00:16.759048] [INFO ] [MAIN ] Update Progress: 940/2367 symbols completed. GL took 24.1s. Estimated remaining: 3h 2m 32s. Rate: 7.8 symbols/min [2025-10-29T19:00:16.929561] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:00:16.956717] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T19:00:17.008597] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-29T19:00:17.008939] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-29T19:00:17.181288] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:00:17.181520] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-29T19:00:17.181565] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-29T19:00:17.181884] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-29T19:00:17.181945] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-29T19:00:17.202302] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-29T19:00:17.532823] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:00:17.828827] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T19:00:17.993534] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-29T19:00:18.115137] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-29T19:00:18.549131] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-29T19:00:18.793562] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-29T19:00:19.143274] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-29T19:00:19.593622] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-29T19:00:20.393565] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-29T19:00:21.104499] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-29T19:00:21.193554] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-29T19:00:21.768151] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T19:00:21.787939] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T19:00:21.993552] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-29T19:00:22.793543] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-29T19:00:23.407321] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T19:00:23.593550] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-29T19:00:24.047526] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:00:24.222814] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T19:00:24.393549] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-29T19:00:25.193718] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-29T19:00:25.669241] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T19:00:25.993549] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-29T19:00:26.126075] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-29T19:00:26.501507] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T19:00:26.793574] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-29T19:00:27.593606] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-29T19:00:28.230800] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T19:00:28.393620] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-29T19:00:29.193638] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-29T19:00:29.326783] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-29T19:00:29.672413] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-29T19:00:29.978715] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-29T19:00:29.993522] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-29T19:00:30.793563] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-29T19:00:31.345561] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T19:00:31.593573] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-29T19:00:32.275554] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-29T19:00:32.393578] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-29T19:00:33.198768] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-29T19:00:33.214977] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-29T19:00:33.225322] [INFO ] [REMOTE ] GLOB: Full fetch complete (66766 records). [2025-10-29T19:00:33.225444] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-29T19:00:33.612755] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-29T19:00:33.612877] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-29T19:00:33.613813] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-29T19:00:33.613874] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-29T19:00:33.615424] [DEBUG] [LOCAL ] GLOB: Trimmed 66766 records to 48070 (keeping 200 days of data) [2025-10-29T19:00:33.894420] [DEBUG] [LOCAL ] GLOB: Primary data saved (48070 records). [2025-10-29T19:00:33.894543] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-29T19:00:33.895415] [INFO ] [MAIN ] Update Progress: 941/2367 symbols completed. GLOB took 31.7s. Estimated remaining: 3h 2m 39s. Rate: 7.8 symbols/min [2025-10-29T19:00:33.998392] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-29T19:00:34.021721] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-29T19:00:34.066985] [INFO ] [REMOTE ] GLP: Full fetch complete (14227 records). [2025-10-29T19:00:34.086953] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:00:34.087263] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-29T19:00:34.481767] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-29T19:00:34.499869] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-29T19:00:34.500325] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-29T19:00:34.530753] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-29T19:00:34.532777] [DEBUG] [LOCAL ] GME: Loaded 53776 existing records from primary storage. [2025-10-29T19:00:34.541411] [DEBUG] [LOCAL ] GLP: Trimmed 14227 records to 9072 (keeping 200 days of data) [2025-10-29T19:00:34.541637] [INFO ] [MAIN ] GME: Loaded 53776 existing records. [2025-10-29T19:00:34.541127] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-29T19:00:34.709496] [DEBUG] [LOCAL ] GLP: Primary data saved (9072 records). [2025-10-29T19:00:34.720823] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-29T19:00:34.720959] [INFO ] [MAIN ] Update Progress: 942/2367 symbols completed. GLP took 28.8s. Estimated remaining: 3h 2m 21s. Rate: 7.8 symbols/min [2025-10-29T19:00:34.802931] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-29T19:00:34.955389] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:00:34.979887] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-29T19:00:34.989053] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:00:34.989173] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-29T19:00:34.990191] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-29T19:00:34.990297] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-29T19:00:35.335669] [DEBUG] [LOCAL ] GMED: Loaded 48070 existing records from primary storage. [2025-10-29T19:00:35.366208] [INFO ] [MAIN ] GMED: Loaded 48070 existing records. [2025-10-29T19:00:35.395219] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:00:35.607683] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:00:35.600680] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-29T19:00:35.609182] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-29T19:00:35.609256] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-29T19:00:35.609624] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-29T19:00:35.609712] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-29T19:00:35.980188] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:00:36.010920] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-29T19:00:36.393609] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-29T19:00:36.845346] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-29T19:00:37.193716] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-29T19:00:37.503431] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T19:00:37.576289] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-29T19:00:37.993552] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-29T19:00:38.793555] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-29T19:00:39.187483] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T19:00:39.304545] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-29T19:00:39.315906] [INFO ] [REMOTE ] GLW: Full fetch complete (77799 records). [2025-10-29T19:00:39.316053] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-29T19:00:39.598718] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-29T19:00:39.726832] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-29T19:00:39.726909] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-29T19:00:39.727867] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-29T19:00:39.727938] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-29T19:00:39.729359] [DEBUG] [LOCAL ] GLW: Trimmed 77799 records to 53635 (keeping 200 days of data) [2025-10-29T19:00:40.045583] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-29T19:00:40.045763] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-29T19:00:40.045850] [INFO ] [MAIN ] Update Progress: 943/2367 symbols completed. GLW took 32.6s. Estimated remaining: 3h 2m 9s. Rate: 7.8 symbols/min [2025-10-29T19:00:40.210089] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:00:40.243164] [DEBUG] [LOCAL ] GMRE: Loaded 35511 existing records from primary storage. [2025-10-29T19:00:40.243454] [INFO ] [MAIN ] GMRE: Loaded 35511 existing records. [2025-10-29T19:00:40.396322] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-29T19:00:40.420430] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:00:40.420791] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-29T19:00:40.420843] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-29T19:00:40.421179] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-29T19:00:40.421218] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-29T19:00:40.775955] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:00:40.963849] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-29T19:00:41.193542] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-29T19:00:41.375277] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-29T19:00:41.780018] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T19:00:41.993565] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-29T19:00:42.793557] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-29T19:00:43.392297] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T19:00:43.393791] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-29T19:00:43.593528] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-29T19:00:43.667901] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T19:00:44.393563] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-29T19:00:44.921579] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T19:00:45.193608] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-29T19:00:45.993620] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-29T19:00:46.459353] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-29T19:00:46.504612] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T19:00:46.793608] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-29T19:00:46.946299] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-29T19:00:47.593561] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-29T19:00:48.393604] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-29T19:00:48.925323] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-29T19:00:48.981308] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T19:00:49.193535] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-29T19:00:49.507356] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T19:00:49.993620] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-29T19:00:50.431498] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T19:00:50.793621] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-29T19:00:51.593530] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-29T19:00:51.920019] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T19:00:51.989215] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-29T19:00:52.393569] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-29T19:00:53.188793] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-29T19:00:53.199154] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-29T19:00:53.899480] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T19:00:53.909821] [INFO ] [REMOTE ] GMED: Full fetch complete (70135 records). [2025-10-29T19:00:53.909984] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-29T19:00:53.998844] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-29T19:00:54.321720] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-29T19:00:54.321822] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-29T19:00:54.322803] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-29T19:00:54.322873] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-29T19:00:54.324309] [DEBUG] [LOCAL ] GMED: Trimmed 70135 records to 48081 (keeping 200 days of data) [2025-10-29T19:00:54.593801] [DEBUG] [LOCAL ] GMED: Primary data saved (48081 records). [2025-10-29T19:00:54.593962] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-29T19:00:54.594049] [INFO ] [MAIN ] Update Progress: 944/2367 symbols completed. GMED took 19.9s. Estimated remaining: 3h 2m 12s. Rate: 7.8 symbols/min [2025-10-29T19:00:54.760049] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:00:54.777675] [DEBUG] [LOCAL ] GNE: Loaded 18106 existing records from primary storage. [2025-10-29T19:00:54.777903] [INFO ] [MAIN ] GNE: Loaded 18106 existing records. [2025-10-29T19:00:54.808624] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-29T19:00:54.953911] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:00:54.954109] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-29T19:00:54.954156] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-29T19:00:54.954316] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-29T19:00:54.954354] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-29T19:00:55.348582] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:00:55.599791] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-29T19:00:55.624532] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-29T19:00:55.864819] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-29T19:00:55.927121] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T19:00:56.197827] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T19:00:56.393563] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-29T19:00:57.193575] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-29T19:00:57.993570] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-29T19:00:58.539913] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-29T19:00:58.540833] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T19:00:58.793532] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-29T19:00:58.922808] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-29T19:00:59.593563] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-29T19:00:59.863334] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T19:01:00.241954] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-29T19:01:00.393619] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-29T19:01:01.193562] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-29T19:01:01.993606] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-29T19:01:02.453949] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-29T19:01:02.587762] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T19:01:02.793567] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-29T19:01:03.405428] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-29T19:01:03.593559] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-29T19:01:04.393628] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-29T19:01:05.205196] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-29T19:01:05.213899] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-29T19:01:05.316090] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-29T19:01:05.327881] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-10-29T19:01:05.328067] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-29T19:01:05.689306] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T19:01:05.781433] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T19:01:05.807059] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-29T19:01:05.807136] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-29T19:01:05.808091] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-29T19:01:05.808153] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-29T19:01:05.809551] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 53776 (keeping 200 days of data) [2025-10-29T19:01:06.009631] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-29T19:01:06.135391] [DEBUG] [LOCAL ] GME: Primary data saved (53776 records). [2025-10-29T19:01:06.135538] [INFO ] [MAIN ] GME: Full history saved. [2025-10-29T19:01:06.136458] [INFO ] [MAIN ] Update Progress: 945/2367 symbols completed. GME took 32.2s. Estimated remaining: 3h 2m 10s. Rate: 7.8 symbols/min [2025-10-29T19:01:06.323528] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:01:06.373834] [DEBUG] [LOCAL ] GNK: Loaded 38830 existing records from primary storage. [2025-10-29T19:01:06.374130] [INFO ] [MAIN ] GNK: Loaded 38830 existing records. [2025-10-29T19:01:06.563347] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:01:06.563587] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-29T19:01:06.563695] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-29T19:01:06.563953] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-29T19:01:06.564024] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-29T19:01:06.762563] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-29T19:01:06.798672] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-29T19:01:06.950766] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:01:07.593612] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-29T19:01:07.903502] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T19:01:08.368783] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T19:01:08.393528] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-29T19:01:09.193531] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-29T19:01:09.217586] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-29T19:01:09.993611] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-29T19:01:10.166553] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T19:01:10.791547] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-29T19:01:10.796437] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-29T19:01:11.505038] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-29T19:01:11.516402] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-29T19:01:11.516562] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-29T19:01:11.598737] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-29T19:01:11.917699] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-29T19:01:11.917810] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-29T19:01:11.918794] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-29T19:01:11.918857] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-29T19:01:11.920307] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-29T19:01:12.272291] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-29T19:01:12.272430] [INFO ] [MAIN ] GM: Full history saved. [2025-10-29T19:01:12.272510] [INFO ] [MAIN ] Update Progress: 946/2367 symbols completed. GM took 55.5s. Estimated remaining: 3h 2m 0s. Rate: 7.8 symbols/min [2025-10-29T19:01:12.398805] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-29T19:01:12.451820] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:01:12.494871] [DEBUG] [LOCAL ] GNL: Loaded 46178 existing records from primary storage. [2025-10-29T19:01:12.495209] [INFO ] [MAIN ] GNL: Loaded 46178 existing records. [2025-10-29T19:01:12.686249] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:01:12.686739] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-29T19:01:12.686814] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-29T19:01:12.687338] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-29T19:01:12.687416] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-29T19:01:12.833837] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T19:01:13.080219] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:01:13.093600] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T19:01:13.193584] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-29T19:01:13.993561] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-29T19:01:14.323428] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-29T19:01:14.329510] [INFO ] [REMOTE ] GMRE: Full fetch complete (51041 records). [2025-10-29T19:01:14.329663] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-29T19:01:14.750817] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-29T19:01:14.750913] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-29T19:01:14.751663] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-29T19:01:14.751725] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-29T19:01:14.752867] [DEBUG] [LOCAL ] GMRE: Trimmed 51041 records to 35346 (keeping 200 days of data) [2025-10-29T19:01:14.803284] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-29T19:01:14.962778] [DEBUG] [LOCAL ] GMRE: Primary data saved (35346 records). [2025-10-29T19:01:14.962909] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-29T19:01:14.962984] [INFO ] [MAIN ] Update Progress: 947/2367 symbols completed. GMRE took 34.9s. Estimated remaining: 3h 1m 45s. Rate: 7.8 symbols/min [2025-10-29T19:01:15.128659] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:01:15.169928] [DEBUG] [LOCAL ] GNRC: Loaded 45153 existing records from primary storage. [2025-10-29T19:01:15.170260] [INFO ] [MAIN ] GNRC: Loaded 45153 existing records. [2025-10-29T19:01:15.347238] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:01:15.347440] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-29T19:01:15.347487] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-29T19:01:15.347733] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-29T19:01:15.347789] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-29T19:01:15.608012] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-29T19:01:15.694903] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:01:16.062380] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-29T19:01:16.229853] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-29T19:01:16.393592] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-29T19:01:16.684303] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-29T19:01:16.687695] [INFO ] [REMOTE ] GNE: Full fetch complete (22627 records). [2025-10-29T19:01:16.687779] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-29T19:01:17.096220] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-29T19:01:17.096296] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-29T19:01:17.097102] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-29T19:01:17.097187] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-29T19:01:17.097875] [DEBUG] [LOCAL ] GNE: Trimmed 22627 records to 18134 (keeping 200 days of data) [2025-10-29T19:01:17.199073] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-29T19:01:17.218933] [DEBUG] [LOCAL ] GNE: Primary data saved (18134 records). [2025-10-29T19:01:17.219038] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-29T19:01:17.219165] [INFO ] [MAIN ] Update Progress: 948/2367 symbols completed. GNE took 22.6s. Estimated remaining: 3h 1m 29s. Rate: 7.8 symbols/min [2025-10-29T19:01:17.395625] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:01:17.405965] [DEBUG] [LOCAL ] GNT: Loaded 8606 existing records from primary storage. [2025-10-29T19:01:17.406169] [INFO ] [MAIN ] GNT: Loaded 8606 existing records. [2025-10-29T19:01:17.584315] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:01:17.584726] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-29T19:01:17.584838] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-29T19:01:17.585102] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-29T19:01:17.585207] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-29T19:01:17.892407] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-29T19:01:17.979474] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:01:17.993559] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-29T19:01:18.425520] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T19:01:18.441778] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T19:01:18.793551] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-29T19:01:19.234496] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-29T19:01:19.593585] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-29T19:01:20.393737] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-29T19:01:20.694456] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T19:01:21.193568] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-29T19:01:21.633837] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T19:01:21.993562] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-29T19:01:22.226619] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T19:01:22.793565] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-29T19:01:23.098254] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T19:01:23.593556] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-29T19:01:23.927522] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T19:01:24.393569] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-29T19:01:24.665928] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T19:01:24.836588] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-29T19:01:25.193605] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-29T19:01:25.993557] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-29T19:01:26.278779] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T19:01:26.544439] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-29T19:01:26.793586] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-29T19:01:27.593609] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-29T19:01:27.975594] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T19:01:28.055047] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-29T19:01:28.393587] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-29T19:01:28.864204] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-29T19:01:29.193595] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-29T19:01:29.993573] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-29T19:01:30.353254] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T19:01:30.793534] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-29T19:01:31.010170] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T19:01:31.262199] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T19:01:31.593569] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-29T19:01:32.012370] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-29T19:01:32.393597] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-29T19:01:33.193590] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-29T19:01:33.644508] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T19:01:33.993550] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-29T19:01:34.288169] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T19:01:34.386469] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T19:01:34.793597] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-29T19:01:35.593587] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-29T19:01:35.801190] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T19:01:36.393560] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-29T19:01:36.935421] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-29T19:01:37.193569] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-29T19:01:37.773927] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T19:01:37.993570] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-29T19:01:38.464821] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-29T19:01:38.476734] [INFO ] [REMOTE ] GNK: Full fetch complete (56940 records). [2025-10-29T19:01:38.476891] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-29T19:01:38.798716] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-29T19:01:38.879437] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-29T19:01:38.906532] [INFO ] [REMOTE ] GNT: Full fetch complete (11512 records). [2025-10-29T19:01:38.924765] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-29T19:01:38.924558] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-29T19:01:38.925222] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-29T19:01:38.969612] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-29T19:01:38.990337] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-29T19:01:39.056158] [DEBUG] [LOCAL ] GNK: Trimmed 56940 records to 38699 (keeping 200 days of data) [2025-10-29T19:01:39.547702] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-29T19:01:39.554786] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-29T19:01:39.555111] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-29T19:01:39.573433] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-29T19:01:39.573528] [DEBUG] [LOCAL ] GNK: Primary data saved (38699 records). [2025-10-29T19:01:39.574308] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-29T19:01:39.575165] [INFO ] [MAIN ] Update Progress: 949/2367 symbols completed. GNK took 33.4s. Estimated remaining: 3h 1m 43s. Rate: 7.8 symbols/min [2025-10-29T19:01:39.575426] [DEBUG] [LOCAL ] GNT: Trimmed 11512 records to 8617 (keeping 200 days of data) [2025-10-29T19:01:39.610116] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-29T19:01:39.746015] [DEBUG] [LOCAL ] GNT: Primary data saved (8617 records). [2025-10-29T19:01:39.750861] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-29T19:01:39.751288] [INFO ] [MAIN ] Update Progress: 950/2367 symbols completed. GNT took 22.5s. Estimated remaining: 3h 1m 25s. Rate: 7.8 symbols/min [2025-10-29T19:01:39.953353] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:01:40.077920] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:01:40.111346] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T19:01:40.166447] [DEBUG] [LOCAL ] GNW: Loaded 51232 existing records from primary storage. [2025-10-29T19:01:40.166835] [INFO ] [MAIN ] GNW: Loaded 51232 existing records. [2025-10-29T19:01:40.281165] [DEBUG] [LOCAL ] GOF: Loaded 42723 existing records from primary storage. [2025-10-29T19:01:40.302107] [INFO ] [MAIN ] GOF: Loaded 42723 existing records. [2025-10-29T19:01:40.400572] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-29T19:01:40.447607] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:01:40.463920] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-29T19:01:40.464016] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-29T19:01:40.469763] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-29T19:01:40.490599] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-29T19:01:40.633475] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:01:40.644932] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-29T19:01:40.644993] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-29T19:01:40.650571] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-29T19:01:40.660851] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-29T19:01:41.260326] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:01:41.291586] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-29T19:01:41.397868] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-29T19:01:41.418195] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:01:41.654349] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:01:41.993576] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-29T19:01:42.613483] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T19:01:42.793576] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-29T19:01:43.108463] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T19:01:43.593563] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-29T19:01:44.014213] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T19:01:44.393572] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-29T19:01:44.723135] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T19:01:45.193623] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-29T19:01:45.643886] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-29T19:01:45.993537] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-29T19:01:46.311101] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T19:01:46.793601] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-29T19:01:47.354542] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T19:01:47.364011] [INFO ] [REMOTE ] GNL: Full fetch complete (67891 records). [2025-10-29T19:01:47.364135] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-29T19:01:47.599735] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-29T19:01:47.755460] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-29T19:01:47.755532] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-29T19:01:47.756437] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-29T19:01:47.756498] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-29T19:01:47.757964] [DEBUG] [LOCAL ] GNL: Trimmed 67891 records to 46108 (keeping 200 days of data) [2025-10-29T19:01:48.043405] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T19:01:48.064745] [DEBUG] [LOCAL ] GNL: Primary data saved (46108 records). [2025-10-29T19:01:48.065119] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-29T19:01:48.065391] [INFO ] [MAIN ] Update Progress: 951/2367 symbols completed. GNL took 35.8s. Estimated remaining: 3h 1m 18s. Rate: 7.8 symbols/min [2025-10-29T19:01:48.229518] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:01:48.258198] [DEBUG] [LOCAL ] GOLF: Loaded 29624 existing records from primary storage. [2025-10-29T19:01:48.258468] [INFO ] [MAIN ] GOLF: Loaded 29624 existing records. [2025-10-29T19:01:48.398629] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-29T19:01:48.439231] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:01:48.439405] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-29T19:01:48.439460] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-29T19:01:48.439802] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-29T19:01:48.439870] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-29T19:01:48.795396] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:01:48.836165] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T19:01:49.193560] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-29T19:01:49.712440] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T19:01:49.993567] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-29T19:01:50.415311] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T19:01:50.793549] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-29T19:01:51.278341] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T19:01:51.593568] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-29T19:01:52.077674] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T19:01:52.393687] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-29T19:01:53.153378] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T19:01:53.163505] [INFO ] [REMOTE ] GNRC: Full fetch complete (65786 records). [2025-10-29T19:01:53.163669] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-29T19:01:53.195335] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-29T19:01:53.552966] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T19:01:53.605115] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-29T19:01:53.605210] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-29T19:01:53.606153] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-29T19:01:53.606229] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-29T19:01:53.607611] [DEBUG] [LOCAL ] GNRC: Trimmed 65786 records to 45196 (keeping 200 days of data) [2025-10-29T19:01:53.887851] [DEBUG] [LOCAL ] GNRC: Primary data saved (45196 records). [2025-10-29T19:01:53.887999] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-29T19:01:53.888083] [INFO ] [MAIN ] Update Progress: 952/2367 symbols completed. GNRC took 38.9s. Estimated remaining: 3h 1m 7s. Rate: 7.8 symbols/min [2025-10-29T19:01:53.998788] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-29T19:01:54.062422] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:01:54.104070] [DEBUG] [LOCAL ] GOOS: Loaded 43634 existing records from primary storage. [2025-10-29T19:01:54.104378] [INFO ] [MAIN ] GOOS: Loaded 43634 existing records. [2025-10-29T19:01:54.284558] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:01:54.284834] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-29T19:01:54.284884] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-29T19:01:54.285565] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-29T19:01:54.285707] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-29T19:01:54.682892] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:01:54.730959] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-29T19:01:54.793591] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-29T19:01:55.361777] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-29T19:01:55.593706] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-29T19:01:56.169229] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T19:01:56.393614] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-29T19:01:56.743299] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T19:01:57.193713] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-29T19:01:57.505436] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T19:01:57.993632] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-29T19:01:58.158093] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T19:01:58.793598] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-29T19:01:59.109231] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T19:01:59.593613] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-29T19:02:00.006329] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T19:02:00.393582] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-29T19:02:01.201312] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-29T19:02:01.212103] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-29T19:02:01.652749] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T19:02:01.993595] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-29T19:02:02.497776] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T19:02:02.793611] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-29T19:02:03.305381] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T19:02:03.593736] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-29T19:02:03.776590] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T19:02:04.393564] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-29T19:02:04.832144] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T19:02:05.193568] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-29T19:02:05.735420] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T19:02:05.993579] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-29T19:02:06.271351] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-29T19:02:06.793630] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-29T19:02:07.554374] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T19:02:07.564817] [INFO ] [REMOTE ] GOF: Full fetch complete (62890 records). [2025-10-29T19:02:07.564938] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-29T19:02:07.598002] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-29T19:02:07.953181] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T19:02:08.006081] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-29T19:02:08.006573] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-29T19:02:08.007504] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-29T19:02:08.007566] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-29T19:02:08.009122] [DEBUG] [LOCAL ] GOF: Trimmed 62890 records to 42710 (keeping 200 days of data) [2025-10-29T19:02:08.262442] [DEBUG] [LOCAL ] GOF: Primary data saved (42710 records). [2025-10-29T19:02:08.262574] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-29T19:02:08.262673] [INFO ] [MAIN ] Update Progress: 953/2367 symbols completed. GOF took 28.5s. Estimated remaining: 3h 1m 10s. Rate: 7.8 symbols/min [2025-10-29T19:02:08.406775] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-29T19:02:08.438666] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:02:08.472491] [DEBUG] [LOCAL ] GOTU: Loaded 36448 existing records from primary storage. [2025-10-29T19:02:08.473118] [INFO ] [MAIN ] GOTU: Loaded 36448 existing records. [2025-10-29T19:02:08.679926] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:02:08.680139] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-29T19:02:08.680186] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-29T19:02:08.680351] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-29T19:02:08.680389] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-29T19:02:09.073227] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:02:09.107352] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-29T19:02:09.193532] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-29T19:02:09.275304] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T19:02:09.993602] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-29T19:02:10.705427] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T19:02:10.716398] [INFO ] [REMOTE ] GNW: Full fetch complete (73867 records). [2025-10-29T19:02:10.716584] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-29T19:02:10.798686] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-29T19:02:11.162200] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-29T19:02:11.162396] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-29T19:02:11.163459] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-29T19:02:11.163563] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-29T19:02:11.165974] [DEBUG] [LOCAL ] GNW: Trimmed 73867 records to 51221 (keeping 200 days of data) [2025-10-29T19:02:11.407837] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T19:02:11.520867] [DEBUG] [LOCAL ] GNW: Primary data saved (51221 records). [2025-10-29T19:02:11.521033] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-29T19:02:11.521155] [INFO ] [MAIN ] Update Progress: 954/2367 symbols completed. GNW took 31.9s. Estimated remaining: 3h 0m 55s. Rate: 7.8 symbols/min [2025-10-29T19:02:11.601242] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-29T19:02:11.721491] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:02:11.774202] [DEBUG] [LOCAL ] GPC: Loaded 45740 existing records from primary storage. [2025-10-29T19:02:11.774534] [INFO ] [MAIN ] GPC: Loaded 45740 existing records. [2025-10-29T19:02:11.973532] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:02:11.973844] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-29T19:02:11.974148] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-29T19:02:11.974679] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-29T19:02:11.974746] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-29T19:02:12.256064] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-29T19:02:12.396017] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-29T19:02:12.401880] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:02:12.528383] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T19:02:13.193571] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-29T19:02:13.578812] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T19:02:13.993613] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-29T19:02:14.542286] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T19:02:14.793616] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-29T19:02:15.379935] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-29T19:02:15.593609] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-29T19:02:16.151630] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T19:02:16.393559] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-29T19:02:16.854688] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T19:02:17.193549] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-29T19:02:17.395963] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-29T19:02:17.993554] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-29T19:02:18.453693] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T19:02:18.793607] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-29T19:02:19.162070] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T19:02:19.593610] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-29T19:02:20.113202] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T19:02:20.393637] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-29T19:02:20.791635] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T19:02:21.193566] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-29T19:02:21.741377] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-29T19:02:21.993574] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-29T19:02:22.123038] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T19:02:22.793593] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-29T19:02:23.226011] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T19:02:23.593568] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-29T19:02:23.783401] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T19:02:23.790161] [INFO ] [REMOTE ] GOLF: Full fetch complete (45234 records). [2025-10-29T19:02:23.790427] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-29T19:02:24.186931] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-29T19:02:24.187011] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-29T19:02:24.187940] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-29T19:02:24.188000] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-29T19:02:24.189140] [DEBUG] [LOCAL ] GOLF: Trimmed 45234 records to 29569 (keeping 200 days of data) [2025-10-29T19:02:24.381519] [DEBUG] [LOCAL ] GOLF: Primary data saved (29569 records). [2025-10-29T19:02:24.381724] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-29T19:02:24.381846] [INFO ] [MAIN ] Update Progress: 955/2367 symbols completed. GOLF took 36.3s. Estimated remaining: 3h 0m 55s. Rate: 7.8 symbols/min [2025-10-29T19:02:24.402585] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-29T19:02:24.572381] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:02:24.588166] [DEBUG] [LOCAL ] GPI: Loaded 14578 existing records from primary storage. [2025-10-29T19:02:24.588420] [INFO ] [MAIN ] GPI: Loaded 14578 existing records. [2025-10-29T19:02:24.772465] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:02:24.772907] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-29T19:02:24.773033] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-29T19:02:24.773353] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-29T19:02:24.773502] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-29T19:02:25.188778] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:02:25.192520] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-29T19:02:25.202041] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-29T19:02:25.598189] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T19:02:25.993563] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-29T19:02:26.390932] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T19:02:26.793611] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-29T19:02:27.380771] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T19:02:27.475776] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-29T19:02:27.593568] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-29T19:02:28.393556] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-29T19:02:28.619906] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T19:02:28.972094] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-29T19:02:29.193577] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-29T19:02:29.991571] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T19:02:29.995471] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-29T19:02:30.793610] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-29T19:02:30.951531] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-29T19:02:31.593591] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-29T19:02:31.812128] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T19:02:32.393567] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-29T19:02:32.845545] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:02:33.193577] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-29T19:02:33.743186] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T19:02:34.003685] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-29T19:02:34.031342] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T19:02:34.793559] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-29T19:02:34.830578] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T19:02:35.593596] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-29T19:02:36.098696] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-29T19:02:36.106987] [INFO ] [REMOTE ] GOOS: Full fetch complete (64492 records). [2025-10-29T19:02:36.107160] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-29T19:02:36.403974] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-29T19:02:36.553008] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-29T19:02:36.553135] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-29T19:02:36.554636] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-29T19:02:36.554732] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-29T19:02:36.556811] [DEBUG] [LOCAL ] GOOS: Trimmed 64492 records to 43547 (keeping 200 days of data) [2025-10-29T19:02:36.797526] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T19:02:36.829933] [INFO ] [REMOTE ] GOTU: Full fetch complete (57835 records). [2025-10-29T19:02:36.847769] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-29T19:02:36.909805] [DEBUG] [LOCAL ] GOOS: Primary data saved (43547 records). [2025-10-29T19:02:36.936298] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-29T19:02:36.946229] [INFO ] [MAIN ] Update Progress: 956/2367 symbols completed. GOOS took 43.1s. Estimated remaining: 3h 0m 55s. Rate: 7.8 symbols/min [2025-10-29T19:02:37.203282] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-29T19:02:37.372399] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:02:37.473910] [DEBUG] [LOCAL ] GPJA: Loaded 4026 existing records from primary storage. [2025-10-29T19:02:37.484562] [INFO ] [MAIN ] GPJA: Loaded 4026 existing records. [2025-10-29T19:02:37.657533] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-29T19:02:37.669252] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-29T19:02:37.670244] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-29T19:02:37.670360] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-29T19:02:37.760117] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:02:37.753118] [DEBUG] [LOCAL ] GOTU: Trimmed 57835 records to 36497 (keeping 200 days of data) [2025-10-29T19:02:37.761283] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-29T19:02:37.762365] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-29T19:02:37.763095] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-29T19:02:37.763157] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-29T19:02:38.227919] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-29T19:02:38.275220] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-29T19:02:38.373007] [DEBUG] [LOCAL ] GOTU: Primary data saved (36497 records). [2025-10-29T19:02:38.373461] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-29T19:02:38.373627] [INFO ] [MAIN ] Update Progress: 957/2367 symbols completed. GOTU took 30.1s. Estimated remaining: 3h 0m 38s. Rate: 7.8 symbols/min [2025-10-29T19:02:38.480300] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:02:38.503943] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-29T19:02:38.516400] [INFO ] [REMOTE ] GPC: Full fetch complete (68611 records). [2025-10-29T19:02:38.516634] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-29T19:02:38.798788] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-29T19:02:38.967069] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-29T19:02:38.967335] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-29T19:02:38.968983] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-29T19:02:38.969113] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-29T19:02:38.971173] [DEBUG] [LOCAL ] GPC: Trimmed 68611 records to 45708 (keeping 200 days of data) [2025-10-29T19:02:39.094904] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T19:02:39.328389] [DEBUG] [LOCAL ] GPC: Primary data saved (45708 records). [2025-10-29T19:02:39.328614] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-29T19:02:39.330285] [INFO ] [MAIN ] Update Progress: 958/2367 symbols completed. GPC took 27.8s. Estimated remaining: 3h 0m 20s. Rate: 7.8 symbols/min [2025-10-29T19:02:39.459298] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-29T19:02:39.593590] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-29T19:02:40.316119] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T19:02:40.393591] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-29T19:02:40.667207] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-29T19:02:41.193610] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-29T19:02:41.813232] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-29T19:02:41.993606] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-29T19:02:42.322236] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-29T19:02:42.793588] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-29T19:02:43.108929] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-29T19:02:43.593784] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-29T19:02:43.897264] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-29T19:02:44.393690] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-29T19:02:45.126610] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T19:02:45.193576] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-29T19:02:45.568850] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T19:02:45.993689] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-29T19:02:46.793690] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-29T19:02:46.817069] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-29T19:02:46.822492] [INFO ] [REMOTE ] GPI: Full fetch complete (22289 records). [2025-10-29T19:02:46.822726] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-29T19:02:47.270532] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-29T19:02:47.271528] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-29T19:02:47.273350] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-29T19:02:47.273456] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-29T19:02:47.272035] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T19:02:47.277379] [DEBUG] [LOCAL ] GPI: Trimmed 22289 records to 14680 (keeping 200 days of data) [2025-10-29T19:02:47.381386] [DEBUG] [LOCAL ] GPI: Primary data saved (14680 records). [2025-10-29T19:02:47.381587] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-29T19:02:47.381708] [INFO ] [MAIN ] Update Progress: 959/2367 symbols completed. GPI took 23.0s. Estimated remaining: 3h 0m 13s. Rate: 7.8 symbols/min [2025-10-29T19:02:47.593723] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-29T19:02:48.050682] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-29T19:02:48.393588] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-29T19:02:48.836210] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-29T19:02:49.193603] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-29T19:02:49.676818] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-29T19:02:49.678774] [INFO ] [REMOTE ] GPJA: Full fetch complete (6733 records). [2025-10-29T19:02:49.678877] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-29T19:02:50.153184] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-29T19:02:50.153273] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-29T19:02:50.153478] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-29T19:02:50.153519] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-29T19:02:50.154074] [DEBUG] [LOCAL ] GPJA: Trimmed 6733 records to 4032 (keeping 200 days of data) [2025-10-29T19:02:50.185689] [DEBUG] [LOCAL ] GPJA: Primary data saved (4032 records). [2025-10-29T19:02:50.185859] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-29T19:02:50.185962] [INFO ] [MAIN ] Update Progress: 960/2367 symbols completed. GPJA took 13.2s. Estimated remaining: 2h 59m 58s. Rate: 7.8 symbols/min [2025-10-29T19:02:51.133005] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:02:51.137499] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:02:51.160002] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:02:51.237168] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:02:51.284762] [DEBUG] [LOCAL ] GPOR: Loaded 23382 existing records from primary storage. [2025-10-29T19:02:51.287605] [INFO ] [MAIN ] GPOR: Loaded 23382 existing records. [2025-10-29T19:02:51.310900] [DEBUG] [LOCAL ] GPMT: Loaded 25367 existing records from primary storage. [2025-10-29T19:02:51.338834] [INFO ] [MAIN ] GPMT: Loaded 25367 existing records. [2025-10-29T19:02:51.573041] [DEBUG] [LOCAL ] GPK: Loaded 52757 existing records from primary storage. [2025-10-29T19:02:51.591965] [INFO ] [MAIN ] GPK: Loaded 52757 existing records. [2025-10-29T19:02:51.619446] [DEBUG] [LOCAL ] GPN: Loaded 51691 existing records from primary storage. [2025-10-29T19:02:51.699688] [INFO ] [MAIN ] GPN: Loaded 51691 existing records. [2025-10-29T19:02:51.892712] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:02:51.901046] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:02:51.916104] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-29T19:02:51.915953] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-29T19:02:51.955324] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-29T19:02:51.955407] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-29T19:02:52.000690] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-29T19:02:52.011334] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-29T19:02:52.006169] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-29T19:02:52.022863] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-29T19:02:52.411779] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:02:52.400676] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:02:52.428732] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-29T19:02:52.455128] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-29T19:02:52.428905] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-29T19:02:52.496040] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-29T19:02:52.550999] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-29T19:02:52.556412] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-29T19:02:52.561701] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-29T19:02:52.618440] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-29T19:02:53.502305] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:02:53.615937] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-29T19:02:53.676605] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:02:53.762706] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:02:53.756375] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-29T19:02:53.763126] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-29T19:02:53.849014] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:02:53.849417] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-29T19:02:54.443938] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-29T19:02:54.452062] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-29T19:02:54.725009] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T19:02:54.731125] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-29T19:02:55.063911] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T19:02:55.107846] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-29T19:02:55.111703] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T19:02:55.345010] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T19:02:55.593564] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-29T19:02:55.666259] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T19:02:56.390873] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T19:02:56.400111] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-29T19:02:56.732438] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T19:02:57.194631] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-29T19:02:57.197991] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T19:02:57.921350] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T19:02:57.993571] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-29T19:02:58.793548] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-29T19:02:58.957050] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-29T19:02:59.593565] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-29T19:03:00.179668] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T19:03:00.394433] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-29T19:03:00.400051] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-29T19:03:01.193576] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-29T19:03:01.705891] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T19:03:01.993599] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-29T19:03:02.575525] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T19:03:02.793631] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-29T19:03:03.278546] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T19:03:03.529520] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-29T19:03:03.593591] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-29T19:03:04.393574] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-29T19:03:04.434639] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T19:03:05.193715] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-29T19:03:05.728434] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T19:03:05.983974] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T19:03:05.993520] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-29T19:03:06.779785] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T19:03:06.793519] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-29T19:03:07.593546] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-29T19:03:07.617338] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T19:03:08.393577] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-29T19:03:08.691357] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T19:03:09.193628] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-29T19:03:09.687816] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T19:03:09.993578] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-29T19:03:10.435493] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:03:10.713817] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T19:03:10.793560] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-29T19:03:11.593586] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-29T19:03:12.090197] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T19:03:12.393597] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-29T19:03:12.946489] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T19:03:13.193607] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-29T19:03:13.764377] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T19:03:13.993553] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-29T19:03:14.428834] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T19:03:14.793602] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-29T19:03:14.856623] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-29T19:03:15.530146] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T19:03:15.593602] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-29T19:03:16.293170] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T19:03:16.393576] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-29T19:03:17.193565] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-29T19:03:17.757068] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T19:03:17.993571] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-29T19:03:18.233292] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T19:03:18.239293] [INFO ] [REMOTE ] GPOR: Full fetch complete (34924 records). [2025-10-29T19:03:18.239387] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-29T19:03:18.624429] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-29T19:03:18.624522] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-29T19:03:18.625221] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-29T19:03:18.625284] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-29T19:03:18.626169] [DEBUG] [LOCAL ] GPOR: Trimmed 34924 records to 23396 (keeping 200 days of data) [2025-10-29T19:03:18.762420] [DEBUG] [LOCAL ] GPOR: Primary data saved (23396 records). [2025-10-29T19:03:18.762554] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-29T19:03:18.762634] [INFO ] [MAIN ] Update Progress: 961/2367 symbols completed. GPOR took 28.5s. Estimated remaining: 3h 0m 21s. Rate: 7.8 symbols/min [2025-10-29T19:03:18.794363] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-29T19:03:18.935789] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:03:18.972849] [DEBUG] [LOCAL ] GPRK: Loaded 39986 existing records from primary storage. [2025-10-29T19:03:18.973145] [INFO ] [MAIN ] GPRK: Loaded 39986 existing records. [2025-10-29T19:03:19.149494] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:03:19.149769] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-29T19:03:19.149840] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-29T19:03:19.150138] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-29T19:03:19.150213] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-29T19:03:19.510683] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:03:19.540906] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-29T19:03:19.551545] [INFO ] [REMOTE ] GPN: Full fetch complete (74965 records). [2025-10-29T19:03:19.551713] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-29T19:03:19.598692] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-29T19:03:19.959071] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T19:03:19.986720] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-29T19:03:19.986924] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-29T19:03:19.987901] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-29T19:03:19.988002] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-29T19:03:19.988115] [INFO ] [REMOTE ] GPMT: Full fetch complete (35909 records). [2025-10-29T19:03:19.988312] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-29T19:03:20.091969] [DEBUG] [LOCAL ] GPN: Trimmed 74965 records to 51694 (keeping 200 days of data) [2025-10-29T19:03:20.396349] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-29T19:03:20.555554] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-29T19:03:20.591322] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-29T19:03:20.593185] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-29T19:03:20.596868] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-29T19:03:20.601916] [DEBUG] [LOCAL ] GPMT: Trimmed 35909 records to 25299 (keeping 200 days of data) [2025-10-29T19:03:20.836004] [DEBUG] [LOCAL ] GPMT: Primary data saved (25299 records). [2025-10-29T19:03:20.843491] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-29T19:03:20.847894] [INFO ] [MAIN ] Update Progress: 962/2367 symbols completed. GPMT took 30.7s. Estimated remaining: 3h 0m 5s. Rate: 7.8 symbols/min [2025-10-29T19:03:20.852298] [DEBUG] [LOCAL ] GPN: Primary data saved (51694 records). [2025-10-29T19:03:20.852427] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-29T19:03:20.911474] [INFO ] [MAIN ] Update Progress: 963/2367 symbols completed. GPN took 30.7s. Estimated remaining: 2h 59m 47s. Rate: 7.8 symbols/min [2025-10-29T19:03:21.000566] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-29T19:03:21.201912] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:03:21.201973] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-29T19:03:21.249146] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:03:21.267518] [DEBUG] [LOCAL ] GRC: Loaded 9304 existing records from primary storage. [2025-10-29T19:03:21.267787] [INFO ] [MAIN ] GRC: Loaded 9304 existing records. [2025-10-29T19:03:21.355255] [DEBUG] [LOCAL ] GRBK: Loaded 26209 existing records from primary storage. [2025-10-29T19:03:21.381623] [INFO ] [MAIN ] GRBK: Loaded 26209 existing records. [2025-10-29T19:03:21.595451] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:03:21.645542] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-29T19:03:21.648801] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-29T19:03:21.651813] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:03:21.652088] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-29T19:03:21.652145] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-29T19:03:21.652244] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-29T19:03:21.652300] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-29T19:03:21.702718] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-29T19:03:21.720946] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-29T19:03:22.370682] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-29T19:03:22.389626] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:03:22.405558] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-29T19:03:22.471476] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:03:22.493808] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T19:03:22.793535] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-29T19:03:23.020565] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-29T19:03:23.593550] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-29T19:03:24.124486] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-29T19:03:24.393554] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-29T19:03:24.511598] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T19:03:25.193602] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-29T19:03:25.853942] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T19:03:25.864922] [INFO ] [REMOTE ] GPK: Full fetch complete (76136 records). [2025-10-29T19:03:25.865110] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-29T19:03:26.006254] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-29T19:03:26.268035] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-29T19:03:26.268126] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-29T19:03:26.269075] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-29T19:03:26.269137] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-29T19:03:26.270577] [DEBUG] [LOCAL ] GPK: Trimmed 76136 records to 52759 (keeping 200 days of data) [2025-10-29T19:03:26.601753] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-29T19:03:26.626730] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T19:03:26.640564] [DEBUG] [LOCAL ] GPK: Primary data saved (52759 records). [2025-10-29T19:03:26.640691] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-29T19:03:26.640801] [INFO ] [MAIN ] Update Progress: 964/2367 symbols completed. GPK took 36.5s. Estimated remaining: 2h 59m 36s. Rate: 7.8 symbols/min [2025-10-29T19:03:26.806117] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:03:26.802819] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-29T19:03:26.826830] [DEBUG] [LOCAL ] GRDN: Loaded 21652 existing records from primary storage. [2025-10-29T19:03:26.827066] [INFO ] [MAIN ] GRDN: Loaded 21652 existing records. [2025-10-29T19:03:27.007041] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:03:27.007260] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-29T19:03:27.007309] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-29T19:03:27.007476] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-29T19:03:27.007516] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-29T19:03:27.361822] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:03:27.593603] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-29T19:03:27.899730] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T19:03:28.357802] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T19:03:28.393524] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-29T19:03:29.193547] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-29T19:03:29.264922] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T19:03:29.708902] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-29T19:03:29.993577] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-29T19:03:30.553302] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-29T19:03:30.793602] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-29T19:03:31.593541] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-29T19:03:31.827045] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T19:03:32.350473] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T19:03:32.393546] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-29T19:03:33.193522] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-29T19:03:33.288193] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T19:03:33.739206] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T19:03:33.993636] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-29T19:03:34.523072] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-29T19:03:34.793562] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-29T19:03:35.593604] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-29T19:03:35.845261] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T19:03:36.393568] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-29T19:03:36.581706] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-29T19:03:37.193679] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-29T19:03:37.440904] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T19:03:37.736025] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-29T19:03:37.993623] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-29T19:03:38.793629] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-29T19:03:39.057972] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-29T19:03:39.182022] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-29T19:03:39.593627] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-29T19:03:40.052017] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T19:03:40.393607] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-29T19:03:40.907067] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-29T19:03:41.193606] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-29T19:03:41.993636] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-29T19:03:42.480284] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T19:03:42.490359] [INFO ] [REMOTE ] GPRK: Full fetch complete (58603 records). [2025-10-29T19:03:42.490520] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-29T19:03:42.695500] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T19:03:42.798635] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-29T19:03:42.910494] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-29T19:03:42.910569] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-29T19:03:42.911412] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-29T19:03:42.911476] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-29T19:03:42.912603] [DEBUG] [LOCAL ] GPRK: Trimmed 58603 records to 40004 (keeping 200 days of data) [2025-10-29T19:03:43.137006] [DEBUG] [LOCAL ] GPRK: Primary data saved (40004 records). [2025-10-29T19:03:43.137122] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-29T19:03:43.137213] [INFO ] [MAIN ] Update Progress: 965/2367 symbols completed. GPRK took 24.4s. Estimated remaining: 2h 59m 41s. Rate: 7.8 symbols/min [2025-10-29T19:03:43.320546] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:03:43.327181] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T19:03:43.366220] [DEBUG] [LOCAL ] GRMN: Loaded 39341 existing records from primary storage. [2025-10-29T19:03:43.366493] [INFO ] [MAIN ] GRMN: Loaded 39341 existing records. [2025-10-29T19:03:43.542153] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:03:43.542430] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-29T19:03:43.542490] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-29T19:03:43.543040] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-29T19:03:43.543100] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-29T19:03:43.599494] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-29T19:03:43.912997] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:03:44.372138] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-29T19:03:44.393540] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-29T19:03:44.894443] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-29T19:03:45.193571] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-29T19:03:45.837177] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T19:03:45.840290] [INFO ] [REMOTE ] GRC: Full fetch complete (13642 records). [2025-10-29T19:03:45.840358] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-29T19:03:45.995207] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-29T19:03:46.205257] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-29T19:03:46.205340] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-29T19:03:46.205726] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-29T19:03:46.205788] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-29T19:03:46.206528] [DEBUG] [LOCAL ] GRC: Trimmed 13642 records to 9341 (keeping 200 days of data) [2025-10-29T19:03:46.262617] [DEBUG] [LOCAL ] GRC: Primary data saved (9341 records). [2025-10-29T19:03:46.262775] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-29T19:03:46.262866] [INFO ] [MAIN ] Update Progress: 966/2367 symbols completed. GRC took 25.3s. Estimated remaining: 2h 59m 27s. Rate: 7.8 symbols/min [2025-10-29T19:03:46.430330] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:03:46.476307] [DEBUG] [LOCAL ] GRND: Loaded 50168 existing records from primary storage. [2025-10-29T19:03:46.476594] [INFO ] [MAIN ] GRND: Loaded 50168 existing records. [2025-10-29T19:03:46.653539] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:03:46.653737] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-29T19:03:46.653787] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-29T19:03:46.654236] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-29T19:03:46.654291] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-29T19:03:46.798821] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-29T19:03:47.039840] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:03:47.054570] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T19:03:47.593538] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-29T19:03:47.621325] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T19:03:48.393558] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-29T19:03:48.486280] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-29T19:03:49.193619] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-29T19:03:49.567999] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T19:03:49.890848] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T19:03:49.993531] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-29T19:03:50.646406] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T19:03:50.793555] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-29T19:03:51.593613] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-29T19:03:51.932330] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T19:03:52.347406] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T19:03:52.393558] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-29T19:03:53.193577] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-29T19:03:53.341550] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T19:03:53.347373] [INFO ] [REMOTE ] GRBK: Full fetch complete (39816 records). [2025-10-29T19:03:53.347482] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-29T19:03:53.742035] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-29T19:03:53.742114] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-29T19:03:53.742852] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-29T19:03:53.742916] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-29T19:03:53.743826] [DEBUG] [LOCAL ] GRBK: Trimmed 39816 records to 26181 (keeping 200 days of data) [2025-10-29T19:03:53.893032] [DEBUG] [LOCAL ] GRBK: Primary data saved (26181 records). [2025-10-29T19:03:53.893157] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-29T19:03:53.893233] [INFO ] [MAIN ] Update Progress: 967/2367 symbols completed. GRBK took 33.0s. Estimated remaining: 2h 59m 19s. Rate: 7.8 symbols/min [2025-10-29T19:03:53.998756] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-29T19:03:54.062437] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:03:54.095092] [DEBUG] [LOCAL ] GRNT: Loaded 33544 existing records from primary storage. [2025-10-29T19:03:54.095365] [INFO ] [MAIN ] GRNT: Loaded 33544 existing records. [2025-10-29T19:03:54.279614] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:03:54.279995] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-29T19:03:54.280137] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-29T19:03:54.280563] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-29T19:03:54.280631] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-29T19:03:54.470826] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T19:03:54.704284] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:03:54.734241] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T19:03:54.793533] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-29T19:03:55.593529] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-29T19:03:55.682624] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T19:03:56.393616] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-29T19:03:56.815409] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T19:03:57.193610] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-29T19:03:57.262437] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T19:03:57.993540] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-29T19:03:58.401795] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T19:03:58.793542] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-29T19:03:58.894841] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-29T19:03:58.900434] [INFO ] [REMOTE ] GRDN: Full fetch complete (27126 records). [2025-10-29T19:03:58.900532] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-29T19:03:59.265217] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-29T19:03:59.265298] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-29T19:03:59.265878] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-29T19:03:59.265940] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-29T19:03:59.266718] [DEBUG] [LOCAL ] GRDN: Trimmed 27126 records to 21743 (keeping 200 days of data) [2025-10-29T19:03:59.388200] [DEBUG] [LOCAL ] GRDN: Primary data saved (21743 records). [2025-10-29T19:03:59.388319] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-29T19:03:59.388393] [INFO ] [MAIN ] Update Progress: 968/2367 symbols completed. GRDN took 32.7s. Estimated remaining: 2h 59m 8s. Rate: 7.8 symbols/min [2025-10-29T19:03:59.560585] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:03:59.570723] [DEBUG] [LOCAL ] GROV: Loaded 8721 existing records from primary storage. [2025-10-29T19:03:59.570939] [INFO ] [MAIN ] GROV: Loaded 8721 existing records. [2025-10-29T19:03:59.601267] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-29T19:03:59.752420] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:03:59.752917] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-29T19:03:59.752982] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-29T19:03:59.753175] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-29T19:03:59.753224] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-29T19:04:00.129316] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:04:00.152810] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-29T19:04:00.393552] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-29T19:04:00.976525] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T19:04:01.122163] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-29T19:04:01.193534] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-29T19:04:01.993577] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-29T19:04:02.425025] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T19:04:02.694200] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-29T19:04:02.793566] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-29T19:04:03.593561] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-29T19:04:04.084571] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T19:04:04.134329] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T19:04:04.393558] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-29T19:04:05.193555] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-29T19:04:05.709981] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T19:04:05.993562] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-29T19:04:06.061202] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-29T19:04:06.793576] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-29T19:04:07.338065] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T19:04:07.593569] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-29T19:04:08.049681] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T19:04:08.393596] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-29T19:04:08.673611] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-29T19:04:08.892428] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-29T19:04:09.193586] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-29T19:04:09.653580] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-29T19:04:09.993601] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-29T19:04:10.487741] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-29T19:04:10.793564] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-29T19:04:11.593533] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-29T19:04:11.801294] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T19:04:12.393581] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-29T19:04:12.786609] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T19:04:12.791350] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T19:04:13.193554] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-29T19:04:13.993577] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-29T19:04:14.329822] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T19:04:14.793561] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-29T19:04:15.517378] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T19:04:15.528397] [INFO ] [REMOTE ] GRND: Full fetch complete (72121 records). [2025-10-29T19:04:15.528605] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-29T19:04:15.599820] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-29T19:04:15.936436] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T19:04:16.025524] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-29T19:04:16.025667] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-29T19:04:16.026728] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-29T19:04:16.026794] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-29T19:04:16.028230] [DEBUG] [LOCAL ] GRND: Trimmed 72121 records to 50171 (keeping 200 days of data) [2025-10-29T19:04:16.317688] [DEBUG] [LOCAL ] GRND: Primary data saved (50171 records). [2025-10-29T19:04:16.317827] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-29T19:04:16.317908] [INFO ] [MAIN ] Update Progress: 969/2367 symbols completed. GRND took 30.1s. Estimated remaining: 2h 59m 14s. Rate: 7.8 symbols/min [2025-10-29T19:04:16.400568] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-29T19:04:16.512302] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:04:16.520265] [DEBUG] [LOCAL ] GRX: Loaded 4799 existing records from primary storage. [2025-10-29T19:04:16.520475] [INFO ] [MAIN ] GRX: Loaded 4799 existing records. [2025-10-29T19:04:16.724712] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:04:16.725094] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-29T19:04:16.725153] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-29T19:04:16.725305] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-29T19:04:16.725390] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-29T19:04:17.088224] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T19:04:17.166979] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:04:17.193539] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-29T19:04:17.307216] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T19:04:17.993605] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-29T19:04:18.274390] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T19:04:18.793615] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-29T19:04:19.009832] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T19:04:19.211696] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-29T19:04:19.593560] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-29T19:04:19.994427] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-29T19:04:20.393600] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-29T19:04:21.193557] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-29T19:04:21.580861] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T19:04:21.589501] [INFO ] [REMOTE ] GRMN: Full fetch complete (59386 records). [2025-10-29T19:04:21.589754] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-29T19:04:21.994409] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-29T19:04:22.014932] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-29T19:04:22.015183] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-29T19:04:22.016496] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-29T19:04:22.016746] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-29T19:04:22.018205] [DEBUG] [LOCAL ] GRMN: Trimmed 59386 records to 39407 (keeping 200 days of data) [2025-10-29T19:04:22.227862] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T19:04:22.298543] [DEBUG] [LOCAL ] GRMN: Primary data saved (39407 records). [2025-10-29T19:04:22.299254] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-29T19:04:22.299947] [INFO ] [MAIN ] Update Progress: 970/2367 symbols completed. GRMN took 39.2s. Estimated remaining: 2h 59m 4s. Rate: 7.8 symbols/min [2025-10-29T19:04:22.423935] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-29T19:04:22.481924] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:04:22.532346] [DEBUG] [LOCAL ] GS: Loaded 51731 existing records from primary storage. [2025-10-29T19:04:22.532708] [INFO ] [MAIN ] GS: Loaded 51731 existing records. [2025-10-29T19:04:22.718274] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:04:22.718539] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-29T19:04:22.718601] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-29T19:04:22.718867] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-29T19:04:22.718926] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-29T19:04:22.798801] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-29T19:04:23.126237] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:04:23.227351] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-29T19:04:23.593594] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-29T19:04:24.393560] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-29T19:04:24.746294] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-29T19:04:25.193573] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-29T19:04:25.356976] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-29T19:04:25.856725] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-29T19:04:25.993550] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-29T19:04:26.389818] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-29T19:04:26.793561] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-29T19:04:27.593584] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-29T19:04:27.835928] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T19:04:27.932779] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-29T19:04:28.393610] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-29T19:04:28.814844] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-29T19:04:29.193562] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-29T19:04:29.993572] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-29T19:04:30.641308] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T19:04:30.793537] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-29T19:04:30.900538] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T19:04:31.189841] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T19:04:31.593558] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-29T19:04:32.172915] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-29T19:04:32.175179] [INFO ] [REMOTE ] GROV: Full fetch complete (13427 records). [2025-10-29T19:04:32.175251] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-29T19:04:32.403131] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-29T19:04:32.556806] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-29T19:04:32.556882] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-29T19:04:32.557173] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-29T19:04:32.557213] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-29T19:04:32.557714] [DEBUG] [LOCAL ] GROV: Trimmed 13427 records to 8732 (keeping 200 days of data) [2025-10-29T19:04:32.605249] [DEBUG] [LOCAL ] GROV: Primary data saved (8732 records). [2025-10-29T19:04:32.605441] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-29T19:04:32.605556] [INFO ] [MAIN ] Update Progress: 971/2367 symbols completed. GROV took 33.2s. Estimated remaining: 2h 58m 60s. Rate: 7.8 symbols/min [2025-10-29T19:04:32.783359] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:04:32.820553] [DEBUG] [LOCAL ] GSBD: Loaded 39288 existing records from primary storage. [2025-10-29T19:04:32.820861] [INFO ] [MAIN ] GSBD: Loaded 39288 existing records. [2025-10-29T19:04:32.993270] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:04:32.993483] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-29T19:04:32.993528] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-29T19:04:32.993839] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-29T19:04:32.993896] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-29T19:04:33.199601] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-29T19:04:33.345165] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:04:33.993609] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-29T19:04:34.161639] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-29T19:04:34.307834] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T19:04:34.314796] [INFO ] [REMOTE ] GRNT: Full fetch complete (48163 records). [2025-10-29T19:04:34.314887] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-29T19:04:34.716205] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-29T19:04:34.716296] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-29T19:04:34.717026] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-29T19:04:34.717086] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-29T19:04:34.718057] [DEBUG] [LOCAL ] GRNT: Trimmed 48163 records to 33472 (keeping 200 days of data) [2025-10-29T19:04:34.799729] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-29T19:04:34.907959] [DEBUG] [LOCAL ] GRNT: Primary data saved (33472 records). [2025-10-29T19:04:34.908078] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-29T19:04:34.908152] [INFO ] [MAIN ] Update Progress: 972/2367 symbols completed. GRNT took 41.0s. Estimated remaining: 2h 58m 44s. Rate: 7.8 symbols/min [2025-10-29T19:04:35.079951] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:04:35.114560] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-29T19:04:35.159435] [DEBUG] [LOCAL ] GSK: Loaded 53510 existing records from primary storage. [2025-10-29T19:04:35.159742] [INFO ] [MAIN ] GSK: Loaded 53510 existing records. [2025-10-29T19:04:35.348147] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:04:35.348341] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-29T19:04:35.348412] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-29T19:04:35.348979] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-29T19:04:35.349051] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-29T19:04:35.598701] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-29T19:04:35.704912] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:04:36.393553] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-29T19:04:36.429895] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-29T19:04:36.735845] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T19:04:37.193570] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-29T19:04:37.998727] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-29T19:04:38.007535] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-29T19:04:38.402490] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T19:04:38.793565] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-29T19:04:39.457442] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T19:04:39.593551] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-29T19:04:40.219191] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T19:04:40.393545] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-29T19:04:41.001859] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T19:04:41.193553] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-29T19:04:41.302387] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T19:04:41.993560] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-29T19:04:42.398958] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T19:04:42.793575] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-29T19:04:42.901965] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-29T19:04:43.593599] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-29T19:04:44.393627] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-29T19:04:44.615381] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-29T19:04:45.040638] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-29T19:04:45.193620] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-29T19:04:45.516825] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T19:04:45.993687] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-29T19:04:46.793590] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-29T19:04:47.197484] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-29T19:04:47.437070] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T19:04:47.439238] [INFO ] [REMOTE ] GRX: Full fetch complete (6536 records). [2025-10-29T19:04:47.439309] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-29T19:04:47.596129] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-29T19:04:47.900325] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-29T19:04:47.900600] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-29T19:04:47.910124] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-29T19:04:47.911237] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-29T19:04:47.911342] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-29T19:04:47.912523] [DEBUG] [LOCAL ] GRX: Trimmed 6536 records to 4793 (keeping 200 days of data) [2025-10-29T19:04:47.942994] [DEBUG] [LOCAL ] GRX: Primary data saved (4793 records). [2025-10-29T19:04:47.943171] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-29T19:04:47.943275] [INFO ] [MAIN ] Update Progress: 973/2367 symbols completed. GRX took 31.6s. Estimated remaining: 2h 58m 44s. Rate: 7.8 symbols/min [2025-10-29T19:04:48.124011] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:04:48.158754] [DEBUG] [LOCAL ] GSL: Loaded 32477 existing records from primary storage. [2025-10-29T19:04:48.159166] [INFO ] [MAIN ] GSL: Loaded 32477 existing records. [2025-10-29T19:04:48.356308] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:04:48.356537] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-29T19:04:48.356586] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-29T19:04:48.356906] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-29T19:04:48.356964] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-29T19:04:48.398816] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-29T19:04:48.767172] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:04:49.042248] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T19:04:49.193612] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-29T19:04:49.999035] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-29T19:04:50.016398] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T19:04:50.215257] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-29T19:04:50.226149] [INFO ] [REMOTE ] GS: Full fetch complete (75820 records). [2025-10-29T19:04:50.226264] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-29T19:04:50.615018] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-29T19:04:50.615093] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-29T19:04:50.616039] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-29T19:04:50.616101] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-29T19:04:50.617448] [DEBUG] [LOCAL ] GS: Trimmed 75820 records to 51721 (keeping 200 days of data) [2025-10-29T19:04:50.795980] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-29T19:04:50.939843] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T19:04:50.968106] [DEBUG] [LOCAL ] GS: Primary data saved (51721 records). [2025-10-29T19:04:50.968199] [INFO ] [MAIN ] GS: Full history saved. [2025-10-29T19:04:50.968266] [INFO ] [MAIN ] Update Progress: 974/2367 symbols completed. GS took 28.7s. Estimated remaining: 2h 58m 30s. Rate: 7.8 symbols/min [2025-10-29T19:04:51.133589] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:04:51.177078] [DEBUG] [LOCAL ] GTES: Loaded 50234 existing records from primary storage. [2025-10-29T19:04:51.177386] [INFO ] [MAIN ] GTES: Loaded 50234 existing records. [2025-10-29T19:04:51.349158] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:04:51.349318] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-29T19:04:51.349364] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-29T19:04:51.349589] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-29T19:04:51.349673] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-29T19:04:51.598633] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-29T19:04:51.697940] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:04:52.206675] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T19:04:52.393578] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-29T19:04:52.878249] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T19:04:53.193569] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-29T19:04:53.665156] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:04:53.993564] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-29T19:04:54.793566] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-29T19:04:54.956527] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T19:04:55.593562] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-29T19:04:55.864318] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T19:04:56.393554] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-29T19:04:56.623144] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T19:04:57.193562] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-29T19:04:57.560138] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T19:04:57.993539] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-29T19:04:58.023156] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (4.83 seconds). [2025-10-29T19:04:58.033328] [INFO ] [REMOTE ] GSBD: Full fetch complete (58497 records). [2025-10-29T19:04:58.033451] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-29T19:04:58.419312] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T19:04:58.470598] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-29T19:04:58.471008] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-29T19:04:58.472064] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-29T19:04:58.472127] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-29T19:04:58.473225] [DEBUG] [LOCAL ] GSBD: Trimmed 58497 records to 39257 (keeping 200 days of data) [2025-10-29T19:04:58.709081] [DEBUG] [LOCAL ] GSBD: Primary data saved (39257 records). [2025-10-29T19:04:58.709241] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-29T19:04:58.709330] [INFO ] [MAIN ] Update Progress: 975/2367 symbols completed. GSBD took 26.1s. Estimated remaining: 2h 58m 22s. Rate: 7.8 symbols/min [2025-10-29T19:04:58.798822] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-29T19:04:58.889553] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:04:58.931127] [DEBUG] [LOCAL ] GTLS: Loaded 42859 existing records from primary storage. [2025-10-29T19:04:58.931415] [INFO ] [MAIN ] GTLS: Loaded 42859 existing records. [2025-10-29T19:04:59.118080] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:04:59.118347] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-29T19:04:59.118396] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-29T19:04:59.118732] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-29T19:04:59.118792] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-29T19:04:59.479035] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:04:59.518515] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-29T19:04:59.593546] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-29T19:04:59.900435] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T19:05:00.393559] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-29T19:05:01.197245] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-29T19:05:01.204065] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-29T19:05:01.924227] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-29T19:05:01.993579] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-29T19:05:02.593752] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T19:05:02.793571] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-29T19:05:03.128878] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T19:05:03.593699] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-29T19:05:04.107466] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T19:05:04.393712] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-29T19:05:04.708918] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T19:05:05.193626] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-29T19:05:05.460962] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T19:05:05.993607] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-29T19:05:06.514201] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T19:05:06.793585] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-29T19:05:07.136015] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-29T19:05:07.593611] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-29T19:05:07.972239] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T19:05:08.393556] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-29T19:05:09.068980] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-29T19:05:09.193603] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-29T19:05:09.761774] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T19:05:09.993607] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-29T19:05:10.460454] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T19:05:10.793599] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-29T19:05:10.985157] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T19:05:11.593549] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-29T19:05:12.038618] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:05:12.393626] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-29T19:05:12.644555] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T19:05:13.193551] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-29T19:05:13.666314] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T19:05:13.993633] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-29T19:05:14.793565] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-29T19:05:14.894544] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-29T19:05:14.907447] [INFO ] [REMOTE ] GSK: Full fetch complete (77637 records). [2025-10-29T19:05:14.907772] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-29T19:05:15.373419] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-29T19:05:15.373296] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T19:05:15.381705] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-29T19:05:15.382780] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-29T19:05:15.382862] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-29T19:05:15.384845] [DEBUG] [LOCAL ] GSK: Trimmed 77637 records to 53510 (keeping 200 days of data) [2025-10-29T19:05:15.597711] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-29T19:05:15.705774] [DEBUG] [LOCAL ] GSK: Primary data saved (53510 records). [2025-10-29T19:05:15.706029] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-29T19:05:15.706967] [INFO ] [MAIN ] Update Progress: 976/2367 symbols completed. GSK took 40.8s. Estimated remaining: 2h 58m 28s. Rate: 7.8 symbols/min [2025-10-29T19:05:15.871126] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:05:15.913585] [DEBUG] [LOCAL ] GTN: Loaded 44374 existing records from primary storage. [2025-10-29T19:05:15.913902] [INFO ] [MAIN ] GTN: Loaded 44374 existing records. [2025-10-29T19:05:16.130672] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T19:05:16.128697] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:05:16.141050] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-29T19:05:16.141548] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-29T19:05:16.142372] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-29T19:05:16.142441] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-29T19:05:16.403530] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-29T19:05:16.493835] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:05:16.955997] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-29T19:05:17.193579] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-29T19:05:17.454723] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T19:05:17.993630] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-29T19:05:18.303965] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T19:05:18.793580] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-29T19:05:19.381153] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-29T19:05:19.391926] [INFO ] [REMOTE ] GTES: Full fetch complete (73852 records). [2025-10-29T19:05:19.392053] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-29T19:05:19.598726] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-29T19:05:19.795133] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-29T19:05:19.795216] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-29T19:05:19.796162] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-29T19:05:19.796225] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-29T19:05:19.797682] [DEBUG] [LOCAL ] GTES: Trimmed 73852 records to 50233 (keeping 200 days of data) [2025-10-29T19:05:20.106345] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T19:05:20.119832] [DEBUG] [LOCAL ] GTES: Primary data saved (50233 records). [2025-10-29T19:05:20.119943] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-29T19:05:20.120060] [INFO ] [MAIN ] Update Progress: 977/2367 symbols completed. GTES took 29.2s. Estimated remaining: 2h 58m 16s. Rate: 7.8 symbols/min [2025-10-29T19:05:20.284703] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:05:20.313372] [DEBUG] [LOCAL ] GTY: Loaded 29639 existing records from primary storage. [2025-10-29T19:05:20.313676] [INFO ] [MAIN ] GTY: Loaded 29639 existing records. [2025-10-29T19:05:20.399008] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-29T19:05:20.494535] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:05:20.494807] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-29T19:05:20.494925] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-29T19:05:20.495239] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-29T19:05:20.495320] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-29T19:05:20.869227] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:05:20.886798] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T19:05:20.893568] [INFO ] [REMOTE ] GSL: Full fetch complete (48261 records). [2025-10-29T19:05:20.893675] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-29T19:05:21.198709] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-29T19:05:21.269634] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-29T19:05:21.269733] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-29T19:05:21.270431] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-29T19:05:21.270469] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-29T19:05:21.271394] [DEBUG] [LOCAL ] GSL: Trimmed 48261 records to 32488 (keeping 200 days of data) [2025-10-29T19:05:21.457885] [DEBUG] [LOCAL ] GSL: Primary data saved (32488 records). [2025-10-29T19:05:21.457998] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-29T19:05:21.458071] [INFO ] [MAIN ] Update Progress: 978/2367 symbols completed. GSL took 33.5s. Estimated remaining: 2h 57m 59s. Rate: 7.8 symbols/min [2025-10-29T19:05:21.630674] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:05:21.676590] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:05:21.692916] [DEBUG] [LOCAL ] GUG: Loaded 12023 existing records from primary storage. [2025-10-29T19:05:21.693509] [INFO ] [MAIN ] GUG: Loaded 12023 existing records. [2025-10-29T19:05:21.890668] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:05:21.890901] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-29T19:05:21.890948] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-29T19:05:21.891105] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-29T19:05:21.891142] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-29T19:05:21.996304] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-29T19:05:22.251747] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T19:05:22.270965] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:05:22.793685] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-29T19:05:23.365797] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-29T19:05:23.555164] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-29T19:05:23.593601] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-29T19:05:24.393555] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-29T19:05:24.942222] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T19:05:25.193542] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-29T19:05:25.227179] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T19:05:25.938007] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-29T19:05:25.993601] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-29T19:05:26.518290] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T19:05:26.793585] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-29T19:05:27.593596] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-29T19:05:27.970902] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T19:05:28.174768] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T19:05:28.393570] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-29T19:05:29.193601] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-29T19:05:29.548464] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T19:05:29.993532] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-29T19:05:30.026362] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-29T19:05:30.793588] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-29T19:05:31.138017] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T19:05:31.593566] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-29T19:05:32.043909] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T19:05:32.052776] [INFO ] [REMOTE ] GTLS: Full fetch complete (61416 records). [2025-10-29T19:05:32.052895] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-29T19:05:32.401404] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-29T19:05:32.457079] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-29T19:05:32.457168] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-29T19:05:32.458059] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-29T19:05:32.458124] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-29T19:05:32.459307] [DEBUG] [LOCAL ] GTLS: Trimmed 61416 records to 42780 (keeping 200 days of data) [2025-10-29T19:05:32.715098] [DEBUG] [LOCAL ] GTLS: Primary data saved (42780 records). [2025-10-29T19:05:32.715320] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-29T19:05:32.715436] [INFO ] [MAIN ] Update Progress: 979/2367 symbols completed. GTLS took 34.0s. Estimated remaining: 2h 57m 56s. Rate: 7.8 symbols/min [2025-10-29T19:05:32.931402] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:05:32.955716] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:05:32.988137] [DEBUG] [LOCAL ] GUT: Loaded 15398 existing records from primary storage. [2025-10-29T19:05:32.988476] [INFO ] [MAIN ] GUT: Loaded 15398 existing records. [2025-10-29T19:05:33.214280] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-29T19:05:33.261827] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:05:33.262836] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-29T19:05:33.280721] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-29T19:05:33.282559] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T19:05:33.285171] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-29T19:05:33.288849] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-29T19:05:33.790256] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:05:33.993630] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-29T19:05:34.116070] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-29T19:05:34.701074] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T19:05:34.793545] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-29T19:05:35.593616] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-29T19:05:36.085391] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-29T19:05:36.182631] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T19:05:36.393563] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-29T19:05:37.013257] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T19:05:37.193569] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-29T19:05:37.993577] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-29T19:05:38.024035] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-29T19:05:38.568715] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-29T19:05:38.793540] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-29T19:05:39.428086] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T19:05:39.593576] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-29T19:05:40.212515] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-29T19:05:40.393578] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-29T19:05:40.900057] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-29T19:05:41.193557] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-29T19:05:41.880349] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T19:05:41.993523] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-29T19:05:42.703357] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T19:05:42.793586] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-29T19:05:43.435493] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-29T19:05:43.593550] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-29T19:05:44.393575] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-29T19:05:44.869807] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:05:44.897841] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-29T19:05:45.193564] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-29T19:05:45.993595] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-29T19:05:46.067594] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T19:05:46.793583] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-29T19:05:46.987260] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T19:05:47.328760] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-29T19:05:47.331579] [INFO ] [REMOTE ] GUG: Full fetch complete (18711 records). [2025-10-29T19:05:47.331677] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-29T19:05:47.598898] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-29T19:05:47.688906] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-29T19:05:47.688982] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-29T19:05:47.689429] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-29T19:05:47.689467] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-29T19:05:47.690043] [DEBUG] [LOCAL ] GUG: Trimmed 18711 records to 11942 (keeping 200 days of data) [2025-10-29T19:05:47.761611] [DEBUG] [LOCAL ] GUG: Primary data saved (11942 records). [2025-10-29T19:05:47.761771] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-29T19:05:47.761852] [INFO ] [MAIN ] Update Progress: 980/2367 symbols completed. GUG took 26.3s. Estimated remaining: 2h 57m 59s. Rate: 7.8 symbols/min [2025-10-29T19:05:47.933591] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:05:47.965392] [DEBUG] [LOCAL ] GVA: Loaded 32061 existing records from primary storage. [2025-10-29T19:05:47.965730] [INFO ] [MAIN ] GVA: Loaded 32061 existing records. [2025-10-29T19:05:48.139235] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:05:48.139432] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-29T19:05:48.139483] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-29T19:05:48.139927] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-29T19:05:48.139986] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-29T19:05:48.399728] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-29T19:05:48.493164] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:05:48.607750] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-29T19:05:49.118585] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-29T19:05:49.193581] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-29T19:05:49.993558] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-29T19:05:50.317751] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-29T19:05:50.669034] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T19:05:50.793550] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-29T19:05:51.496886] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-29T19:05:51.500740] [INFO ] [REMOTE ] GUT: Full fetch complete (22451 records). [2025-10-29T19:05:51.500810] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-29T19:05:51.598717] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-29T19:05:51.877286] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-29T19:05:51.877362] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-29T19:05:51.877893] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-29T19:05:51.877956] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-29T19:05:51.878546] [DEBUG] [LOCAL ] GUT: Trimmed 22451 records to 15365 (keeping 200 days of data) [2025-10-29T19:05:51.968177] [DEBUG] [LOCAL ] GUT: Primary data saved (15365 records). [2025-10-29T19:05:51.968360] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-29T19:05:51.968467] [INFO ] [MAIN ] Update Progress: 981/2367 symbols completed. GUT took 19.3s. Estimated remaining: 2h 57m 46s. Rate: 7.8 symbols/min [2025-10-29T19:05:52.159336] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:05:52.180187] [DEBUG] [LOCAL ] GWH: Loaded 21187 existing records from primary storage. [2025-10-29T19:05:52.180415] [INFO ] [MAIN ] GWH: Loaded 21187 existing records. [2025-10-29T19:05:52.373145] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:05:52.373346] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-29T19:05:52.373396] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-29T19:05:52.373639] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-29T19:05:52.373734] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-29T19:05:52.398732] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-29T19:05:52.765283] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:05:53.005188] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-29T19:05:53.015080] [INFO ] [REMOTE ] GTN: Full fetch complete (65417 records). [2025-10-29T19:05:53.015272] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-29T19:05:53.197793] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-29T19:05:53.431143] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-29T19:05:53.431357] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-29T19:05:53.433305] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-29T19:05:53.433431] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-29T19:05:53.452261] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T19:05:53.460250] [DEBUG] [LOCAL ] GTN: Trimmed 65417 records to 44308 (keeping 200 days of data) [2025-10-29T19:05:53.755810] [DEBUG] [LOCAL ] GTN: Primary data saved (44308 records). [2025-10-29T19:05:53.766088] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-29T19:05:53.767492] [INFO ] [MAIN ] Update Progress: 982/2367 symbols completed. GTN took 38.1s. Estimated remaining: 2h 57m 30s. Rate: 7.8 symbols/min [2025-10-29T19:05:53.767305] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T19:05:53.981068] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:05:54.000596] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-29T19:05:54.019136] [DEBUG] [LOCAL ] GWRE: Loaded 39159 existing records from primary storage. [2025-10-29T19:05:54.019462] [INFO ] [MAIN ] GWRE: Loaded 39159 existing records. [2025-10-29T19:05:54.224917] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:05:54.225160] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-29T19:05:54.225207] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-29T19:05:54.225941] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-29T19:05:54.226000] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-29T19:05:54.586197] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:05:54.594546] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-29T19:05:54.793555] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-29T19:05:55.593565] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-29T19:05:56.103666] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T19:05:56.198874] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-29T19:05:56.393594] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-29T19:05:56.743116] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-29T19:05:57.193550] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-29T19:05:57.993562] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-29T19:05:58.393367] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T19:05:58.793579] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-29T19:05:58.947418] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T19:05:59.575696] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-29T19:05:59.593514] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-29T19:06:00.393519] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-29T19:06:00.485629] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T19:06:01.193577] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-29T19:06:01.469749] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-29T19:06:01.476674] [INFO ] [REMOTE ] GTY: Full fetch complete (43817 records). [2025-10-29T19:06:01.476822] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-29T19:06:01.841168] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-29T19:06:01.841249] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-29T19:06:01.842020] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-29T19:06:01.842082] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-29T19:06:01.843050] [DEBUG] [LOCAL ] GTY: Trimmed 43817 records to 29630 (keeping 200 days of data) [2025-10-29T19:06:02.000700] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-29T19:06:02.041809] [DEBUG] [LOCAL ] GTY: Primary data saved (29630 records). [2025-10-29T19:06:02.042775] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-29T19:06:02.043134] [INFO ] [MAIN ] Update Progress: 983/2367 symbols completed. GTY took 41.9s. Estimated remaining: 2h 57m 23s. Rate: 7.8 symbols/min [2025-10-29T19:06:02.243606] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:06:02.265527] [DEBUG] [LOCAL ] GWW: Loaded 18883 existing records from primary storage. [2025-10-29T19:06:02.265854] [INFO ] [MAIN ] GWW: Loaded 18883 existing records. [2025-10-29T19:06:02.444781] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:06:02.445143] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-29T19:06:02.445223] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-29T19:06:02.445502] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-29T19:06:02.445550] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-29T19:06:02.800266] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-29T19:06:02.805122] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:06:02.841562] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-29T19:06:02.885435] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T19:06:03.593539] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-29T19:06:03.784390] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-29T19:06:04.393605] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-29T19:06:04.624137] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-29T19:06:05.029300] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T19:06:05.193555] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-29T19:06:05.993536] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-29T19:06:06.325946] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T19:06:06.793520] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-29T19:06:06.829725] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T19:06:07.530597] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-29T19:06:07.593524] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-29T19:06:08.393557] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-29T19:06:09.141759] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-29T19:06:09.193542] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-29T19:06:09.701477] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-29T19:06:09.710485] [INFO ] [REMOTE ] GWH: Full fetch complete (25889 records). [2025-10-29T19:06:09.710579] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-29T19:06:09.994551] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-29T19:06:10.077965] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-29T19:06:10.078163] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-29T19:06:10.078748] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-29T19:06:10.078827] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-29T19:06:10.094467] [DEBUG] [LOCAL ] GWH: Trimmed 25889 records to 21456 (keeping 200 days of data) [2025-10-29T19:06:10.096047] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-29T19:06:10.216766] [DEBUG] [LOCAL ] GWH: Primary data saved (21456 records). [2025-10-29T19:06:10.216888] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-29T19:06:10.216961] [INFO ] [MAIN ] Update Progress: 984/2367 symbols completed. GWH took 18.2s. Estimated remaining: 2h 57m 16s. Rate: 7.8 symbols/min [2025-10-29T19:06:10.380338] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:06:10.420064] [DEBUG] [LOCAL ] GXO: Loaded 46093 existing records from primary storage. [2025-10-29T19:06:10.420351] [INFO ] [MAIN ] GXO: Loaded 46093 existing records. [2025-10-29T19:06:10.591852] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:06:10.592060] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-29T19:06:10.592131] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-29T19:06:10.592596] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-29T19:06:10.592702] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-29T19:06:10.798684] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-29T19:06:10.943253] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:06:11.302686] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T19:06:11.593563] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-29T19:06:12.027419] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T19:06:12.175057] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-29T19:06:12.393570] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-29T19:06:13.193585] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-29T19:06:13.401009] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T19:06:13.888612] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T19:06:13.993543] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-29T19:06:14.793564] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-29T19:06:15.042584] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-29T19:06:15.593555] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-29T19:06:15.930681] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T19:06:16.384975] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T19:06:16.393505] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-29T19:06:17.129291] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-29T19:06:17.193530] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-29T19:06:17.993572] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-29T19:06:18.392505] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T19:06:18.793607] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-29T19:06:18.943824] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T19:06:19.485936] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T19:06:19.593577] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-29T19:06:20.393678] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-29T19:06:20.635234] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T19:06:21.193528] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-29T19:06:21.302021] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T19:06:21.306476] [INFO ] [REMOTE ] GWW: Full fetch complete (28969 records). [2025-10-29T19:06:21.306564] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-29T19:06:21.716336] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-29T19:06:21.716467] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-29T19:06:21.717486] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-29T19:06:21.717575] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-29T19:06:21.718919] [DEBUG] [LOCAL ] GWW: Trimmed 28969 records to 18804 (keeping 200 days of data) [2025-10-29T19:06:21.858815] [DEBUG] [LOCAL ] GWW: Primary data saved (18804 records). [2025-10-29T19:06:21.858955] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-29T19:06:21.859036] [INFO ] [MAIN ] Update Progress: 985/2367 symbols completed. GWW took 19.8s. Estimated remaining: 2h 57m 14s. Rate: 7.8 symbols/min [2025-10-29T19:06:21.998760] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-29T19:06:22.056809] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:06:22.060215] [DEBUG] [LOCAL ] GYLD: Loaded 1514 existing records from primary storage. [2025-10-29T19:06:22.060929] [INFO ] [MAIN ] GYLD: Loaded 1514 existing records. [2025-10-29T19:06:22.264201] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:06:22.264567] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-29T19:06:22.264802] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-29T19:06:22.265172] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-29T19:06:22.265375] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-29T19:06:22.565106] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T19:06:22.717190] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:06:22.793576] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-29T19:06:23.046600] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-29T19:06:23.463364] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-29T19:06:23.593538] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-29T19:06:24.393603] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-29T19:06:24.916070] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T19:06:25.193545] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-29T19:06:25.267167] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T19:06:25.547815] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-29T19:06:25.993632] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-29T19:06:26.793600] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-29T19:06:27.175411] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T19:06:27.593580] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-29T19:06:28.092694] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-29T19:06:28.100234] [INFO ] [REMOTE ] GWRE: Full fetch complete (59817 records). [2025-10-29T19:06:28.100339] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-29T19:06:28.403434] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-29T19:06:28.505532] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-29T19:06:28.505732] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-29T19:06:28.506525] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-29T19:06:28.506568] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-29T19:06:28.507713] [DEBUG] [LOCAL ] GWRE: Trimmed 59817 records to 39216 (keeping 200 days of data) [2025-10-29T19:06:28.701542] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T19:06:28.765747] [DEBUG] [LOCAL ] GWRE: Primary data saved (39216 records). [2025-10-29T19:06:28.765888] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-29T19:06:28.766671] [INFO ] [MAIN ] Update Progress: 986/2367 symbols completed. GWRE took 35.0s. Estimated remaining: 2h 57m 5s. Rate: 7.8 symbols/min [2025-10-29T19:06:28.931152] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:06:28.972929] [DEBUG] [LOCAL ] H: Loaded 44158 existing records from primary storage. [2025-10-29T19:06:28.973223] [INFO ] [MAIN ] H: Loaded 44158 existing records. [2025-10-29T19:06:29.152294] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:06:29.152505] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-29T19:06:29.152574] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-29T19:06:29.153499] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-29T19:06:29.153556] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-29T19:06:29.198791] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-29T19:06:29.506753] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:06:29.643098] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:06:29.993596] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-29T19:06:30.386238] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-29T19:06:30.391119] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T19:06:30.793596] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-29T19:06:31.593618] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-29T19:06:31.784553] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-29T19:06:32.393580] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-29T19:06:32.740683] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T19:06:33.193591] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-29T19:06:33.371391] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-29T19:06:33.546058] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-29T19:06:33.993592] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-29T19:06:34.793578] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-29T19:06:35.126542] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T19:06:35.130880] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-29T19:06:35.137565] [INFO ] [REMOTE ] GVA: Full fetch complete (48451 records). [2025-10-29T19:06:35.137673] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-29T19:06:35.508201] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-29T19:06:35.508299] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-29T19:06:35.509025] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-29T19:06:35.509085] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-29T19:06:35.510121] [DEBUG] [LOCAL ] GVA: Trimmed 48451 records to 31976 (keeping 200 days of data) [2025-10-29T19:06:35.598201] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-29T19:06:35.710962] [DEBUG] [LOCAL ] GVA: Primary data saved (31976 records). [2025-10-29T19:06:35.711288] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-29T19:06:35.711362] [INFO ] [MAIN ] Update Progress: 987/2367 symbols completed. GVA took 47.9s. Estimated remaining: 2h 56m 57s. Rate: 7.8 symbols/min [2025-10-29T19:06:35.883692] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:06:35.886447] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-29T19:06:35.921607] [DEBUG] [LOCAL ] HAE: Loaded 38836 existing records from primary storage. [2025-10-29T19:06:35.921932] [INFO ] [MAIN ] HAE: Loaded 38836 existing records. [2025-10-29T19:06:36.104578] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:06:36.104864] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-29T19:06:36.104920] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-29T19:06:36.105925] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-29T19:06:36.106123] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-29T19:06:36.396484] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-29T19:06:36.473455] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:06:37.193560] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-29T19:06:37.478519] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-29T19:06:37.677067] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T19:06:37.993548] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-29T19:06:38.285150] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-29T19:06:38.793557] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-29T19:06:39.593567] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-29T19:06:39.893151] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T19:06:40.043760] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T19:06:40.393553] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-29T19:06:41.193591] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-29T19:06:41.636558] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-29T19:06:41.637484] [INFO ] [REMOTE ] GYLD: Full fetch complete (2115 records). [2025-10-29T19:06:41.637551] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-29T19:06:41.781611] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-29T19:06:42.001312] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-29T19:06:42.044853] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-29T19:06:42.044936] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-29T19:06:42.045054] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-29T19:06:42.045115] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-29T19:06:42.045455] [DEBUG] [LOCAL ] GYLD: Trimmed 2115 records to 1514 (keeping 200 days of data) [2025-10-29T19:06:42.055750] [DEBUG] [LOCAL ] GYLD: Primary data saved (1514 records). [2025-10-29T19:06:42.055863] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-29T19:06:42.055941] [INFO ] [MAIN ] Update Progress: 988/2367 symbols completed. GYLD took 20.2s. Estimated remaining: 2h 56m 47s. Rate: 7.8 symbols/min [2025-10-29T19:06:42.226421] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:06:42.261893] [DEBUG] [LOCAL ] HAFN: Loaded 42374 existing records from primary storage. [2025-10-29T19:06:42.262255] [INFO ] [MAIN ] HAFN: Loaded 42374 existing records. [2025-10-29T19:06:42.454967] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:06:42.455193] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-29T19:06:42.455253] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-29T19:06:42.456016] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-29T19:06:42.456072] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-29T19:06:42.798434] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-29T19:06:42.823945] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:06:43.212559] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T19:06:43.593553] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-29T19:06:44.055800] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T19:06:44.393605] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-29T19:06:44.635290] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T19:06:45.193599] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-29T19:06:45.683505] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T19:06:45.993580] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-29T19:06:46.349630] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T19:06:46.793563] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-29T19:06:47.164163] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T19:06:47.593711] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-29T19:06:48.287237] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-29T19:06:48.393553] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-29T19:06:48.847173] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T19:06:49.193586] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-29T19:06:49.873066] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T19:06:49.993544] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-29T19:06:50.453736] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T19:06:50.793532] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-29T19:06:51.306364] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-29T19:06:51.593555] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-29T19:06:51.873728] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T19:06:52.393551] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-29T19:06:52.912663] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T19:06:52.922520] [INFO ] [REMOTE ] GXO: Full fetch complete (69052 records). [2025-10-29T19:06:52.922749] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-29T19:06:53.202945] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-29T19:06:53.344432] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-29T19:06:53.344533] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-29T19:06:53.345497] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-29T19:06:53.345560] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-29T19:06:53.346931] [DEBUG] [LOCAL ] GXO: Trimmed 69052 records to 45996 (keeping 200 days of data) [2025-10-29T19:06:53.607445] [DEBUG] [LOCAL ] GXO: Primary data saved (45996 records). [2025-10-29T19:06:53.607755] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-29T19:06:53.607868] [INFO ] [MAIN ] Update Progress: 989/2367 symbols completed. GXO took 43.4s. Estimated remaining: 2h 56m 45s. Rate: 7.8 symbols/min [2025-10-29T19:06:53.779638] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:06:53.809880] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T19:06:53.869090] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-29T19:06:53.869479] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-29T19:06:53.998723] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-29T19:06:54.080120] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:06:54.080341] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-29T19:06:54.080390] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-29T19:06:54.080847] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-29T19:06:54.080904] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-29T19:06:54.443157] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:06:54.518456] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T19:06:54.793570] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-29T19:06:55.013412] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T19:06:55.593582] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-29T19:06:56.207781] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-29T19:06:56.393569] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-29T19:06:56.481802] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T19:06:57.193562] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-29T19:06:57.772596] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-29T19:06:57.993561] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-29T19:06:58.364103] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T19:06:58.793601] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-29T19:06:59.478734] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-29T19:06:59.593575] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-29T19:06:59.846748] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T19:07:00.393557] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-29T19:07:01.193553] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-29T19:07:01.457394] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-29T19:07:01.498033] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T19:07:01.993561] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-29T19:07:02.426496] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T19:07:02.793565] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-29T19:07:03.264323] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T19:07:03.593603] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-29T19:07:04.345239] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T19:07:04.393517] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-29T19:07:04.900136] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T19:07:05.193593] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-29T19:07:05.998778] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-29T19:07:06.014964] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-29T19:07:06.700900] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T19:07:06.710269] [INFO ] [REMOTE ] H: Full fetch complete (63632 records). [2025-10-29T19:07:06.710423] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-29T19:07:06.803145] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-29T19:07:07.096669] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-29T19:07:07.096766] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-29T19:07:07.097600] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-29T19:07:07.097662] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-29T19:07:07.098854] [DEBUG] [LOCAL ] H: Trimmed 63632 records to 44201 (keeping 200 days of data) [2025-10-29T19:07:07.372756] [DEBUG] [LOCAL ] H: Primary data saved (44201 records). [2025-10-29T19:07:07.373065] [INFO ] [MAIN ] H: Full history saved. [2025-10-29T19:07:07.374019] [INFO ] [MAIN ] Update Progress: 990/2367 symbols completed. H took 38.6s. Estimated remaining: 2h 56m 46s. Rate: 7.8 symbols/min [2025-10-29T19:07:07.550523] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-29T19:07:07.592089] [INFO ] [REMOTE ] HAE: Full fetch complete (59323 records). [2025-10-29T19:07:07.591967] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:07:07.592308] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-29T19:07:07.599432] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-29T19:07:07.928742] [DEBUG] [LOCAL ] HASI: Loaded 47390 existing records from primary storage. [2025-10-29T19:07:07.932749] [INFO ] [MAIN ] HASI: Loaded 47390 existing records. [2025-10-29T19:07:08.191287] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-29T19:07:08.206144] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-29T19:07:08.212263] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-29T19:07:08.211116] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:07:08.212447] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-29T19:07:08.212604] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-29T19:07:08.212918] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-29T19:07:08.213867] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-29T19:07:08.213931] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-29T19:07:08.245234] [DEBUG] [LOCAL ] HAE: Trimmed 59323 records to 38768 (keeping 200 days of data) [2025-10-29T19:07:08.790797] [DEBUG] [LOCAL ] HAE: Primary data saved (38768 records). [2025-10-29T19:07:08.831565] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-29T19:07:08.863177] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:07:08.863920] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-29T19:07:08.863569] [INFO ] [MAIN ] Update Progress: 991/2367 symbols completed. HAE took 33.2s. Estimated remaining: 2h 56m 29s. Rate: 7.8 symbols/min [2025-10-29T19:07:09.083848] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:07:09.100864] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-29T19:07:09.113066] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-29T19:07:09.167701] [DEBUG] [LOCAL ] HAYW: Loaded 48731 existing records from primary storage. [2025-10-29T19:07:09.168083] [INFO ] [MAIN ] HAYW: Loaded 48731 existing records. [2025-10-29T19:07:09.198705] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-29T19:07:09.346176] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:07:09.346413] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-29T19:07:09.346461] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-29T19:07:09.347253] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-29T19:07:09.347309] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-29T19:07:09.698786] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:07:09.993568] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-29T19:07:10.276819] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-29T19:07:10.528991] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T19:07:10.793592] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-29T19:07:11.011848] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-29T19:07:11.593565] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-29T19:07:11.999723] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T19:07:12.393569] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-29T19:07:12.649850] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T19:07:13.193576] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-29T19:07:13.647514] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:07:13.993603] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-29T19:07:14.204160] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T19:07:14.793605] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-29T19:07:15.130961] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-29T19:07:15.140520] [INFO ] [REMOTE ] HAFN: Full fetch complete (64457 records). [2025-10-29T19:07:15.140775] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-29T19:07:15.548446] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-29T19:07:15.548603] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-29T19:07:15.549942] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-29T19:07:15.550018] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-29T19:07:15.551865] [DEBUG] [LOCAL ] HAFN: Trimmed 64457 records to 42360 (keeping 200 days of data) [2025-10-29T19:07:15.600836] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-29T19:07:15.821146] [DEBUG] [LOCAL ] HAFN: Primary data saved (42360 records). [2025-10-29T19:07:15.821529] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-29T19:07:15.821716] [INFO ] [MAIN ] Update Progress: 992/2367 symbols completed. HAFN took 33.8s. Estimated remaining: 2h 56m 21s. Rate: 7.8 symbols/min [2025-10-29T19:07:15.965537] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T19:07:16.043169] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:07:16.053776] [DEBUG] [LOCAL ] HBB: Loaded 5976 existing records from primary storage. [2025-10-29T19:07:16.054009] [INFO ] [MAIN ] HBB: Loaded 5976 existing records. [2025-10-29T19:07:16.230811] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:07:16.231081] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-29T19:07:16.231136] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-29T19:07:16.231276] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-29T19:07:16.231312] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-29T19:07:16.406008] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-29T19:07:16.596597] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:07:17.198688] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-29T19:07:17.221540] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-29T19:07:17.644423] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T19:07:17.726743] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T19:07:17.993586] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-29T19:07:18.384115] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-29T19:07:18.793566] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-29T19:07:19.593633] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-29T19:07:20.042033] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-29T19:07:20.364519] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-29T19:07:20.393552] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-29T19:07:21.025804] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T19:07:21.037193] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-29T19:07:21.037341] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-29T19:07:21.196451] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-29T19:07:21.432303] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-29T19:07:21.432380] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-29T19:07:21.433312] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-29T19:07:21.433372] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-29T19:07:21.434758] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-29T19:07:21.772681] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-29T19:07:21.772820] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-29T19:07:21.772911] [INFO ] [MAIN ] Update Progress: 993/2367 symbols completed. HAL took 28.2s. Estimated remaining: 2h 56m 10s. Rate: 7.8 symbols/min [2025-10-29T19:07:21.951074] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:07:21.996089] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-29T19:07:21.997933] [DEBUG] [LOCAL ] HBI: Loaded 52883 existing records from primary storage. [2025-10-29T19:07:21.998318] [INFO ] [MAIN ] HBI: Loaded 52883 existing records. [2025-10-29T19:07:22.170823] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:07:22.171030] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-29T19:07:22.171076] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-29T19:07:22.171844] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-29T19:07:22.171900] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-29T19:07:22.534080] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:07:22.564162] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T19:07:22.793582] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-29T19:07:23.288477] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T19:07:23.593555] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-29T19:07:23.985339] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T19:07:24.393578] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-29T19:07:24.947843] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T19:07:25.193561] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-29T19:07:25.587609] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T19:07:25.993611] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-29T19:07:26.287910] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T19:07:26.793570] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-29T19:07:27.321601] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T19:07:27.593617] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-29T19:07:27.826489] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T19:07:28.393633] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-29T19:07:28.866629] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T19:07:28.923613] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T19:07:29.193577] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-29T19:07:29.993558] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-29T19:07:30.438681] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-29T19:07:30.793717] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-29T19:07:31.086061] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T19:07:31.137243] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-29T19:07:31.593623] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-29T19:07:32.393564] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-29T19:07:32.918419] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T19:07:33.193583] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-29T19:07:33.653807] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T19:07:33.993568] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-29T19:07:34.649470] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T19:07:34.793597] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-29T19:07:35.250896] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T19:07:35.593580] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-29T19:07:36.256444] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-29T19:07:36.393600] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-29T19:07:36.767452] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T19:07:37.193606] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-29T19:07:37.686564] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T19:07:37.993612] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-29T19:07:38.395269] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T19:07:38.397032] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T19:07:38.793598] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-29T19:07:39.593596] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-29T19:07:40.230324] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-29T19:07:40.241360] [INFO ] [REMOTE ] HASI: Full fetch complete (68173 records). [2025-10-29T19:07:40.241550] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-29T19:07:40.398688] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-29T19:07:40.659462] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-29T19:07:40.659837] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-29T19:07:40.661019] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-29T19:07:40.661087] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-29T19:07:40.663058] [DEBUG] [LOCAL ] HASI: Trimmed 68173 records to 47312 (keeping 200 days of data) [2025-10-29T19:07:40.952248] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T19:07:41.025352] [DEBUG] [LOCAL ] HASI: Primary data saved (47312 records). [2025-10-29T19:07:41.025555] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-29T19:07:41.025716] [INFO ] [MAIN ] Update Progress: 994/2367 symbols completed. HASI took 33.7s. Estimated remaining: 2h 56m 19s. Rate: 7.8 symbols/min [2025-10-29T19:07:41.197054] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-29T19:07:41.196976] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:07:41.251159] [DEBUG] [LOCAL ] HBM: Loaded 52979 existing records from primary storage. [2025-10-29T19:07:41.251616] [INFO ] [MAIN ] HBM: Loaded 52979 existing records. [2025-10-29T19:07:41.445580] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:07:41.446031] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-29T19:07:41.446097] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-29T19:07:41.447336] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-29T19:07:41.447403] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-29T19:07:41.843456] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:07:41.877563] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T19:07:41.889021] [INFO ] [REMOTE ] HAYW: Full fetch complete (70952 records). [2025-10-29T19:07:41.889230] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-29T19:07:41.998729] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-29T19:07:42.302239] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-29T19:07:42.302391] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-29T19:07:42.304004] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-29T19:07:42.304106] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-29T19:07:42.309512] [DEBUG] [LOCAL ] HAYW: Trimmed 70952 records to 48740 (keeping 200 days of data) [2025-10-29T19:07:42.620927] [DEBUG] [LOCAL ] HAYW: Primary data saved (48740 records). [2025-10-29T19:07:42.621163] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-29T19:07:42.621433] [INFO ] [MAIN ] Update Progress: 995/2367 symbols completed. HAYW took 33.8s. Estimated remaining: 2h 56m 3s. Rate: 7.8 symbols/min [2025-10-29T19:07:42.793962] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-29T19:07:42.804498] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-29T19:07:42.867129] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:07:42.921241] [DEBUG] [LOCAL ] HCA: Loaded 46820 existing records from primary storage. [2025-10-29T19:07:42.921762] [INFO ] [MAIN ] HCA: Loaded 46820 existing records. [2025-10-29T19:07:43.108481] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:07:43.108809] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-29T19:07:43.108863] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-29T19:07:43.109281] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-29T19:07:43.109323] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-29T19:07:43.434742] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-29T19:07:43.514466] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:07:43.547967] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-29T19:07:43.593537] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-29T19:07:44.108362] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T19:07:44.393598] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-29T19:07:45.193606] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-29T19:07:45.527686] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T19:07:45.777363] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T19:07:45.993597] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-29T19:07:46.793595] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-29T19:07:47.593581] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-29T19:07:47.728791] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-29T19:07:47.740936] [INFO ] [REMOTE ] HBI: Full fetch complete (76948 records). [2025-10-29T19:07:47.741143] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-29T19:07:48.109077] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-29T19:07:48.194958] [INFO ] [REMOTE ] HBB: Full fetch complete (9126 records). [2025-10-29T19:07:48.197730] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-29T19:07:48.263069] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-29T19:07:48.293913] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-29T19:07:48.342881] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-29T19:07:48.383232] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-29T19:07:48.404623] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-29T19:07:48.507206] [DEBUG] [LOCAL ] HBI: Trimmed 76948 records to 52885 (keeping 200 days of data) [2025-10-29T19:07:48.707868] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-29T19:07:48.778463] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-29T19:07:48.781107] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-29T19:07:48.785910] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-29T19:07:48.786059] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-29T19:07:48.788567] [DEBUG] [LOCAL ] HBB: Trimmed 9126 records to 5936 (keeping 200 days of data) [2025-10-29T19:07:48.838564] [DEBUG] [LOCAL ] HBB: Primary data saved (5936 records). [2025-10-29T19:07:48.844122] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-29T19:07:48.845058] [INFO ] [MAIN ] Update Progress: 996/2367 symbols completed. HBB took 33.0s. Estimated remaining: 2h 55m 53s. Rate: 7.8 symbols/min [2025-10-29T19:07:49.160284] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:07:49.205686] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-29T19:07:49.272870] [DEBUG] [LOCAL ] HBI: Primary data saved (52885 records). [2025-10-29T19:07:49.273125] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-29T19:07:49.273288] [INFO ] [MAIN ] Update Progress: 997/2367 symbols completed. HBI took 27.5s. Estimated remaining: 2h 55m 35s. Rate: 7.8 symbols/min [2025-10-29T19:07:49.289290] [DEBUG] [LOCAL ] HCC: Loaded 44630 existing records from primary storage. [2025-10-29T19:07:49.289734] [INFO ] [MAIN ] HCC: Loaded 44630 existing records. [2025-10-29T19:07:49.487401] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:07:49.487736] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-29T19:07:49.487798] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-29T19:07:49.488068] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-29T19:07:49.488126] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-29T19:07:49.950513] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:07:49.957543] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-29T19:07:49.993528] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-29T19:07:50.793554] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-29T19:07:50.847452] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-29T19:07:51.321830] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T19:07:51.593633] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-29T19:07:51.880955] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T19:07:52.393587] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-29T19:07:53.025441] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T19:07:53.193583] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-29T19:07:53.830465] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T19:07:53.993608] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-29T19:07:54.179391] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T19:07:54.793594] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-29T19:07:55.259545] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T19:07:55.593589] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-29T19:07:55.994365] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T19:07:56.393586] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-29T19:07:56.644788] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T19:07:57.193616] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-29T19:07:57.680549] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T19:07:57.993748] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-29T19:07:58.421028] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T19:07:58.793785] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-29T19:07:59.042541] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T19:07:59.593742] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-29T19:07:59.888290] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T19:08:00.393622] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-29T19:08:01.117720] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-29T19:08:01.193628] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-29T19:08:01.824731] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-29T19:08:01.993568] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-29T19:08:02.311311] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T19:08:02.793627] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-29T19:08:03.186402] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T19:08:03.593628] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-29T19:08:04.143378] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T19:08:04.393733] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-29T19:08:04.746988] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T19:08:05.193607] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-29T19:08:05.959880] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-29T19:08:05.993547] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-29T19:08:06.683943] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T19:08:06.693785] [INFO ] [REMOTE ] HCA: Full fetch complete (68853 records). [2025-10-29T19:08:06.693911] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-29T19:08:06.794441] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-29T19:08:07.088162] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-29T19:08:07.088262] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-29T19:08:07.089283] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-29T19:08:07.089357] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-29T19:08:07.090624] [DEBUG] [LOCAL ] HCA: Trimmed 68853 records to 46781 (keeping 200 days of data) [2025-10-29T19:08:07.386948] [DEBUG] [LOCAL ] HCA: Primary data saved (46781 records). [2025-10-29T19:08:07.387106] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-29T19:08:07.387311] [INFO ] [MAIN ] Update Progress: 998/2367 symbols completed. HCA took 24.8s. Estimated remaining: 2h 55m 42s. Rate: 7.8 symbols/min [2025-10-29T19:08:07.436076] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T19:08:07.593797] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-29T19:08:07.846084] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T19:08:08.393746] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-29T19:08:09.231761] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T19:08:09.244486] [INFO ] [REMOTE ] HBM: Full fetch complete (76791 records). [2025-10-29T19:08:09.244733] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-29T19:08:09.717036] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-29T19:08:09.750571] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-29T19:08:09.751132] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-29T19:08:09.752582] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-29T19:08:09.752705] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-29T19:08:09.751029] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-29T19:08:09.755428] [DEBUG] [LOCAL ] HBM: Trimmed 76791 records to 52979 (keeping 200 days of data) [2025-10-29T19:08:10.111973] [DEBUG] [LOCAL ] HBM: Primary data saved (52979 records). [2025-10-29T19:08:10.112199] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-29T19:08:10.113342] [INFO ] [MAIN ] Update Progress: 999/2367 symbols completed. HBM took 29.1s. Estimated remaining: 2h 55m 27s. Rate: 7.8 symbols/min [2025-10-29T19:08:11.225022] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-29T19:08:11.233794] [INFO ] [REMOTE ] HCC: Full fetch complete (64661 records). [2025-10-29T19:08:11.233889] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-29T19:08:11.620983] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-29T19:08:11.621063] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-29T19:08:11.621921] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-29T19:08:11.621981] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-29T19:08:11.623159] [DEBUG] [LOCAL ] HCC: Trimmed 64661 records to 44577 (keeping 200 days of data) [2025-10-29T19:08:11.880027] [DEBUG] [LOCAL ] HCC: Primary data saved (44577 records). [2025-10-29T19:08:11.880146] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-29T19:08:11.880224] [INFO ] [MAIN ] Update Progress: 1000/2367 symbols completed. HCC took 23.0s. Estimated remaining: 2h 55m 11s. Rate: 7.8 symbols/min [2025-10-29T19:08:12.492517] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:08:12.454125] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:08:12.523876] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-29T19:08:12.603634] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:08:12.594225] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-29T19:08:12.606093] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-29T19:08:12.622254] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-29T19:08:12.625754] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:08:12.626119] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-29T19:08:12.626291] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-29T19:08:12.738236] [DEBUG] [LOCAL ] HCI: Loaded 13859 existing records from primary storage. [2025-10-29T19:08:12.742169] [INFO ] [MAIN ] HCI: Loaded 13859 existing records. [2025-10-29T19:08:13.226473] [DEBUG] [LOCAL ] HDB: Loaded 51896 existing records from primary storage. [2025-10-29T19:08:13.274053] [INFO ] [MAIN ] HDB: Loaded 51896 existing records. [2025-10-29T19:08:13.253783] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:08:13.390788] [DEBUG] [LOCAL ] HD: Loaded 53446 existing records from primary storage. [2025-10-29T19:08:13.356978] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-29T19:08:13.435009] [INFO ] [MAIN ] HD: Loaded 53446 existing records. [2025-10-29T19:08:13.429533] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:08:13.450769] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-29T19:08:13.460379] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-29T19:08:13.466718] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-29T19:08:13.466888] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-29T19:08:13.704533] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:08:13.746992] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-29T19:08:13.790051] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-29T19:08:13.820677] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-29T19:08:13.851593] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-29T19:08:13.846290] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-29T19:08:13.883043] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-29T19:08:13.875107] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:08:13.987286] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-29T19:08:14.006003] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-29T19:08:14.062253] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-29T19:08:14.062468] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-29T19:08:14.229695] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-29T19:08:14.296768] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-29T19:08:14.565359] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:08:14.644837] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-29T19:08:14.645944] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-29T19:08:14.648576] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-29T19:08:14.847401] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:08:14.848241] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-29T19:08:14.926621] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:08:14.926950] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-29T19:08:15.020109] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-29T19:08:15.334405] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-29T19:08:15.593577] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-29T19:08:16.155431] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T19:08:16.172252] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-29T19:08:16.393580] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-29T19:08:16.764186] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-29T19:08:17.122152] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T19:08:17.193682] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-29T19:08:17.897385] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T19:08:17.993567] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-29T19:08:18.196860] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-10-29T19:08:18.793595] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-29T19:08:19.411727] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T19:08:19.593555] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-29T19:08:19.793952] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-10-29T19:08:20.393588] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-29T19:08:21.112200] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-29T19:08:21.193686] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-29T19:08:21.419901] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-29T19:08:21.993828] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-29T19:08:22.793573] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-29T19:08:22.972173] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-10-29T19:08:23.248621] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T19:08:23.593605] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-29T19:08:24.393573] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-29T19:08:25.109715] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-29T19:08:25.193534] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-29T19:08:25.847271] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T19:08:25.993579] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-29T19:08:26.146487] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-29T19:08:26.601530] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-29T19:08:26.793817] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-29T19:08:26.967977] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.17 seconds). [2025-10-29T19:08:27.593708] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-29T19:08:27.865236] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-29T19:08:27.866265] [INFO ] [REMOTE ] HCXY: Full fetch complete (518 records). [2025-10-29T19:08:27.866358] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-29T19:08:28.057279] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-29T19:08:28.057502] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:08:28.057573] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:08:28.057667] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-29T19:08:28.057758] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-29T19:08:28.057816] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-29T19:08:28.057874] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-29T19:08:28.057952] [INFO ] [MAIN ] Update Progress: 1001/2367 symbols completed. HCXY took 16.2s. Estimated remaining: 2h 55m 15s. Rate: 7.8 symbols/min [2025-10-29T19:08:28.240311] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:08:28.286568] [DEBUG] [LOCAL ] HE: Loaded 48563 existing records from primary storage. [2025-10-29T19:08:28.286888] [INFO ] [MAIN ] HE: Loaded 48563 existing records. [2025-10-29T19:08:28.398668] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-29T19:08:28.466492] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:08:28.466706] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-29T19:08:28.466763] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-29T19:08:28.467032] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-29T19:08:28.467070] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-29T19:08:28.825796] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:08:29.113010] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-29T19:08:29.193609] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-29T19:08:29.993626] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-29T19:08:30.640533] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T19:08:30.752239] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T19:08:30.755901] [INFO ] [REMOTE ] HCI: Full fetch complete (19497 records). [2025-10-29T19:08:30.756006] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-29T19:08:30.798806] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-29T19:08:31.115700] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-29T19:08:31.115783] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-29T19:08:31.116185] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-29T19:08:31.116223] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-29T19:08:31.116783] [DEBUG] [LOCAL ] HCI: Trimmed 19497 records to 13869 (keeping 200 days of data) [2025-10-29T19:08:31.203708] [DEBUG] [LOCAL ] HCI: Primary data saved (13869 records). [2025-10-29T19:08:31.203883] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-29T19:08:31.204001] [INFO ] [MAIN ] Update Progress: 1002/2367 symbols completed. HCI took 19.3s. Estimated remaining: 2h 55m 1s. Rate: 7.8 symbols/min [2025-10-29T19:08:31.373225] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:08:31.402856] [DEBUG] [LOCAL ] HEI: Loaded 29971 existing records from primary storage. [2025-10-29T19:08:31.403105] [INFO ] [MAIN ] HEI: Loaded 29971 existing records. [2025-10-29T19:08:31.575973] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:08:31.576148] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-29T19:08:31.576195] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-29T19:08:31.576434] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-29T19:08:31.576475] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-29T19:08:31.598817] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-29T19:08:31.931964] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:08:32.070744] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:08:32.393601] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-29T19:08:33.172866] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-29T19:08:33.193531] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-29T19:08:33.689445] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T19:08:33.993574] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-29T19:08:34.405675] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T19:08:34.793602] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-29T19:08:35.433207] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-29T19:08:35.593576] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-29T19:08:36.393542] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-29T19:08:36.436487] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-29T19:08:36.666768] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T19:08:37.193730] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-29T19:08:37.699448] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T19:08:37.993523] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-29T19:08:38.201075] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:08:38.793575] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-29T19:08:39.399765] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-29T19:08:39.593531] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-29T19:08:40.105525] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T19:08:40.393587] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-29T19:08:41.048625] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-29T19:08:41.193537] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-29T19:08:41.770634] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T19:08:41.993569] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-29T19:08:42.382486] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T19:08:42.793550] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-29T19:08:43.236019] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:08:43.593597] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-29T19:08:44.304936] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-29T19:08:44.393545] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-29T19:08:44.553930] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-29T19:08:45.193587] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-29T19:08:45.948734] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-29T19:08:45.993527] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-29T19:08:46.393164] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T19:08:46.793568] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-29T19:08:47.515388] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-29T19:08:47.593516] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-29T19:08:48.159428] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T19:08:48.393552] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-29T19:08:49.193560] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-29T19:08:49.428547] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-29T19:08:49.926428] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T19:08:49.938432] [INFO ] [REMOTE ] HDB: Full fetch complete (75669 records). [2025-10-29T19:08:49.938688] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-29T19:08:50.005957] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-29T19:08:50.337739] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-29T19:08:50.337823] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-29T19:08:50.338826] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-29T19:08:50.338889] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-29T19:08:50.340308] [DEBUG] [LOCAL ] HDB: Trimmed 75669 records to 51889 (keeping 200 days of data) [2025-10-29T19:08:50.672294] [DEBUG] [LOCAL ] HDB: Primary data saved (51889 records). [2025-10-29T19:08:50.675094] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-29T19:08:50.675185] [INFO ] [MAIN ] Update Progress: 1003/2367 symbols completed. HDB took 38.8s. Estimated remaining: 2h 55m 10s. Rate: 7.8 symbols/min [2025-10-29T19:08:50.740200] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T19:08:50.798588] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-29T19:08:50.856228] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:08:50.864980] [DEBUG] [LOCAL ] HEQ: Loaded 6561 existing records from primary storage. [2025-10-29T19:08:50.865347] [INFO ] [MAIN ] HEQ: Loaded 6561 existing records. [2025-10-29T19:08:51.043872] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:08:51.044122] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-29T19:08:51.044177] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-29T19:08:51.044323] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-29T19:08:51.044377] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-29T19:08:51.390917] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:08:51.593577] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-29T19:08:51.873398] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-29T19:08:52.049852] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-29T19:08:52.073777] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T19:08:52.393533] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-29T19:08:52.893564] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T19:08:53.193549] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-29T19:08:53.993550] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-29T19:08:54.793694] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-29T19:08:55.124915] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T19:08:55.210599] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-29T19:08:55.212351] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-29T19:08:55.225790] [INFO ] [REMOTE ] HD: Full fetch complete (77526 records). [2025-10-29T19:08:55.225890] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-29T19:08:55.604821] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-29T19:08:55.629291] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-29T19:08:55.629360] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-29T19:08:55.630481] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-29T19:08:55.630676] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-29T19:08:55.632136] [DEBUG] [LOCAL ] HD: Trimmed 77526 records to 53442 (keeping 200 days of data) [2025-10-29T19:08:55.959798] [DEBUG] [LOCAL ] HD: Primary data saved (53442 records). [2025-10-29T19:08:55.959934] [INFO ] [MAIN ] HD: Full history saved. [2025-10-29T19:08:55.960012] [INFO ] [MAIN ] Update Progress: 1004/2367 symbols completed. HD took 44.1s. Estimated remaining: 2h 54m 59s. Rate: 7.8 symbols/min [2025-10-29T19:08:56.127480] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:08:56.168961] [DEBUG] [LOCAL ] HESM: Loaded 48536 existing records from primary storage. [2025-10-29T19:08:56.169239] [INFO ] [MAIN ] HESM: Loaded 48536 existing records. [2025-10-29T19:08:56.343128] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:08:56.343317] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-29T19:08:56.343362] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-29T19:08:56.343737] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-29T19:08:56.343794] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-29T19:08:56.405952] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-29T19:08:56.698714] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:08:56.793704] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T19:08:57.193542] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-29T19:08:57.406906] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-29T19:08:57.680033] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-29T19:08:57.993601] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-29T19:08:58.793629] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-29T19:08:59.199268] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T19:08:59.593606] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-29T19:09:00.251820] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-29T19:09:00.261768] [INFO ] [REMOTE ] HE: Full fetch complete (71828 records). [2025-10-29T19:09:00.261877] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-29T19:09:00.401278] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-29T19:09:00.661108] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-29T19:09:00.661190] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-29T19:09:00.662245] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-29T19:09:00.662488] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-29T19:09:00.664068] [DEBUG] [LOCAL ] HE: Trimmed 71828 records to 48542 (keeping 200 days of data) [2025-10-29T19:09:00.901679] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T19:09:00.906569] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T19:09:00.982485] [DEBUG] [LOCAL ] HE: Primary data saved (48542 records). [2025-10-29T19:09:00.982613] [INFO ] [MAIN ] HE: Full history saved. [2025-10-29T19:09:00.982720] [INFO ] [MAIN ] Update Progress: 1005/2367 symbols completed. HE took 32.9s. Estimated remaining: 2h 54m 47s. Rate: 7.8 symbols/min [2025-10-29T19:09:01.158759] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:09:01.158964] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-29T19:09:01.159075] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-29T19:09:01.159156] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-29T19:09:01.159192] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-29T19:09:01.159232] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-29T19:09:01.159263] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-29T19:09:01.199271] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-29T19:09:01.537740] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:09:01.780412] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-29T19:09:01.993749] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-29T19:09:02.465969] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-29T19:09:02.793704] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-29T19:09:03.180169] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T19:09:03.593559] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-29T19:09:04.393515] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-29T19:09:04.592787] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-10-29T19:09:04.593810] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-29T19:09:05.193567] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-29T19:09:05.993559] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-29T19:09:06.176145] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.18 seconds). [2025-10-29T19:09:06.308854] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T19:09:06.793579] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-29T19:09:07.058832] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-29T19:09:07.593688] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-29T19:09:07.778251] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.18 seconds). [2025-10-29T19:09:08.393620] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-29T19:09:09.193617] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-29T19:09:09.348895] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T19:09:09.356182] [INFO ] [REMOTE ] HEI: Full fetch complete (46522 records). [2025-10-29T19:09:09.356337] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-29T19:09:09.761984] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-29T19:09:09.767998] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-29T19:09:09.769580] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-29T19:09:09.769316] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-29T19:09:09.772215] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-29T19:09:09.773453] [DEBUG] [LOCAL ] HEI: Trimmed 46522 records to 29812 (keeping 200 days of data) [2025-10-29T19:09:09.954392] [DEBUG] [LOCAL ] HEI: Primary data saved (29812 records). [2025-10-29T19:09:09.954531] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-29T19:09:09.954611] [INFO ] [MAIN ] Update Progress: 1006/2367 symbols completed. HEI took 38.8s. Estimated remaining: 2h 54m 41s. Rate: 7.8 symbols/min [2025-10-29T19:09:09.998788] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-29T19:09:10.129245] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:09:10.129445] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-29T19:09:10.129492] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-29T19:09:10.129604] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-29T19:09:10.129673] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-29T19:09:10.129738] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-29T19:09:10.129772] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-29T19:09:10.479629] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:09:10.793550] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-29T19:09:10.993892] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-10-29T19:09:11.407297] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T19:09:11.593545] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-29T19:09:11.779003] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-10-29T19:09:12.393568] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-29T19:09:12.735556] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-29T19:09:13.193555] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-29T19:09:13.782387] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T19:09:13.784829] [INFO ] [REMOTE ] HEQ: Full fetch complete (9708 records). [2025-10-29T19:09:13.784900] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-29T19:09:13.998757] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-29T19:09:14.152477] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-29T19:09:14.152553] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-29T19:09:14.152831] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-29T19:09:14.152904] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-29T19:09:14.153324] [DEBUG] [LOCAL ] HEQ: Trimmed 9708 records to 6539 (keeping 200 days of data) [2025-10-29T19:09:14.190539] [DEBUG] [LOCAL ] HEQ: Primary data saved (6539 records). [2025-10-29T19:09:14.190617] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-29T19:09:14.190716] [INFO ] [MAIN ] Update Progress: 1007/2367 symbols completed. HEQ took 23.5s. Estimated remaining: 2h 54m 29s. Rate: 7.8 symbols/min [2025-10-29T19:09:14.360075] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:09:14.375833] [DEBUG] [LOCAL ] HFRO: Loaded 15711 existing records from primary storage. [2025-10-29T19:09:14.376058] [INFO ] [MAIN ] HFRO: Loaded 15711 existing records. [2025-10-29T19:09:14.553067] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:09:14.553294] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-29T19:09:14.553339] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-29T19:09:14.553579] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-29T19:09:14.553635] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-29T19:09:14.798770] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-29T19:09:14.900842] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:09:15.095773] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T19:09:15.319731] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-29T19:09:15.593572] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-29T19:09:16.391148] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-29T19:09:16.396501] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-29T19:09:17.193601] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-29T19:09:17.477632] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-29T19:09:17.615263] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T19:09:17.993551] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-29T19:09:18.793536] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-29T19:09:18.853333] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T19:09:19.066560] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-29T19:09:19.593537] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-29T19:09:20.393590] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-29T19:09:20.687358] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-29T19:09:20.747063] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T19:09:21.193606] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-29T19:09:21.993565] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-29T19:09:22.206408] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-29T19:09:22.472172] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-29T19:09:22.793570] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-29T19:09:22.977382] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.18 seconds). [2025-10-29T19:09:23.593564] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-29T19:09:23.765146] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.17 seconds). [2025-10-29T19:09:24.393552] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-29T19:09:24.599735] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.21 seconds). [2025-10-29T19:09:25.193582] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-29T19:09:25.993550] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-29T19:09:26.309293] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-29T19:09:26.475111] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:09:26.793580] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-29T19:09:27.593624] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-29T19:09:27.869463] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-29T19:09:28.038716] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:09:28.393567] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-29T19:09:28.697790] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T19:09:29.193605] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-29T19:09:29.481998] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-29T19:09:29.482691] [INFO ] [REMOTE ] HF: Full fetch complete (415 records). [2025-10-29T19:09:29.482765] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-29T19:09:29.660683] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-10-29T19:09:29.660849] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:09:29.660918] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:09:29.661009] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-29T19:09:29.661073] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-29T19:09:29.661110] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-29T19:09:29.661150] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-29T19:09:29.661207] [INFO ] [MAIN ] Update Progress: 1008/2367 symbols completed. HF took 28.7s. Estimated remaining: 2h 54m 32s. Rate: 7.8 symbols/min [2025-10-29T19:09:29.831743] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:09:29.848062] [DEBUG] [LOCAL ] HGER: Loaded 15888 existing records from primary storage. [2025-10-29T19:09:29.848295] [INFO ] [MAIN ] HGER: Loaded 15888 existing records. [2025-10-29T19:09:30.002743] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-29T19:09:30.026245] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:09:30.026494] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-29T19:09:30.026566] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-29T19:09:30.027392] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-29T19:09:30.027450] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-29T19:09:30.384848] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:09:30.793617] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-29T19:09:31.211892] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-29T19:09:31.212789] [INFO ] [REMOTE ] HFND: Full fetch complete (1786 records). [2025-10-29T19:09:31.212858] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-29T19:09:31.395457] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-29T19:09:31.395826] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:09:31.395905] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:09:31.395975] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-29T19:09:31.396038] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-29T19:09:31.396073] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-29T19:09:31.396110] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-29T19:09:31.396162] [INFO ] [MAIN ] Update Progress: 1009/2367 symbols completed. HFND took 21.4s. Estimated remaining: 2h 54m 16s. Rate: 7.8 symbols/min [2025-10-29T19:09:31.562477] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:09:31.573192] [DEBUG] [LOCAL ] HGLB: Loaded 9253 existing records from primary storage. [2025-10-29T19:09:31.573388] [INFO ] [MAIN ] HGLB: Loaded 9253 existing records. [2025-10-29T19:09:31.601629] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-29T19:09:31.754865] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:09:31.755296] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-29T19:09:31.755356] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-29T19:09:31.755556] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-29T19:09:31.755705] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-29T19:09:31.943250] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-29T19:09:32.068981] [INFO ] [REMOTE ] HESM: Full fetch complete (70062 records). [2025-10-29T19:09:32.093803] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-29T19:09:32.311609] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:09:32.400381] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-29T19:09:32.629482] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T19:09:32.663201] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-29T19:09:32.663749] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-29T19:09:32.665124] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-29T19:09:32.665204] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-29T19:09:32.667513] [DEBUG] [LOCAL ] HESM: Trimmed 70062 records to 48546 (keeping 200 days of data) [2025-10-29T19:09:33.003723] [DEBUG] [LOCAL ] HESM: Primary data saved (48546 records). [2025-10-29T19:09:32.988622] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-29T19:09:33.006971] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-29T19:09:33.008096] [INFO ] [MAIN ] Update Progress: 1010/2367 symbols completed. HESM took 37.0s. Estimated remaining: 2h 54m 0s. Rate: 7.8 symbols/min [2025-10-29T19:09:33.180582] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:09:33.193768] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-29T19:09:33.199575] [DEBUG] [LOCAL ] HGTY: Loaded 13398 existing records from primary storage. [2025-10-29T19:09:33.200934] [INFO ] [MAIN ] HGTY: Loaded 13398 existing records. [2025-10-29T19:09:33.430308] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:09:33.430611] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-29T19:09:33.430695] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-29T19:09:33.430968] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-29T19:09:33.431027] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-29T19:09:33.795296] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:09:33.986794] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-29T19:09:33.993517] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-29T19:09:34.534205] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-29T19:09:34.793561] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-29T19:09:35.329228] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-29T19:09:35.593615] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-29T19:09:36.108826] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-29T19:09:36.393581] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-29T19:09:36.857494] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-29T19:09:37.193583] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-29T19:09:37.856820] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T19:09:37.993603] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-29T19:09:38.528307] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T19:09:38.793576] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-29T19:09:39.257747] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-29T19:09:39.593600] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-29T19:09:40.152784] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-29T19:09:40.393552] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-29T19:09:40.808022] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T19:09:41.193587] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-29T19:09:41.727437] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T19:09:41.993581] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-29T19:09:42.503098] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T19:09:42.793592] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-29T19:09:43.386203] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-29T19:09:43.593575] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-29T19:09:44.203164] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-29T19:09:44.393580] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-29T19:09:45.172472] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T19:09:45.193519] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-29T19:09:45.897211] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T19:09:45.993536] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-29T19:09:46.627600] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T19:09:46.630442] [INFO ] [REMOTE ] HFRO: Full fetch complete (25924 records). [2025-10-29T19:09:46.630516] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-29T19:09:46.799593] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-29T19:09:47.038826] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-29T19:09:47.038897] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-29T19:09:47.039421] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-29T19:09:47.039458] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-29T19:09:47.040072] [DEBUG] [LOCAL ] HFRO: Trimmed 25924 records to 15645 (keeping 200 days of data) [2025-10-29T19:09:47.131078] [DEBUG] [LOCAL ] HFRO: Primary data saved (15645 records). [2025-10-29T19:09:47.131245] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-29T19:09:47.131332] [INFO ] [MAIN ] Update Progress: 1011/2367 symbols completed. HFRO took 32.9s. Estimated remaining: 2h 54m 1s. Rate: 7.8 symbols/min [2025-10-29T19:09:47.307710] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:09:47.348259] [DEBUG] [LOCAL ] HGV: Loaded 45892 existing records from primary storage. [2025-10-29T19:09:47.348537] [INFO ] [MAIN ] HGV: Loaded 45892 existing records. [2025-10-29T19:09:47.531253] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:09:47.531437] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-29T19:09:47.531505] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-29T19:09:47.531867] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-29T19:09:47.531940] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-29T19:09:47.598935] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-29T19:09:47.704726] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-29T19:09:47.918972] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:09:48.155346] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-29T19:09:48.393577] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-29T19:09:48.875015] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T19:09:49.193549] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-29T19:09:49.993599] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-29T19:09:50.404472] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T19:09:50.569306] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T19:09:50.793565] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-29T19:09:51.593603] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-29T19:09:52.059706] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T19:09:52.073209] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-29T19:09:52.393552] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-29T19:09:53.193553] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-29T19:09:53.571285] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T19:09:53.993559] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-29T19:09:54.013772] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T19:09:54.793605] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-29T19:09:55.593606] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-29T19:09:55.716954] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-29T19:09:55.723291] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-29T19:09:56.393544] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-29T19:09:56.464459] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-29T19:09:57.047004] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T19:09:57.193580] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-29T19:09:57.644020] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T19:09:57.993580] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-29T19:09:58.493637] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-29T19:09:58.793558] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-29T19:09:59.593584] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-29T19:09:59.828306] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T19:10:00.175469] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-29T19:10:00.393621] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-29T19:10:01.193636] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-29T19:10:01.211483] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-29T19:10:01.216521] [INFO ] [REMOTE ] HGTY: Full fetch complete (17592 records). [2025-10-29T19:10:01.216723] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-29T19:10:01.662939] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-29T19:10:01.663043] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-29T19:10:01.663486] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-29T19:10:01.663559] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-29T19:10:01.664452] [DEBUG] [LOCAL ] HGTY: Trimmed 17592 records to 13437 (keeping 200 days of data) [2025-10-29T19:10:01.754094] [DEBUG] [LOCAL ] HGTY: Primary data saved (13437 records). [2025-10-29T19:10:01.754290] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-29T19:10:01.754396] [INFO ] [MAIN ] Update Progress: 1012/2367 symbols completed. HGTY took 28.7s. Estimated remaining: 2h 54m 3s. Rate: 7.8 symbols/min [2025-10-29T19:10:01.944783] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T19:10:01.968599] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:10:02.000133] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-29T19:10:02.017198] [DEBUG] [LOCAL ] HHH: Loaded 32707 existing records from primary storage. [2025-10-29T19:10:02.017501] [INFO ] [MAIN ] HHH: Loaded 32707 existing records. [2025-10-29T19:10:02.240016] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:10:02.240251] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-29T19:10:02.240298] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-29T19:10:02.240744] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-29T19:10:02.240803] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-29T19:10:02.588315] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T19:10:02.654906] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:10:02.793593] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-29T19:10:03.593584] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-29T19:10:04.084930] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T19:10:04.393601] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-29T19:10:04.794180] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T19:10:05.193615] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-29T19:10:05.976562] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T19:10:05.993516] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-29T19:10:06.140230] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-29T19:10:06.793552] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-29T19:10:07.326200] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:10:07.332101] [INFO ] [REMOTE ] HGER: Full fetch complete (19657 records). [2025-10-29T19:10:07.332205] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-29T19:10:07.597688] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-29T19:10:07.721896] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-29T19:10:07.721974] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-29T19:10:07.722388] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-29T19:10:07.722425] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-29T19:10:07.723010] [DEBUG] [LOCAL ] HGER: Trimmed 19657 records to 15997 (keeping 200 days of data) [2025-10-29T19:10:07.816042] [DEBUG] [LOCAL ] HGER: Primary data saved (15997 records). [2025-10-29T19:10:07.816220] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-29T19:10:07.816395] [INFO ] [MAIN ] Update Progress: 1013/2367 symbols completed. HGER took 38.2s. Estimated remaining: 2h 53m 53s. Rate: 7.8 symbols/min [2025-10-29T19:10:07.911540] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T19:10:08.045708] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:10:08.078796] [DEBUG] [LOCAL ] HI: Loaded 36061 existing records from primary storage. [2025-10-29T19:10:08.079088] [INFO ] [MAIN ] HI: Loaded 36061 existing records. [2025-10-29T19:10:08.267278] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:10:08.267571] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-29T19:10:08.273923] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-29T19:10:08.274686] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T19:10:08.275574] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-29T19:10:08.278068] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-29T19:10:08.398670] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-29T19:10:08.651695] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:10:09.193572] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-29T19:10:09.404861] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T19:10:09.993563] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-29T19:10:10.509567] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T19:10:10.700554] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-29T19:10:10.703365] [INFO ] [REMOTE ] HGLB: Full fetch complete (14420 records). [2025-10-29T19:10:10.703436] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-29T19:10:10.798756] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-29T19:10:11.081112] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-29T19:10:11.081186] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-29T19:10:11.081518] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-29T19:10:11.081556] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-29T19:10:11.082078] [DEBUG] [LOCAL ] HGLB: Trimmed 14420 records to 9139 (keeping 200 days of data) [2025-10-29T19:10:11.135593] [DEBUG] [LOCAL ] HGLB: Primary data saved (9139 records). [2025-10-29T19:10:11.135756] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-29T19:10:11.135840] [INFO ] [MAIN ] Update Progress: 1014/2367 symbols completed. HGLB took 39.7s. Estimated remaining: 2h 53m 39s. Rate: 7.8 symbols/min [2025-10-29T19:10:11.303249] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:10:11.355526] [DEBUG] [LOCAL ] HIG: Loaded 51022 existing records from primary storage. [2025-10-29T19:10:11.355934] [INFO ] [MAIN ] HIG: Loaded 51022 existing records. [2025-10-29T19:10:11.531077] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:10:11.531267] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-29T19:10:11.531312] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-29T19:10:11.531794] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-29T19:10:11.531863] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-29T19:10:11.598780] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-29T19:10:11.893176] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:10:11.971708] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T19:10:12.393566] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-29T19:10:12.504037] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-29T19:10:13.193591] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-29T19:10:13.662932] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T19:10:13.993602] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-29T19:10:14.465085] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:10:14.793580] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-29T19:10:15.281773] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T19:10:15.593604] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-29T19:10:16.085677] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T19:10:16.094800] [INFO ] [REMOTE ] HGV: Full fetch complete (65857 records). [2025-10-29T19:10:16.094978] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-29T19:10:16.398703] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-29T19:10:16.482266] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-29T19:10:16.482338] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-29T19:10:16.483186] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-29T19:10:16.483246] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-29T19:10:16.484503] [DEBUG] [LOCAL ] HGV: Trimmed 65857 records to 45882 (keeping 200 days of data) [2025-10-29T19:10:16.706743] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T19:10:16.777699] [DEBUG] [LOCAL ] HGV: Primary data saved (45882 records). [2025-10-29T19:10:16.777822] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-29T19:10:16.777898] [INFO ] [MAIN ] Update Progress: 1015/2367 symbols completed. HGV took 29.6s. Estimated remaining: 2h 53m 29s. Rate: 7.8 symbols/min [2025-10-29T19:10:16.956741] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:10:16.986895] [DEBUG] [LOCAL ] HII: Loaded 32873 existing records from primary storage. [2025-10-29T19:10:16.987149] [INFO ] [MAIN ] HII: Loaded 32873 existing records. [2025-10-29T19:10:17.169503] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:10:17.169727] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-29T19:10:17.169787] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-29T19:10:17.170126] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-29T19:10:17.170188] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-29T19:10:17.193684] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-29T19:10:17.524743] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:10:17.925232] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-29T19:10:17.993520] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-29T19:10:18.419015] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T19:10:18.793555] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-29T19:10:19.404014] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T19:10:19.593544] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-29T19:10:19.779721] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T19:10:20.393559] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-29T19:10:21.015271] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T19:10:21.193530] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-29T19:10:21.379454] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T19:10:21.993603] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-29T19:10:22.222426] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T19:10:22.793624] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-29T19:10:23.343564] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-29T19:10:23.593561] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-29T19:10:23.903408] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-29T19:10:24.393567] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-29T19:10:24.929513] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:10:25.193577] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-29T19:10:25.400968] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T19:10:25.993540] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-29T19:10:26.208497] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:10:26.793556] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-29T19:10:26.874542] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T19:10:27.593576] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-29T19:10:27.695154] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-29T19:10:28.393560] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-29T19:10:28.436800] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T19:10:29.193545] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-29T19:10:29.689149] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T19:10:29.993546] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-29T19:10:30.230861] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T19:10:30.793563] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-29T19:10:31.076922] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T19:10:31.593569] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-29T19:10:31.813172] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T19:10:31.819516] [INFO ] [REMOTE ] HHH: Full fetch complete (46030 records). [2025-10-29T19:10:31.819668] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-29T19:10:32.223607] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-29T19:10:32.223720] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-29T19:10:32.224417] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-29T19:10:32.224457] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-29T19:10:32.225415] [DEBUG] [LOCAL ] HHH: Trimmed 46030 records to 32671 (keeping 200 days of data) [2025-10-29T19:10:32.395927] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-29T19:10:32.414296] [DEBUG] [LOCAL ] HHH: Primary data saved (32671 records). [2025-10-29T19:10:32.414484] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-29T19:10:32.414564] [INFO ] [MAIN ] Update Progress: 1016/2367 symbols completed. HHH took 30.7s. Estimated remaining: 2h 53m 32s. Rate: 7.8 symbols/min [2025-10-29T19:10:32.589666] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:10:32.638401] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-29T19:10:32.638750] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-29T19:10:32.824543] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:10:32.824914] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-29T19:10:32.824979] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-29T19:10:32.825259] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-29T19:10:32.825332] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-29T19:10:33.191613] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:10:33.203940] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-29T19:10:33.223237] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-29T19:10:33.292862] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T19:10:33.993557] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-29T19:10:34.488874] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T19:10:34.793607] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-29T19:10:35.349592] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T19:10:35.358785] [INFO ] [REMOTE ] HI: Full fetch complete (51832 records). [2025-10-29T19:10:35.358942] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-29T19:10:35.598765] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-29T19:10:35.742400] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-29T19:10:35.742480] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-29T19:10:35.743207] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-29T19:10:35.743268] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-29T19:10:35.744288] [DEBUG] [LOCAL ] HI: Trimmed 51832 records to 36127 (keeping 200 days of data) [2025-10-29T19:10:35.958503] [DEBUG] [LOCAL ] HI: Primary data saved (36127 records). [2025-10-29T19:10:35.958718] [INFO ] [MAIN ] HI: Full history saved. [2025-10-29T19:10:35.958828] [INFO ] [MAIN ] Update Progress: 1017/2367 symbols completed. HI took 28.1s. Estimated remaining: 2h 53m 18s. Rate: 7.8 symbols/min [2025-10-29T19:10:36.143427] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:10:36.170906] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T19:10:36.196231] [DEBUG] [LOCAL ] HIO: Loaded 23411 existing records from primary storage. [2025-10-29T19:10:36.196481] [INFO ] [MAIN ] HIO: Loaded 23411 existing records. [2025-10-29T19:10:36.374245] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:10:36.374487] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-29T19:10:36.374549] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-29T19:10:36.374757] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-29T19:10:36.374813] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-29T19:10:36.405066] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-29T19:10:36.732371] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:10:36.900964] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T19:10:37.193555] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-29T19:10:37.993548] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-29T19:10:38.049974] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T19:10:38.166440] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-29T19:10:38.793566] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-29T19:10:39.030911] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T19:10:39.593556] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-29T19:10:40.393580] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-29T19:10:41.025959] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-29T19:10:41.155129] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T19:10:41.165930] [INFO ] [REMOTE ] HIG: Full fetch complete (73712 records). [2025-10-29T19:10:41.166076] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-29T19:10:41.199528] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-29T19:10:41.568486] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T19:10:41.596540] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-29T19:10:41.596786] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-29T19:10:41.597797] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-29T19:10:41.597880] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-29T19:10:41.599252] [DEBUG] [LOCAL ] HIG: Trimmed 73712 records to 51007 (keeping 200 days of data) [2025-10-29T19:10:41.928956] [DEBUG] [LOCAL ] HIG: Primary data saved (51007 records). [2025-10-29T19:10:41.929136] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-29T19:10:41.929303] [INFO ] [MAIN ] Update Progress: 1018/2367 symbols completed. HIG took 30.8s. Estimated remaining: 2h 53m 8s. Rate: 7.8 symbols/min [2025-10-29T19:10:41.998710] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-29T19:10:42.103415] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:10:42.123275] [DEBUG] [LOCAL ] HIPO: Loaded 21001 existing records from primary storage. [2025-10-29T19:10:42.123528] [INFO ] [MAIN ] HIPO: Loaded 21001 existing records. [2025-10-29T19:10:42.299950] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:10:42.300187] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-29T19:10:42.300235] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-29T19:10:42.300423] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-29T19:10:42.300480] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-29T19:10:42.702895] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:10:42.793522] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-29T19:10:42.993012] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T19:10:43.307956] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-29T19:10:43.365699] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T19:10:43.593563] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-29T19:10:44.393547] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-29T19:10:44.424492] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T19:10:45.193574] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-29T19:10:45.993594] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-29T19:10:46.052815] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T19:10:46.761187] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-29T19:10:46.793516] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-29T19:10:47.279603] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T19:10:47.593568] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-29T19:10:48.393593] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-29T19:10:48.773891] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T19:10:49.193553] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-29T19:10:49.286730] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-29T19:10:49.479206] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T19:10:49.993556] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-29T19:10:50.240139] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T19:10:50.793589] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-29T19:10:50.882845] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T19:10:51.591169] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-29T19:10:51.597722] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-29T19:10:52.296767] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-29T19:10:52.393611] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-29T19:10:53.171608] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-29T19:10:53.193561] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-29T19:10:53.993624] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-29T19:10:54.500956] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-29T19:10:54.507611] [INFO ] [REMOTE ] HII: Full fetch complete (52129 records). [2025-10-29T19:10:54.507731] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-29T19:10:54.798279] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-29T19:10:54.958002] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T19:10:54.958179] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-29T19:10:54.964551] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-29T19:10:54.966593] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-29T19:10:54.966720] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-29T19:10:54.968680] [DEBUG] [LOCAL ] HII: Trimmed 52129 records to 32737 (keeping 200 days of data) [2025-10-29T19:10:55.199687] [DEBUG] [LOCAL ] HII: Primary data saved (32737 records). [2025-10-29T19:10:55.199932] [INFO ] [MAIN ] HII: Full history saved. [2025-10-29T19:10:55.200565] [INFO ] [MAIN ] Update Progress: 1019/2367 symbols completed. HII took 38.4s. Estimated remaining: 2h 53m 8s. Rate: 7.8 symbols/min [2025-10-29T19:10:55.394388] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:10:55.444438] [DEBUG] [LOCAL ] HIW: Loaded 44259 existing records from primary storage. [2025-10-29T19:10:55.444915] [INFO ] [MAIN ] HIW: Loaded 44259 existing records. [2025-10-29T19:10:55.600328] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-29T19:10:55.631967] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:10:55.633092] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-29T19:10:55.633151] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-29T19:10:55.633432] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-29T19:10:55.633489] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-29T19:10:55.871801] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T19:10:56.012228] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:10:56.342086] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-29T19:10:56.393545] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-29T19:10:57.193703] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-29T19:10:57.527313] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T19:10:57.753137] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-29T19:10:57.993701] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-29T19:10:58.801798] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-29T19:10:58.809112] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T19:10:59.593604] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-29T19:11:00.369768] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T19:11:00.393522] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-29T19:11:01.170960] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-29T19:11:01.194674] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-29T19:11:01.199487] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-29T19:11:01.993592] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-29T19:11:02.273702] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T19:11:02.793566] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-29T19:11:03.593556] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-29T19:11:03.799565] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T19:11:03.806569] [INFO ] [REMOTE ] HIO: Full fetch complete (38174 records). [2025-10-29T19:11:03.806741] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-29T19:11:04.204609] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-29T19:11:04.204930] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-29T19:11:04.205788] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-29T19:11:04.205867] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-29T19:11:04.215749] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T19:11:04.220245] [INFO ] [REMOTE ] HIPO: Full fetch complete (30807 records). [2025-10-29T19:11:04.220352] [DEBUG] [LOCAL ] HIO: Trimmed 38174 records to 23363 (keeping 200 days of data) [2025-10-29T19:11:04.220916] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-29T19:11:04.398326] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-29T19:11:04.619002] [DEBUG] [LOCAL ] HIO: Primary data saved (23363 records). [2025-10-29T19:11:04.636909] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-29T19:11:04.672551] [INFO ] [MAIN ] Update Progress: 1020/2367 symbols completed. HIO took 28.7s. Estimated remaining: 2h 53m 3s. Rate: 7.8 symbols/min [2025-10-29T19:11:04.917163] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-29T19:11:04.927702] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-29T19:11:04.952236] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-29T19:11:04.986165] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:11:04.984384] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-29T19:11:04.987822] [DEBUG] [LOCAL ] HIPO: Trimmed 30807 records to 20959 (keeping 200 days of data) [2025-10-29T19:11:05.121685] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-29T19:11:05.172010] [DEBUG] [LOCAL ] HIPO: Primary data saved (20959 records). [2025-10-29T19:11:05.179841] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-29T19:11:05.180582] [INFO ] [MAIN ] Update Progress: 1021/2367 symbols completed. HIPO took 23.3s. Estimated remaining: 2h 52m 46s. Rate: 7.8 symbols/min [2025-10-29T19:11:05.180345] [DEBUG] [LOCAL ] HIX: Loaded 20042 existing records from primary storage. [2025-10-29T19:11:05.203118] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-29T19:11:05.214383] [INFO ] [MAIN ] HIX: Loaded 20042 existing records. [2025-10-29T19:11:05.511094] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:11:05.585123] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:11:05.586070] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-29T19:11:05.586163] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-29T19:11:05.586403] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-29T19:11:05.586458] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-29T19:11:05.703305] [DEBUG] [LOCAL ] HKD: Loaded 18680 existing records from primary storage. [2025-10-29T19:11:05.703790] [INFO ] [MAIN ] HKD: Loaded 18680 existing records. [2025-10-29T19:11:05.929319] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-29T19:11:06.036687] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-29T19:11:06.189199] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:11:06.212426] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-29T19:11:06.212325] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:11:06.212561] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-29T19:11:06.213139] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-29T19:11:06.213202] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-29T19:11:06.618375] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:11:06.793624] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-29T19:11:07.406040] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T19:11:07.553236] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-29T19:11:07.577293] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T19:11:07.593505] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-29T19:11:08.393538] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-29T19:11:08.421373] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T19:11:09.193583] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-29T19:11:09.759718] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T19:11:09.993588] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-29T19:11:10.049742] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T19:11:10.782960] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-29T19:11:10.793507] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-29T19:11:11.426883] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-29T19:11:11.593527] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-29T19:11:12.393566] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-29T19:11:13.193551] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-29T19:11:13.585384] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-29T19:11:13.679044] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T19:11:13.712146] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T19:11:13.993571] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-29T19:11:14.709858] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T19:11:14.793529] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-29T19:11:15.541728] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-29T19:11:15.593535] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-29T19:11:16.333559] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-29T19:11:16.393532] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-29T19:11:17.028419] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T19:11:17.193588] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-29T19:11:17.998762] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-29T19:11:18.011354] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-29T19:11:18.793556] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-29T19:11:18.820681] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T19:11:19.593814] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-29T19:11:19.924063] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T19:11:20.393608] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-29T19:11:20.669680] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T19:11:21.193557] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-29T19:11:21.579170] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T19:11:21.993572] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-29T19:11:22.785087] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-29T19:11:22.793545] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-29T19:11:23.397388] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T19:11:23.593552] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-29T19:11:23.690051] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-29T19:11:23.703327] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-29T19:11:23.703529] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-29T19:11:24.105773] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-29T19:11:24.106062] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-29T19:11:24.107279] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-29T19:11:24.107347] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-29T19:11:24.109323] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-29T19:11:24.378241] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-29T19:11:24.393515] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-29T19:11:24.509900] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-29T19:11:24.510039] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-29T19:11:24.510947] [INFO ] [MAIN ] Update Progress: 1022/2367 symbols completed. HIMS took 52.1s. Estimated remaining: 2h 52m 53s. Rate: 7.8 symbols/min [2025-10-29T19:11:24.712241] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:11:24.771038] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-29T19:11:24.771382] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-29T19:11:24.947396] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:11:24.947632] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-29T19:11:24.947716] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-29T19:11:24.948146] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-29T19:11:24.948185] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-29T19:11:25.193933] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-29T19:11:25.319605] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T19:11:25.325098] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:11:25.993596] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-29T19:11:26.152405] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-29T19:11:26.793627] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-29T19:11:27.323486] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T19:11:27.593603] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-29T19:11:27.702113] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-29T19:11:27.706672] [INFO ] [REMOTE ] HIX: Full fetch complete (29926 records). [2025-10-29T19:11:27.706768] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-29T19:11:28.089994] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-29T19:11:28.090068] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-29T19:11:28.090637] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-29T19:11:28.090745] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-29T19:11:28.091399] [DEBUG] [LOCAL ] HIX: Trimmed 29926 records to 19998 (keeping 200 days of data) [2025-10-29T19:11:28.205199] [DEBUG] [LOCAL ] HIX: Primary data saved (19998 records). [2025-10-29T19:11:28.205327] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-29T19:11:28.205402] [INFO ] [MAIN ] Update Progress: 1023/2367 symbols completed. HIX took 23.5s. Estimated remaining: 2h 52m 40s. Rate: 7.8 symbols/min [2025-10-29T19:11:28.373081] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:11:28.395152] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-29T19:11:28.415859] [DEBUG] [LOCAL ] HLF: Loaded 48171 existing records from primary storage. [2025-10-29T19:11:28.416150] [INFO ] [MAIN ] HLF: Loaded 48171 existing records. [2025-10-29T19:11:28.594380] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:11:28.594606] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-29T19:11:28.594714] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-29T19:11:28.594952] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-29T19:11:28.595007] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-29T19:11:28.956310] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:11:29.171330] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-29T19:11:29.193074] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T19:11:29.197996] [INFO ] [REMOTE ] HKD: Full fetch complete (27694 records). [2025-10-29T19:11:29.197281] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-29T19:11:29.198826] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-29T19:11:29.564327] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-29T19:11:29.564405] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-29T19:11:29.564992] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-29T19:11:29.565055] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-29T19:11:29.565796] [DEBUG] [LOCAL ] HKD: Trimmed 27694 records to 18714 (keeping 200 days of data) [2025-10-29T19:11:29.671273] [DEBUG] [LOCAL ] HKD: Primary data saved (18714 records). [2025-10-29T19:11:29.671404] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-29T19:11:29.671480] [INFO ] [MAIN ] Update Progress: 1024/2367 symbols completed. HKD took 24.5s. Estimated remaining: 2h 52m 24s. Rate: 7.8 symbols/min [2025-10-29T19:11:29.856365] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:11:29.886237] [DEBUG] [LOCAL ] HLI: Loaded 30307 existing records from primary storage. [2025-10-29T19:11:29.886489] [INFO ] [MAIN ] HLI: Loaded 30307 existing records. [2025-10-29T19:11:29.998881] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-29T19:11:30.071083] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:11:30.071287] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-29T19:11:30.071334] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-29T19:11:30.071527] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-29T19:11:30.071593] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-29T19:11:30.456258] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:11:30.483936] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T19:11:30.793605] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-29T19:11:31.552762] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-29T19:11:31.593524] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-29T19:11:32.149083] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T19:11:32.393551] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-29T19:11:33.126753] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T19:11:33.193522] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-29T19:11:33.794328] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T19:11:33.993553] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-29T19:11:34.793526] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-29T19:11:34.936309] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-29T19:11:35.041324] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T19:11:35.593528] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-29T19:11:36.121739] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T19:11:36.393618] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-29T19:11:36.447847] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T19:11:37.193758] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-29T19:11:37.547698] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:11:37.993630] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-29T19:11:38.793617] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-29T19:11:38.842165] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-29T19:11:39.378609] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T19:11:39.388972] [INFO ] [REMOTE ] HIW: Full fetch complete (65036 records). [2025-10-29T19:11:39.389200] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-29T19:11:39.598758] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-29T19:11:39.811449] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-29T19:11:39.811746] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-29T19:11:39.812688] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-29T19:11:39.812892] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-29T19:11:39.814485] [DEBUG] [LOCAL ] HIW: Trimmed 65036 records to 44310 (keeping 200 days of data) [2025-10-29T19:11:40.010206] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T19:11:40.113196] [DEBUG] [LOCAL ] HIW: Primary data saved (44310 records). [2025-10-29T19:11:40.113343] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-29T19:11:40.113425] [INFO ] [MAIN ] Update Progress: 1025/2367 symbols completed. HIW took 44.9s. Estimated remaining: 2h 52m 20s. Rate: 7.8 symbols/min [2025-10-29T19:11:40.285395] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:11:40.312495] [DEBUG] [LOCAL ] HLIO: Loaded 27808 existing records from primary storage. [2025-10-29T19:11:40.312768] [INFO ] [MAIN ] HLIO: Loaded 27808 existing records. [2025-10-29T19:11:40.400737] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-29T19:11:40.492993] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:11:40.493171] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-29T19:11:40.493221] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-29T19:11:40.493474] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-29T19:11:40.493534] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-29T19:11:40.888474] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:11:41.193621] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-29T19:11:41.236051] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T19:11:41.776710] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T19:11:41.937559] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-29T19:11:41.993516] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-29T19:11:42.584707] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-29T19:11:42.793541] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-29T19:11:43.593554] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-29T19:11:44.111391] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-29T19:11:44.393576] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-29T19:11:44.629860] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-29T19:11:45.193584] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-29T19:11:45.215251] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T19:11:45.993553] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-29T19:11:46.793628] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-29T19:11:46.883429] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T19:11:47.021893] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-29T19:11:47.593567] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-29T19:11:48.084289] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T19:11:48.329305] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-29T19:11:48.393565] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-29T19:11:49.193566] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-29T19:11:49.300495] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-29T19:11:49.993593] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-29T19:11:50.392478] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T19:11:50.793538] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-29T19:11:51.593579] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-29T19:11:51.857134] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-29T19:11:51.952611] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T19:11:52.393544] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-29T19:11:52.423770] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-29T19:11:53.193605] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-29T19:11:53.584032] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T19:11:54.004313] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-29T19:11:54.006851] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T19:11:54.793569] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-29T19:11:55.294736] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T19:11:55.304277] [INFO ] [REMOTE ] HLF: Full fetch complete (70629 records). [2025-10-29T19:11:55.304397] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-29T19:11:55.596120] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-29T19:11:55.696317] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-29T19:11:55.696463] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-29T19:11:55.697493] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-29T19:11:55.697572] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-29T19:11:55.707537] [DEBUG] [LOCAL ] HLF: Trimmed 70629 records to 48128 (keeping 200 days of data) [2025-10-29T19:11:55.723421] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T19:11:56.004228] [DEBUG] [LOCAL ] HLF: Primary data saved (48128 records). [2025-10-29T19:11:56.004378] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-29T19:11:56.004473] [INFO ] [MAIN ] Update Progress: 1026/2367 symbols completed. HLF took 27.8s. Estimated remaining: 2h 52m 23s. Rate: 7.8 symbols/min [2025-10-29T19:11:56.183379] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:11:56.213849] [DEBUG] [LOCAL ] HLLY: Loaded 33119 existing records from primary storage. [2025-10-29T19:11:56.214112] [INFO ] [MAIN ] HLLY: Loaded 33119 existing records. [2025-10-29T19:11:56.390275] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:11:56.390521] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-29T19:11:56.390568] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-29T19:11:56.390877] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-29T19:11:56.390934] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-29T19:11:56.402010] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-29T19:11:56.771820] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:11:57.193549] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-29T19:11:57.375134] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-29T19:11:57.551602] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-29T19:11:57.562881] [INFO ] [REMOTE ] HL: Full fetch complete (77828 records). [2025-10-29T19:11:57.563030] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-29T19:11:57.998896] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-29T19:11:58.071753] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-29T19:11:58.072303] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-29T19:11:58.073912] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-29T19:11:58.075989] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-29T19:11:58.078390] [DEBUG] [LOCAL ] HL: Trimmed 77828 records to 53676 (keeping 200 days of data) [2025-10-29T19:11:58.247886] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T19:11:58.530405] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-29T19:11:58.530612] [INFO ] [MAIN ] HL: Full history saved. [2025-10-29T19:11:58.530766] [INFO ] [MAIN ] Update Progress: 1027/2367 symbols completed. HL took 34.0s. Estimated remaining: 2h 52m 9s. Rate: 7.8 symbols/min [2025-10-29T19:11:58.759637] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:11:58.793591] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-29T19:11:58.816779] [DEBUG] [LOCAL ] HLN: Loaded 53097 existing records from primary storage. [2025-10-29T19:11:58.817173] [INFO ] [MAIN ] HLN: Loaded 53097 existing records. [2025-10-29T19:11:59.028495] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:11:59.028882] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-29T19:11:59.028969] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-29T19:11:59.036089] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-29T19:11:59.047253] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-29T19:11:59.054856] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-29T19:11:59.470892] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:11:59.593615] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-29T19:11:59.701491] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-29T19:12:00.393572] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-29T19:12:01.193796] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-29T19:12:01.327154] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-29T19:12:01.647002] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T19:12:01.654167] [INFO ] [REMOTE ] HLI: Full fetch complete (45442 records). [2025-10-29T19:12:01.654271] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-29T19:12:01.996374] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-29T19:12:02.060467] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-29T19:12:02.061424] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-29T19:12:02.063124] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-29T19:12:02.062246] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T19:12:02.063290] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-29T19:12:02.069567] [DEBUG] [LOCAL ] HLI: Trimmed 45442 records to 30346 (keeping 200 days of data) [2025-10-29T19:12:02.262335] [DEBUG] [LOCAL ] HLI: Primary data saved (30346 records). [2025-10-29T19:12:02.262460] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-29T19:12:02.262536] [INFO ] [MAIN ] Update Progress: 1028/2367 symbols completed. HLI took 32.6s. Estimated remaining: 2h 51m 56s. Rate: 7.8 symbols/min [2025-10-29T19:12:02.432873] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:12:02.480857] [DEBUG] [LOCAL ] HLT: Loaded 50372 existing records from primary storage. [2025-10-29T19:12:02.481225] [INFO ] [MAIN ] HLT: Loaded 50372 existing records. [2025-10-29T19:12:02.666896] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:12:02.667127] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-29T19:12:02.667181] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-29T19:12:02.667366] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-29T19:12:02.667410] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-29T19:12:02.798679] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-29T19:12:03.051550] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:12:03.067741] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T19:12:03.593591] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-29T19:12:04.169779] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-29T19:12:04.393574] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-29T19:12:05.020570] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T19:12:05.193534] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-29T19:12:05.228127] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T19:12:05.993624] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-29T19:12:06.467962] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T19:12:06.793539] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-29T19:12:06.949372] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-29T19:12:07.593563] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-29T19:12:07.819906] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-29T19:12:07.825402] [INFO ] [REMOTE ] HLIO: Full fetch complete (37304 records). [2025-10-29T19:12:07.825493] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-29T19:12:08.203907] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-29T19:12:08.203983] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-29T19:12:08.204602] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-29T19:12:08.204660] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-29T19:12:08.205466] [DEBUG] [LOCAL ] HLIO: Trimmed 37304 records to 27852 (keeping 200 days of data) [2025-10-29T19:12:08.371946] [DEBUG] [LOCAL ] HLIO: Primary data saved (27852 records). [2025-10-29T19:12:08.372104] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-29T19:12:08.372228] [INFO ] [MAIN ] Update Progress: 1029/2367 symbols completed. HLIO took 28.3s. Estimated remaining: 2h 51m 46s. Rate: 7.8 symbols/min [2025-10-29T19:12:08.402049] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-29T19:12:08.552032] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:12:08.573562] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-29T19:12:08.615459] [DEBUG] [LOCAL ] HLX: Loaded 47235 existing records from primary storage. [2025-10-29T19:12:08.615817] [INFO ] [MAIN ] HLX: Loaded 47235 existing records. [2025-10-29T19:12:08.799750] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:12:08.799904] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-29T19:12:08.799951] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-29T19:12:08.800156] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-29T19:12:08.800212] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-29T19:12:09.166783] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:12:09.193555] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-29T19:12:09.847730] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T19:12:09.993575] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-29T19:12:10.408677] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T19:12:10.793618] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-29T19:12:10.939486] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T19:12:11.593620] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-29T19:12:12.181442] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T19:12:12.393577] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-29T19:12:12.681567] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T19:12:13.193563] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-29T19:12:13.872806] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T19:12:13.991114] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T19:12:13.996317] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-29T19:12:14.793524] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-29T19:12:15.431195] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T19:12:15.593541] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-29T19:12:15.752125] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T19:12:16.393598] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-29T19:12:16.754492] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T19:12:17.193599] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-29T19:12:17.929579] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-29T19:12:17.993532] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-29T19:12:18.502567] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T19:12:18.793612] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-29T19:12:19.352094] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-29T19:12:19.593614] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-29T19:12:20.132876] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T19:12:20.393564] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-29T19:12:20.840189] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:12:21.193596] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-29T19:12:21.642768] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T19:12:21.993542] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-29T19:12:22.734420] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-29T19:12:22.793619] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-29T19:12:23.065136] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T19:12:23.593612] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-29T19:12:24.085924] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T19:12:24.393562] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-29T19:12:24.861277] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T19:12:25.193569] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-29T19:12:25.283377] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T19:12:25.993559] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-29T19:12:26.577360] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T19:12:26.793568] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-29T19:12:27.255667] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T19:12:27.593563] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-29T19:12:27.976952] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T19:12:28.393579] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-29T19:12:28.462520] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T19:12:28.469219] [INFO ] [REMOTE ] HLLY: Full fetch complete (46063 records). [2025-10-29T19:12:28.469329] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-29T19:12:28.843811] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-29T19:12:28.843885] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-29T19:12:28.844564] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-29T19:12:28.844602] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-29T19:12:28.845552] [DEBUG] [LOCAL ] HLLY: Trimmed 46063 records to 33175 (keeping 200 days of data) [2025-10-29T19:12:29.027529] [DEBUG] [LOCAL ] HLLY: Primary data saved (33175 records). [2025-10-29T19:12:29.027694] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-29T19:12:29.027806] [INFO ] [MAIN ] Update Progress: 1030/2367 symbols completed. HLLY took 33.0s. Estimated remaining: 2h 51m 55s. Rate: 7.8 symbols/min [2025-10-29T19:12:29.198743] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-29T19:12:29.200708] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:12:29.243198] [DEBUG] [LOCAL ] HMC: Loaded 46011 existing records from primary storage. [2025-10-29T19:12:29.243498] [INFO ] [MAIN ] HMC: Loaded 46011 existing records. [2025-10-29T19:12:29.426396] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:12:29.426661] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-29T19:12:29.426742] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-29T19:12:29.426916] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-29T19:12:29.426955] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-29T19:12:29.805966] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:12:29.835377] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T19:12:29.993533] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-29T19:12:30.420486] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T19:12:30.793580] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-29T19:12:31.593533] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-29T19:12:31.794114] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-29T19:12:31.805797] [INFO ] [REMOTE ] HLN: Full fetch complete (77023 records). [2025-10-29T19:12:31.805955] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-29T19:12:32.230444] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-29T19:12:32.233215] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-29T19:12:32.234389] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-29T19:12:32.234471] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-29T19:12:32.236733] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T19:12:32.247588] [DEBUG] [LOCAL ] HLN: Trimmed 77023 records to 53092 (keeping 200 days of data) [2025-10-29T19:12:32.416544] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-29T19:12:32.560847] [DEBUG] [LOCAL ] HLN: Primary data saved (53092 records). [2025-10-29T19:12:32.560974] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-29T19:12:32.562020] [INFO ] [MAIN ] Update Progress: 1031/2367 symbols completed. HLN took 34.0s. Estimated remaining: 2h 51m 42s. Rate: 7.8 symbols/min [2025-10-29T19:12:32.735045] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:12:32.758146] [DEBUG] [LOCAL ] HMN: Loaded 22876 existing records from primary storage. [2025-10-29T19:12:32.758417] [INFO ] [MAIN ] HMN: Loaded 22876 existing records. [2025-10-29T19:12:32.952197] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:12:32.952503] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-29T19:12:32.952580] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-29T19:12:32.953037] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-29T19:12:32.953203] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-29T19:12:33.204685] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-29T19:12:33.344063] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:12:33.363083] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-29T19:12:33.375934] [INFO ] [REMOTE ] HLT: Full fetch complete (73656 records). [2025-10-29T19:12:33.376163] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-29T19:12:33.835160] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T19:12:33.883129] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-29T19:12:33.883219] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-29T19:12:33.884242] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-29T19:12:33.884341] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-29T19:12:33.886066] [DEBUG] [LOCAL ] HLT: Trimmed 73656 records to 50366 (keeping 200 days of data) [2025-10-29T19:12:33.994345] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-29T19:12:34.203859] [DEBUG] [LOCAL ] HLT: Primary data saved (50366 records). [2025-10-29T19:12:34.203998] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-29T19:12:34.204076] [INFO ] [MAIN ] Update Progress: 1032/2367 symbols completed. HLT took 31.9s. Estimated remaining: 2h 51m 26s. Rate: 7.8 symbols/min [2025-10-29T19:12:34.382112] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:12:34.431148] [DEBUG] [LOCAL ] HMY: Loaded 53165 existing records from primary storage. [2025-10-29T19:12:34.431476] [INFO ] [MAIN ] HMY: Loaded 53165 existing records. [2025-10-29T19:12:34.608485] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:12:34.608939] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-29T19:12:34.608996] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-29T19:12:34.609185] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-29T19:12:34.609239] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-29T19:12:34.802675] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-29T19:12:34.819094] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T19:12:35.011897] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:12:35.039954] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-29T19:12:35.593554] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-29T19:12:36.209936] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-29T19:12:36.221586] [INFO ] [REMOTE ] HLX: Full fetch complete (69043 records). [2025-10-29T19:12:36.221781] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-29T19:12:36.394354] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-29T19:12:36.629241] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-29T19:12:36.629315] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-29T19:12:36.630197] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-29T19:12:36.630260] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-29T19:12:36.631454] [DEBUG] [LOCAL ] HLX: Trimmed 69043 records to 47244 (keeping 200 days of data) [2025-10-29T19:12:36.882335] [DEBUG] [LOCAL ] HLX: Primary data saved (47244 records). [2025-10-29T19:12:36.882457] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-29T19:12:36.882531] [INFO ] [MAIN ] Update Progress: 1033/2367 symbols completed. HLX took 28.5s. Estimated remaining: 2h 51m 12s. Rate: 7.8 symbols/min [2025-10-29T19:12:37.052103] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:12:37.052511] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-29T19:12:37.052638] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-29T19:12:37.052786] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-29T19:12:37.052829] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-29T19:12:37.052869] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-29T19:12:37.052899] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-29T19:12:37.210727] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-29T19:12:37.416875] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:12:37.451571] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-29T19:12:37.712097] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-29T19:12:37.993560] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-29T19:12:38.057413] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T19:12:38.793607] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-29T19:12:38.984729] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T19:12:38.985055] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-29T19:12:38.985159] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:12:38.985257] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-29T19:12:38.985340] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:12:38.985432] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-29T19:12:38.985513] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-29T19:12:38.985551] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-29T19:12:38.985590] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-29T19:12:38.985706] [INFO ] [MAIN ] Update Progress: 1034/2367 symbols completed. HNGE took 2.1s. Estimated remaining: 2h 50m 57s. Rate: 7.8 symbols/min [2025-10-29T19:12:39.179814] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:12:39.209889] [DEBUG] [LOCAL ] HNI: Loaded 29761 existing records from primary storage. [2025-10-29T19:12:39.210244] [INFO ] [MAIN ] HNI: Loaded 29761 existing records. [2025-10-29T19:12:39.440883] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:12:39.461628] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-29T19:12:39.461786] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-29T19:12:39.462363] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-29T19:12:39.462463] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-29T19:12:39.470565] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T19:12:39.596507] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-29T19:12:39.866193] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:12:40.380382] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T19:12:40.393548] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-29T19:12:41.198706] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-29T19:12:41.216455] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T19:12:41.993546] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-29T19:12:42.618486] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T19:12:42.779575] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-29T19:12:42.793514] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-29T19:12:43.593617] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-29T19:12:44.137944] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T19:12:44.393559] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-29T19:12:45.073878] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T19:12:45.193573] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-29T19:12:45.728975] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T19:12:45.993585] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-29T19:12:46.793547] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-29T19:12:46.907523] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-29T19:12:46.943631] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T19:12:47.588514] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-29T19:12:47.594009] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-29T19:12:48.393707] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-29T19:12:49.195092] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-29T19:12:49.209636] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-29T19:12:49.275433] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-29T19:12:49.993570] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-29T19:12:50.368372] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T19:12:50.793583] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-29T19:12:51.539585] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-29T19:12:51.593536] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-29T19:12:51.664496] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-29T19:12:52.393595] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-29T19:12:53.146472] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T19:12:53.193538] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-29T19:12:53.690885] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T19:12:53.993608] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-29T19:12:54.744926] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-29T19:12:54.793530] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-29T19:12:54.844639] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-29T19:12:55.538278] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T19:12:55.593522] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-29T19:12:56.393566] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-29T19:12:56.459407] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T19:12:57.193548] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-29T19:12:57.570001] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T19:12:57.823458] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T19:12:57.993598] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-29T19:12:58.793577] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-29T19:12:59.593589] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-29T19:12:59.747924] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-29T19:12:59.967869] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T19:13:00.393547] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-29T19:13:00.479678] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-29T19:13:01.193724] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-29T19:13:01.670600] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:13:01.993637] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-29T19:13:02.572333] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-29T19:13:02.582207] [INFO ] [REMOTE ] HMC: Full fetch complete (68396 records). [2025-10-29T19:13:02.582353] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-29T19:13:02.799062] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-29T19:13:02.992543] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-29T19:13:02.992639] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-29T19:13:02.993775] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-29T19:13:02.993853] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-29T19:13:02.995179] [DEBUG] [LOCAL ] HMC: Trimmed 68396 records to 46014 (keeping 200 days of data) [2025-10-29T19:13:03.264134] [DEBUG] [LOCAL ] HMC: Primary data saved (46014 records). [2025-10-29T19:13:03.264239] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-29T19:13:03.264321] [INFO ] [MAIN ] Update Progress: 1035/2367 symbols completed. HMC took 34.2s. Estimated remaining: 2h 51m 11s. Rate: 7.8 symbols/min [2025-10-29T19:13:03.434471] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:03.481593] [DEBUG] [LOCAL ] HOG: Loaded 50482 existing records from primary storage. [2025-10-29T19:13:03.481917] [INFO ] [MAIN ] HOG: Loaded 50482 existing records. [2025-10-29T19:13:03.597668] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-29T19:13:03.701867] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:03.704284] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-29T19:13:03.709796] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-29T19:13:03.710120] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-29T19:13:03.710832] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-29T19:13:03.710978] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-29T19:13:03.907597] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-29T19:13:03.984948] [INFO ] [REMOTE ] HMY: Full fetch complete (77164 records). [2025-10-29T19:13:04.017835] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-29T19:13:04.260592] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:04.398805] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-29T19:13:04.589397] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-29T19:13:04.589685] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-29T19:13:04.591080] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-29T19:13:04.591153] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-29T19:13:04.593575] [DEBUG] [LOCAL ] HMY: Trimmed 77164 records to 53163 (keeping 200 days of data) [2025-10-29T19:13:04.839246] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T19:13:04.972108] [DEBUG] [LOCAL ] HMY: Primary data saved (53163 records). [2025-10-29T19:13:04.972316] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-29T19:13:04.972407] [INFO ] [MAIN ] Update Progress: 1036/2367 symbols completed. HMY took 30.8s. Estimated remaining: 2h 50m 56s. Rate: 7.8 symbols/min [2025-10-29T19:13:05.151368] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:05.165457] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T19:13:05.193676] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-29T19:13:05.208380] [DEBUG] [LOCAL ] HOMB: Loaded 43531 existing records from primary storage. [2025-10-29T19:13:05.208768] [INFO ] [MAIN ] HOMB: Loaded 43531 existing records. [2025-10-29T19:13:05.405860] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:05.406100] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-29T19:13:05.406148] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-29T19:13:05.406325] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-29T19:13:05.406363] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-29T19:13:05.764135] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:05.993535] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-29T19:13:06.035313] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-29T19:13:06.039923] [INFO ] [REMOTE ] HMN: Full fetch complete (31771 records). [2025-10-29T19:13:06.040031] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-29T19:13:06.413096] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-29T19:13:06.413175] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-29T19:13:06.413815] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-29T19:13:06.413876] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-29T19:13:06.414567] [DEBUG] [LOCAL ] HMN: Trimmed 31771 records to 22853 (keeping 200 days of data) [2025-10-29T19:13:06.558753] [DEBUG] [LOCAL ] HMN: Primary data saved (22853 records). [2025-10-29T19:13:06.558872] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-29T19:13:06.558944] [INFO ] [MAIN ] Update Progress: 1037/2367 symbols completed. HMN took 34.0s. Estimated remaining: 2h 50m 40s. Rate: 7.8 symbols/min [2025-10-29T19:13:06.793599] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-29T19:13:07.134853] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-29T19:13:07.593572] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-29T19:13:08.045121] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T19:13:08.393573] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-29T19:13:08.561861] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T19:13:09.193585] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-29T19:13:09.416771] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T19:13:09.424381] [INFO ] [REMOTE ] HNI: Full fetch complete (42382 records). [2025-10-29T19:13:09.424516] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-29T19:13:09.803026] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-29T19:13:09.803114] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-29T19:13:09.803796] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-29T19:13:09.803858] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-29T19:13:09.804769] [DEBUG] [LOCAL ] HNI: Trimmed 42382 records to 29870 (keeping 200 days of data) [2025-10-29T19:13:09.976530] [DEBUG] [LOCAL ] HNI: Primary data saved (29870 records). [2025-10-29T19:13:09.976690] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-29T19:13:09.976782] [INFO ] [MAIN ] Update Progress: 1038/2367 symbols completed. HNI took 31.0s. Estimated remaining: 2h 50m 27s. Rate: 7.8 symbols/min [2025-10-29T19:13:09.993694] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-29T19:13:10.410710] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T19:13:10.793616] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-29T19:13:11.138980] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:13:11.593608] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-29T19:13:12.324294] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T19:13:12.393529] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-29T19:13:12.780967] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T19:13:13.193598] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-29T19:13:13.653876] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T19:13:13.993563] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-29T19:13:14.169705] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T19:13:14.793616] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-29T19:13:15.177270] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-29T19:13:15.593566] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-29T19:13:15.665174] [DEBUG] [REMOTE ] HOG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-29T19:13:15.665376] [WARN ] [REMOTE ] HOG: No data returned for month 2025-06 [2025-10-29T19:13:15.665476] [FATAL] [REMOTE ] HOG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:13:15.667140] [FATAL] [MAIN ] HOG: Failed to fetch primary data. [2025-10-29T19:13:15.667282] [WARN ] [MAIN ] HOG: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:13:15.667376] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-29T19:13:15.667456] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-29T19:13:15.667496] [INFO ] [LOCAL ] HOG: Starting deletion of derivative data. [2025-10-29T19:13:15.667781] [DEBUG] [LOCAL ] HOG: Deleted derivative data file. [2025-10-29T19:13:15.667864] [INFO ] [MAIN ] Update Progress: 1039/2367 symbols completed. HOG took 12.4s. Estimated remaining: 2h 50m 17s. Rate: 7.8 symbols/min [2025-10-29T19:13:15.776845] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T19:13:16.393566] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-29T19:13:17.602077] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T19:13:17.612400] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-29T19:13:18.639328] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T19:13:18.649201] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-29T19:13:19.854696] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T19:13:19.865267] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-29T19:13:21.170782] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-29T19:13:21.181882] [INFO ] [REMOTE ] HOMB: Full fetch complete (64439 records). [2025-10-29T19:13:21.182091] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-29T19:13:21.584255] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-29T19:13:21.584370] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-29T19:13:21.585766] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-29T19:13:21.585844] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-29T19:13:21.587638] [DEBUG] [LOCAL ] HOMB: Trimmed 64439 records to 43495 (keeping 200 days of data) [2025-10-29T19:13:21.877046] [DEBUG] [LOCAL ] HOMB: Primary data saved (43495 records). [2025-10-29T19:13:21.877236] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-29T19:13:21.877332] [INFO ] [MAIN ] Update Progress: 1040/2367 symbols completed. HOMB took 16.9s. Estimated remaining: 2h 50m 7s. Rate: 7.8 symbols/min [2025-10-29T19:13:22.531181] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:22.531948] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:22.502841] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:22.586075] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:22.602720] [DEBUG] [LOCAL ] HOV: Loaded 13612 existing records from primary storage. [2025-10-29T19:13:22.603365] [INFO ] [MAIN ] HOV: Loaded 13612 existing records. [2025-10-29T19:13:22.860405] [DEBUG] [LOCAL ] HOUS: Loaded 45809 existing records from primary storage. [2025-10-29T19:13:22.867944] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:22.869468] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-29T19:13:22.869735] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-29T19:13:22.870105] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-29T19:13:22.868805] [DEBUG] [LOCAL ] HP: Loaded 51229 existing records from primary storage. [2025-10-29T19:13:22.870330] [INFO ] [MAIN ] HOUS: Loaded 45809 existing records. [2025-10-29T19:13:22.870029] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-29T19:13:22.881611] [INFO ] [MAIN ] HP: Loaded 51229 existing records. [2025-10-29T19:13:22.887040] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-29T19:13:22.980146] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-29T19:13:23.510996] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:23.573436] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:23.543390] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:23.574124] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-29T19:13:23.579760] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-29T19:13:23.573953] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-29T19:13:23.579693] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-29T19:13:23.600555] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-29T19:13:23.614671] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-29T19:13:23.619939] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-29T19:13:23.626269] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-29T19:13:23.626489] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-29T19:13:23.626384] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-29T19:13:23.626553] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-29T19:13:23.664812] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-29T19:13:24.486844] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:24.533213] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-29T19:13:24.921311] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:24.993813] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:24.948425] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-29T19:13:25.049133] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:25.049693] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-29T19:13:25.051251] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-29T19:13:25.276172] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-29T19:13:25.278998] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-29T19:13:25.713924] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-29T19:13:25.716710] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-29T19:13:25.989636] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T19:13:25.999171] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-29T19:13:26.248975] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T19:13:26.259202] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-29T19:13:26.393485] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-29T19:13:26.399218] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-29T19:13:26.775382] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-29T19:13:26.793522] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-29T19:13:26.961438] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T19:13:27.028311] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-29T19:13:27.388953] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T19:13:27.593561] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-29T19:13:28.026633] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T19:13:28.186745] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T19:13:28.393564] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-29T19:13:29.193569] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-29T19:13:29.998689] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-29T19:13:30.019542] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-29T19:13:30.358947] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T19:13:30.656496] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T19:13:30.793553] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-29T19:13:31.593564] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-29T19:13:31.959818] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T19:13:32.393553] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-29T19:13:33.107507] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T19:13:33.193546] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-29T19:13:33.607187] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T19:13:33.993620] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-29T19:13:34.672146] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-29T19:13:34.793527] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-29T19:13:35.295477] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T19:13:35.593578] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-29T19:13:36.144979] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T19:13:36.242349] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T19:13:36.393549] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-29T19:13:36.962515] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-29T19:13:37.193595] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-29T19:13:37.993596] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-29T19:13:38.414126] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T19:13:38.519129] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T19:13:38.793568] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-29T19:13:39.593563] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-29T19:13:39.853132] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T19:13:40.393554] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-29T19:13:41.193583] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-29T19:13:41.249236] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-29T19:13:41.639786] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:13:41.993552] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-29T19:13:42.423117] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T19:13:42.793616] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-29T19:13:43.010156] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-29T19:13:43.593573] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-29T19:13:44.316333] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-29T19:13:44.393531] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-29T19:13:44.973784] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T19:13:45.193621] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-29T19:13:45.946069] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-29T19:13:45.965182] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T19:13:45.968110] [INFO ] [REMOTE ] HOV: Full fetch complete (18819 records). [2025-10-29T19:13:45.968215] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-29T19:13:45.998713] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-29T19:13:46.353809] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-29T19:13:46.353883] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-29T19:13:46.354277] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-29T19:13:46.354315] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-29T19:13:46.354856] [DEBUG] [LOCAL ] HOV: Trimmed 18819 records to 13593 (keeping 200 days of data) [2025-10-29T19:13:46.432885] [DEBUG] [LOCAL ] HOV: Primary data saved (13593 records). [2025-10-29T19:13:46.433006] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-29T19:13:46.433082] [INFO ] [MAIN ] Update Progress: 1041/2367 symbols completed. HOV took 24.5s. Estimated remaining: 2h 50m 21s. Rate: 7.8 symbols/min [2025-10-29T19:13:46.598378] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:46.607723] [DEBUG] [LOCAL ] HPF: Loaded 7291 existing records from primary storage. [2025-10-29T19:13:46.607923] [INFO ] [MAIN ] HPF: Loaded 7291 existing records. [2025-10-29T19:13:46.786246] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:46.786468] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-29T19:13:46.786514] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-29T19:13:46.786691] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-29T19:13:46.786746] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-29T19:13:46.799411] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-29T19:13:47.150733] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:47.332589] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T19:13:47.593542] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-29T19:13:48.393557] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-29T19:13:48.700332] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-29T19:13:48.711938] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-29T19:13:48.712071] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-29T19:13:48.918273] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T19:13:49.143604] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-29T19:13:49.143711] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-29T19:13:49.144662] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-29T19:13:49.144724] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-29T19:13:49.146141] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-29T19:13:49.198263] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-29T19:13:49.474053] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-29T19:13:49.474182] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-29T19:13:49.474262] [INFO ] [MAIN ] Update Progress: 1042/2367 symbols completed. HPE took 27.6s. Estimated remaining: 2h 50m 7s. Rate: 7.8 symbols/min [2025-10-29T19:13:49.649193] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:49.685892] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T19:13:49.700998] [DEBUG] [LOCAL ] HPI: Loaded 10492 existing records from primary storage. [2025-10-29T19:13:49.701544] [INFO ] [MAIN ] HPI: Loaded 10492 existing records. [2025-10-29T19:13:49.809785] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-29T19:13:49.896537] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:49.896765] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-29T19:13:49.896816] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-29T19:13:49.896965] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-29T19:13:49.897004] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-29T19:13:49.995596] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-29T19:13:50.245446] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:50.793693] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-29T19:13:51.192091] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-29T19:13:51.249468] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:13:51.593533] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-29T19:13:52.393597] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-29T19:13:52.847277] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T19:13:53.022479] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-29T19:13:53.032729] [INFO ] [REMOTE ] HP: Full fetch complete (74148 records). [2025-10-29T19:13:53.032875] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-29T19:13:53.203960] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-29T19:13:53.422214] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-29T19:13:53.422289] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-29T19:13:53.423219] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-29T19:13:53.423279] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-29T19:13:53.424554] [DEBUG] [LOCAL ] HP: Trimmed 74148 records to 51212 (keeping 200 days of data) [2025-10-29T19:13:53.731689] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-29T19:13:53.740910] [DEBUG] [LOCAL ] HP: Primary data saved (51212 records). [2025-10-29T19:13:53.740989] [INFO ] [MAIN ] HP: Full history saved. [2025-10-29T19:13:53.741057] [INFO ] [MAIN ] Update Progress: 1043/2367 symbols completed. HP took 31.9s. Estimated remaining: 2h 49m 55s. Rate: 7.8 symbols/min [2025-10-29T19:13:53.908552] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:53.954383] [DEBUG] [LOCAL ] HPP: Loaded 51198 existing records from primary storage. [2025-10-29T19:13:53.954687] [INFO ] [MAIN ] HPP: Loaded 51198 existing records. [2025-10-29T19:13:53.998693] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-29T19:13:54.134530] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:54.134768] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-29T19:13:54.134843] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-29T19:13:54.135072] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-29T19:13:54.135148] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-29T19:13:54.501351] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:54.501985] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T19:13:54.793539] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-29T19:13:55.327237] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T19:13:55.593546] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-29T19:13:56.393609] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-29T19:13:56.899081] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T19:13:57.117945] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T19:13:57.129081] [INFO ] [REMOTE ] HOUS: Full fetch complete (64869 records). [2025-10-29T19:13:57.129217] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-29T19:13:57.198815] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-29T19:13:57.524731] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-29T19:13:57.524817] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-29T19:13:57.525701] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-29T19:13:57.525764] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-29T19:13:57.526980] [DEBUG] [LOCAL ] HOUS: Trimmed 64869 records to 45845 (keeping 200 days of data) [2025-10-29T19:13:57.781664] [DEBUG] [LOCAL ] HOUS: Primary data saved (45845 records). [2025-10-29T19:13:57.781824] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-29T19:13:57.781911] [INFO ] [MAIN ] Update Progress: 1044/2367 symbols completed. HOUS took 35.9s. Estimated remaining: 2h 49m 43s. Rate: 7.8 symbols/min [2025-10-29T19:13:57.851088] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-29T19:13:57.956787] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:13:58.004679] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-29T19:13:58.007525] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-29T19:13:58.007881] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-29T19:13:58.184173] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:13:58.184385] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-29T19:13:58.184432] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-29T19:13:58.184681] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-29T19:13:58.184738] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-29T19:13:58.532572] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:13:58.649598] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-29T19:13:58.793555] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-29T19:13:59.593559] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-29T19:14:00.073388] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T19:14:00.133070] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T19:14:00.393561] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-29T19:14:01.193739] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-29T19:14:01.798707] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-29T19:14:01.822247] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-29T19:14:01.993610] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-29T19:14:02.793571] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-29T19:14:03.195168] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T19:14:03.376051] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T19:14:03.593639] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-29T19:14:04.119240] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-29T19:14:04.393567] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-29T19:14:04.897516] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-29T19:14:05.193561] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-29T19:14:05.715268] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-29T19:14:05.717091] [INFO ] [REMOTE ] HPF: Full fetch complete (10302 records). [2025-10-29T19:14:05.717157] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-29T19:14:05.998819] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-29T19:14:06.075191] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-29T19:14:06.075265] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-29T19:14:06.075510] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-29T19:14:06.075547] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-29T19:14:06.076021] [DEBUG] [LOCAL ] HPF: Trimmed 10302 records to 7269 (keeping 200 days of data) [2025-10-29T19:14:06.118805] [DEBUG] [LOCAL ] HPF: Primary data saved (7269 records). [2025-10-29T19:14:06.118920] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-29T19:14:06.118995] [INFO ] [MAIN ] Update Progress: 1045/2367 symbols completed. HPF took 19.7s. Estimated remaining: 2h 49m 36s. Rate: 7.8 symbols/min [2025-10-29T19:14:06.289334] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:14:06.301485] [DEBUG] [LOCAL ] HPS: Loaded 10110 existing records from primary storage. [2025-10-29T19:14:06.301729] [INFO ] [MAIN ] HPS: Loaded 10110 existing records. [2025-10-29T19:14:06.478495] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:14:06.478704] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-29T19:14:06.478763] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-29T19:14:06.479066] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-29T19:14:06.479123] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-29T19:14:06.626359] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T19:14:06.798612] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-29T19:14:06.853020] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:14:07.593569] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-29T19:14:08.227604] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-29T19:14:08.398783] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-29T19:14:08.415374] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-29T19:14:08.960938] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-29T19:14:09.193558] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-29T19:14:09.993548] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-29T19:14:10.420173] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T19:14:10.678032] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-29T19:14:10.793603] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-29T19:14:11.593560] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-29T19:14:12.384639] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-29T19:14:12.385770] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T19:14:12.401455] [INFO ] [REMOTE ] HPI: Full fetch complete (13809 records). [2025-10-29T19:14:12.397866] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-29T19:14:12.403386] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-29T19:14:12.806062] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-29T19:14:12.806146] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-29T19:14:12.806537] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-29T19:14:12.806578] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-29T19:14:12.807078] [DEBUG] [LOCAL ] HPI: Trimmed 13809 records to 10520 (keeping 200 days of data) [2025-10-29T19:14:12.873660] [DEBUG] [LOCAL ] HPI: Primary data saved (10520 records). [2025-10-29T19:14:12.873801] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-29T19:14:12.873884] [INFO ] [MAIN ] Update Progress: 1046/2367 symbols completed. HPI took 23.4s. Estimated remaining: 2h 49m 27s. Rate: 7.8 symbols/min [2025-10-29T19:14:13.056861] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:14:13.085287] [DEBUG] [LOCAL ] HQH: Loaded 25506 existing records from primary storage. [2025-10-29T19:14:13.085634] [INFO ] [MAIN ] HQH: Loaded 25506 existing records. [2025-10-29T19:14:13.198831] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-29T19:14:13.270849] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:14:13.271062] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-29T19:14:13.271111] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-29T19:14:13.271596] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-29T19:14:13.271678] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-29T19:14:13.622411] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:14:13.764423] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T19:14:13.796758] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T19:14:13.993563] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-29T19:14:14.766709] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T19:14:14.793525] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-29T19:14:15.593569] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-29T19:14:15.634562] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T19:14:16.393563] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-29T19:14:17.145031] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-29T19:14:17.169443] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-29T19:14:17.193522] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-29T19:14:17.993531] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-29T19:14:18.077063] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T19:14:18.793550] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-29T19:14:19.590671] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-29T19:14:19.600969] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-29T19:14:19.644445] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-29T19:14:20.156227] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-29T19:14:20.393563] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-29T19:14:21.193558] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-29T19:14:21.932888] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T19:14:21.985881] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-29T19:14:21.996821] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-29T19:14:22.544393] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-29T19:14:22.793564] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-29T19:14:23.593574] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-29T19:14:24.398703] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-29T19:14:24.415548] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-29T19:14:24.784400] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-29T19:14:24.930600] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-29T19:14:25.193585] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-29T19:14:25.993549] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-29T19:14:26.156759] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T19:14:26.793605] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-29T19:14:27.289404] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T19:14:27.405227] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T19:14:27.593562] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-29T19:14:28.393588] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-29T19:14:28.951718] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-29T19:14:29.193554] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-29T19:14:29.957936] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T19:14:29.993525] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-29T19:14:30.040968] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-29T19:14:30.798741] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-29T19:14:30.810770] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T19:14:31.320797] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-29T19:14:31.593591] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-29T19:14:32.393536] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-29T19:14:32.556627] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T19:14:32.562604] [INFO ] [REMOTE ] HQH: Full fetch complete (36765 records). [2025-10-29T19:14:32.562743] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-29T19:14:32.933454] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-29T19:14:32.933538] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-29T19:14:32.934201] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-29T19:14:32.934265] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-29T19:14:32.935273] [DEBUG] [LOCAL ] HQH: Trimmed 36765 records to 25538 (keeping 200 days of data) [2025-10-29T19:14:33.096377] [DEBUG] [LOCAL ] HQH: Primary data saved (25538 records). [2025-10-29T19:14:33.096501] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-29T19:14:33.096579] [INFO ] [MAIN ] Update Progress: 1047/2367 symbols completed. HQH took 20.2s. Estimated remaining: 2h 49m 35s. Rate: 7.8 symbols/min [2025-10-29T19:14:33.195724] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-29T19:14:33.266412] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:14:33.286861] [DEBUG] [LOCAL ] HQL: Loaded 17242 existing records from primary storage. [2025-10-29T19:14:33.287168] [INFO ] [MAIN ] HQL: Loaded 17242 existing records. [2025-10-29T19:14:33.470679] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:14:33.470886] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-29T19:14:33.470933] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-29T19:14:33.471352] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-29T19:14:33.471410] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-29T19:14:33.874925] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:14:33.896389] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-29T19:14:33.905537] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T19:14:33.993543] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-29T19:14:34.736098] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-29T19:14:34.747427] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-29T19:14:34.747618] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-29T19:14:34.802552] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-29T19:14:35.144098] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-29T19:14:35.144201] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-29T19:14:35.145336] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-29T19:14:35.145401] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-29T19:14:35.146949] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-29T19:14:35.466983] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-29T19:14:35.467111] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-29T19:14:35.468202] [INFO ] [MAIN ] Update Progress: 1048/2367 symbols completed. HPQ took 37.7s. Estimated remaining: 2h 49m 21s. Rate: 7.8 symbols/min [2025-10-29T19:14:35.581798] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T19:14:35.596437] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-29T19:14:35.656470] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:14:35.704545] [DEBUG] [LOCAL ] HR: Loaded 52094 existing records from primary storage. [2025-10-29T19:14:35.704849] [INFO ] [MAIN ] HR: Loaded 52094 existing records. [2025-10-29T19:14:35.883779] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:14:35.884035] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-29T19:14:35.884091] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-29T19:14:35.884969] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-29T19:14:35.885025] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-29T19:14:36.234707] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:14:36.393551] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-29T19:14:37.124071] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T19:14:37.193545] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-29T19:14:37.736600] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T19:14:37.993567] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-29T19:14:38.356202] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-29T19:14:38.742072] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T19:14:38.793573] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-29T19:14:39.340808] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-29T19:14:39.593578] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-29T19:14:40.239699] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-29T19:14:40.393604] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-29T19:14:41.193606] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-29T19:14:41.597252] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T19:14:41.865550] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T19:14:41.993550] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-29T19:14:42.669523] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-29T19:14:42.793559] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-29T19:14:43.593550] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-29T19:14:44.125290] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T19:14:44.393568] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-29T19:14:44.929911] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T19:14:44.966143] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T19:14:44.977371] [INFO ] [REMOTE ] HPP: Full fetch complete (73380 records). [2025-10-29T19:14:44.977508] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-29T19:14:45.202416] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-29T19:14:45.386662] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-29T19:14:45.386749] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-29T19:14:45.387701] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-29T19:14:45.387763] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-29T19:14:45.389188] [DEBUG] [LOCAL ] HPP: Trimmed 73380 records to 51213 (keeping 200 days of data) [2025-10-29T19:14:45.675201] [DEBUG] [LOCAL ] HPP: Primary data saved (51213 records). [2025-10-29T19:14:45.675329] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-29T19:14:45.675424] [INFO ] [MAIN ] Update Progress: 1049/2367 symbols completed. HPP took 51.9s. Estimated remaining: 2h 49m 16s. Rate: 7.8 symbols/min [2025-10-29T19:14:45.859734] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:14:45.901517] [DEBUG] [LOCAL ] HRB: Loaded 47981 existing records from primary storage. [2025-10-29T19:14:45.901824] [INFO ] [MAIN ] HRB: Loaded 47981 existing records. [2025-10-29T19:14:46.002030] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-29T19:14:46.082188] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:14:46.082346] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-29T19:14:46.082392] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-29T19:14:46.083221] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-29T19:14:46.083279] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-29T19:14:46.423063] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:14:46.793532] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-29T19:14:46.880117] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-29T19:14:46.900059] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-29T19:14:47.530500] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-29T19:14:47.533004] [INFO ] [REMOTE ] HPS: Full fetch complete (14884 records). [2025-10-29T19:14:47.533073] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-29T19:14:47.598739] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-29T19:14:47.929212] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-29T19:14:47.929297] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-29T19:14:47.929677] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-29T19:14:47.929739] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-29T19:14:47.930223] [DEBUG] [LOCAL ] HPS: Trimmed 14884 records to 10061 (keeping 200 days of data) [2025-10-29T19:14:47.994410] [DEBUG] [LOCAL ] HPS: Primary data saved (10061 records). [2025-10-29T19:14:47.994549] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-29T19:14:47.994628] [INFO ] [MAIN ] Update Progress: 1050/2367 symbols completed. HPS took 41.9s. Estimated remaining: 2h 49m 2s. Rate: 7.8 symbols/min [2025-10-29T19:14:48.192771] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:14:48.224296] [DEBUG] [LOCAL ] HRI: Loaded 32021 existing records from primary storage. [2025-10-29T19:14:48.224571] [INFO ] [MAIN ] HRI: Loaded 32021 existing records. [2025-10-29T19:14:48.398689] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-29T19:14:48.429639] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:14:48.430707] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-29T19:14:48.430784] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-29T19:14:48.431488] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-29T19:14:48.431561] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-29T19:14:48.791972] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:14:48.818433] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T19:14:49.193530] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-29T19:14:49.244855] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-29T19:14:49.993522] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-29T19:14:50.147833] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T19:14:50.793572] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-29T19:14:51.137302] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T19:14:51.393881] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T19:14:51.593573] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-29T19:14:52.393626] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-29T19:14:52.687953] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T19:14:53.193626] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-29T19:14:53.681520] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T19:14:53.851688] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T19:14:53.993551] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-29T19:14:54.793599] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-29T19:14:55.384898] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T19:14:55.593534] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-29T19:14:55.731018] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T19:14:55.736392] [INFO ] [REMOTE ] HQL: Full fetch complete (25495 records). [2025-10-29T19:14:55.736465] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-29T19:14:56.096672] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-29T19:14:56.096757] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-29T19:14:56.097276] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-29T19:14:56.097315] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-29T19:14:56.097975] [DEBUG] [LOCAL ] HQL: Trimmed 25495 records to 17336 (keeping 200 days of data) [2025-10-29T19:14:56.201097] [DEBUG] [LOCAL ] HQL: Primary data saved (17336 records). [2025-10-29T19:14:56.201228] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-29T19:14:56.201311] [INFO ] [MAIN ] Update Progress: 1051/2367 symbols completed. HQL took 23.1s. Estimated remaining: 2h 48m 55s. Rate: 7.8 symbols/min [2025-10-29T19:14:56.368547] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:14:56.395097] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-29T19:14:56.416029] [DEBUG] [LOCAL ] HRL: Loaded 53113 existing records from primary storage. [2025-10-29T19:14:56.416314] [INFO ] [MAIN ] HRL: Loaded 53113 existing records. [2025-10-29T19:14:56.595773] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:14:56.596011] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-29T19:14:56.596060] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-29T19:14:56.596251] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-29T19:14:56.596305] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-29T19:14:56.979182] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:14:57.015085] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-29T19:14:57.193558] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-29T19:14:57.896675] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-29T19:14:57.993590] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-29T19:14:58.530151] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T19:14:58.793551] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-29T19:14:59.377012] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T19:14:59.593561] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-29T19:14:59.661307] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-29T19:15:00.393612] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-29T19:15:01.139417] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T19:15:01.193549] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-29T19:15:01.471579] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-29T19:15:01.993623] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-29T19:15:02.499124] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T19:15:02.793704] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-29T19:15:03.167135] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T19:15:03.593691] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-29T19:15:04.123869] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T19:15:04.393584] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-29T19:15:04.862988] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T19:15:05.129795] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T19:15:05.193536] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-29T19:15:05.993573] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-29T19:15:06.340398] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T19:15:06.793555] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-29T19:15:07.264136] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T19:15:07.593565] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-29T19:15:07.706861] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-29T19:15:08.393574] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-29T19:15:08.780586] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T19:15:09.193563] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-29T19:15:09.695791] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T19:15:09.993537] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-29T19:15:10.165844] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T19:15:10.793552] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-29T19:15:11.598692] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-29T19:15:11.614973] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-29T19:15:12.200897] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-29T19:15:12.393571] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-29T19:15:12.624573] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-29T19:15:12.631506] [INFO ] [REMOTE ] HRI: Full fetch complete (46986 records). [2025-10-29T19:15:12.631705] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-29T19:15:13.010559] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-29T19:15:13.010686] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-29T19:15:13.011402] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-29T19:15:13.011443] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-29T19:15:13.012338] [DEBUG] [LOCAL ] HRI: Trimmed 46986 records to 32045 (keeping 200 days of data) [2025-10-29T19:15:13.195018] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-29T19:15:13.205057] [DEBUG] [LOCAL ] HRI: Primary data saved (32045 records). [2025-10-29T19:15:13.205288] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-29T19:15:13.206022] [INFO ] [MAIN ] Update Progress: 1052/2367 symbols completed. HRI took 25.2s. Estimated remaining: 2h 48m 58s. Rate: 7.8 symbols/min [2025-10-29T19:15:13.373101] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:15:13.406442] [DEBUG] [LOCAL ] HRTG: Loaded 34248 existing records from primary storage. [2025-10-29T19:15:13.406741] [INFO ] [MAIN ] HRTG: Loaded 34248 existing records. [2025-10-29T19:15:13.583550] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:15:13.583753] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-29T19:15:13.583803] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-29T19:15:13.584573] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-29T19:15:13.584629] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-29T19:15:13.947205] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:15:13.977524] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-29T19:15:13.988352] [INFO ] [REMOTE ] HR: Full fetch complete (75088 records). [2025-10-29T19:15:13.988474] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-29T19:15:14.000371] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-29T19:15:14.376876] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-29T19:15:14.376963] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-29T19:15:14.377902] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-29T19:15:14.377967] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-29T19:15:14.379324] [DEBUG] [LOCAL ] HR: Trimmed 75088 records to 52084 (keeping 200 days of data) [2025-10-29T19:15:14.696162] [DEBUG] [LOCAL ] HR: Primary data saved (52084 records). [2025-10-29T19:15:14.696308] [INFO ] [MAIN ] HR: Full history saved. [2025-10-29T19:15:14.696468] [INFO ] [MAIN ] Update Progress: 1053/2367 symbols completed. HR took 39.2s. Estimated remaining: 2h 48m 43s. Rate: 7.8 symbols/min [2025-10-29T19:15:14.796672] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-29T19:15:14.870995] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:15:14.901108] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-29T19:15:14.952456] [DEBUG] [LOCAL ] HSBC: Loaded 50952 existing records from primary storage. [2025-10-29T19:15:14.952768] [INFO ] [MAIN ] HSBC: Loaded 50952 existing records. [2025-10-29T19:15:15.128608] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:15:15.128974] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-29T19:15:15.129022] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-29T19:15:15.129935] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-29T19:15:15.129991] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-29T19:15:15.484740] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:15:15.513930] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-29T19:15:15.551772] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T19:15:15.593516] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-29T19:15:16.393540] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-29T19:15:17.123102] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-29T19:15:17.193550] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-29T19:15:17.993556] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-29T19:15:18.351253] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-29T19:15:18.705982] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-29T19:15:18.793549] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-29T19:15:18.819970] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T19:15:19.593573] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-29T19:15:20.167577] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T19:15:20.393561] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-29T19:15:21.070058] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T19:15:21.080192] [INFO ] [REMOTE ] HRB: Full fetch complete (69826 records). [2025-10-29T19:15:21.080359] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-29T19:15:21.195906] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-29T19:15:21.491344] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T19:15:21.596113] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-29T19:15:21.596235] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-29T19:15:21.597436] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-29T19:15:21.597525] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-29T19:15:21.599432] [DEBUG] [LOCAL ] HRB: Trimmed 69826 records to 47965 (keeping 200 days of data) [2025-10-29T19:15:21.907444] [DEBUG] [LOCAL ] HRB: Primary data saved (47965 records). [2025-10-29T19:15:21.907581] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-29T19:15:21.907680] [INFO ] [MAIN ] Update Progress: 1054/2367 symbols completed. HRB took 36.2s. Estimated remaining: 2h 48m 35s. Rate: 7.8 symbols/min [2025-10-29T19:15:21.998616] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-29T19:15:22.075161] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:15:22.088529] [DEBUG] [LOCAL ] HSHP: Loaded 13903 existing records from primary storage. [2025-10-29T19:15:22.088782] [INFO ] [MAIN ] HSHP: Loaded 13903 existing records. [2025-10-29T19:15:22.263673] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:15:22.263916] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-29T19:15:22.263970] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-29T19:15:22.264350] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-29T19:15:22.264407] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-29T19:15:22.629384] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:15:22.660593] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T19:15:22.793549] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-29T19:15:23.467489] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T19:15:23.540095] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-29T19:15:23.593537] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-29T19:15:24.393608] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-29T19:15:25.057947] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-29T19:15:25.152865] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-29T19:15:25.193556] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-29T19:15:25.993582] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-29T19:15:26.684757] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-29T19:15:26.793557] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-29T19:15:27.351221] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T19:15:27.523015] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T19:15:27.593515] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-29T19:15:28.323799] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-29T19:15:28.393524] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-29T19:15:28.889898] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-29T19:15:29.193598] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-29T19:15:29.993556] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-29T19:15:30.525736] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T19:15:30.793566] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-29T19:15:31.447507] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T19:15:31.588519] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T19:15:31.598759] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-29T19:15:31.601152] [INFO ] [REMOTE ] HRL: Full fetch complete (77030 records). [2025-10-29T19:15:31.601289] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-29T19:15:31.996238] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-29T19:15:31.996313] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-29T19:15:31.997257] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-29T19:15:31.997319] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-29T19:15:31.998677] [DEBUG] [LOCAL ] HRL: Trimmed 77030 records to 53113 (keeping 200 days of data) [2025-10-29T19:15:32.313842] [DEBUG] [LOCAL ] HRL: Primary data saved (53113 records). [2025-10-29T19:15:32.313970] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-29T19:15:32.314043] [INFO ] [MAIN ] Update Progress: 1055/2367 symbols completed. HRL took 36.1s. Estimated remaining: 2h 48m 30s. Rate: 7.8 symbols/min [2025-10-29T19:15:32.398636] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-29T19:15:32.501615] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:15:32.546689] [DEBUG] [LOCAL ] HSY: Loaded 50287 existing records from primary storage. [2025-10-29T19:15:32.546990] [INFO ] [MAIN ] HSY: Loaded 50287 existing records. [2025-10-29T19:15:32.729045] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:15:32.729414] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-29T19:15:32.729553] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-29T19:15:32.735982] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-29T19:15:32.744893] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-29T19:15:32.825083] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T19:15:33.117066] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:15:33.193601] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-29T19:15:33.894616] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-29T19:15:33.945717] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T19:15:33.993681] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-29T19:15:34.793580] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-29T19:15:35.335999] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T19:15:35.593592] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-29T19:15:35.866829] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T19:15:36.393561] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-29T19:15:36.902321] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T19:15:36.935096] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T19:15:37.193606] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-29T19:15:37.848716] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T19:15:37.993547] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-29T19:15:38.629924] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T19:15:38.633471] [INFO ] [REMOTE ] HSHP: Full fetch complete (22911 records). [2025-10-29T19:15:38.633587] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-29T19:15:38.798414] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-29T19:15:39.033538] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-29T19:15:39.033638] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-29T19:15:39.034199] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-29T19:15:39.034262] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-29T19:15:39.034977] [DEBUG] [LOCAL ] HSHP: Trimmed 22911 records to 13889 (keeping 200 days of data) [2025-10-29T19:15:39.116055] [DEBUG] [LOCAL ] HSHP: Primary data saved (13889 records). [2025-10-29T19:15:39.116190] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-29T19:15:39.116268] [INFO ] [MAIN ] Update Progress: 1056/2367 symbols completed. HSHP took 17.2s. Estimated remaining: 2h 48m 21s. Rate: 7.8 symbols/min [2025-10-29T19:15:39.293969] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:15:39.294132] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-29T19:15:39.294171] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-29T19:15:39.294285] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-29T19:15:39.294326] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-29T19:15:39.294367] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-29T19:15:39.294398] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-29T19:15:39.595918] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-29T19:15:39.678755] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:15:40.393602] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-29T19:15:40.608078] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T19:15:40.623326] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-29T19:15:40.623544] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:15:40.624102] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-29T19:15:40.624480] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:15:40.625045] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-29T19:15:40.625866] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-29T19:15:40.631056] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-29T19:15:40.631138] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-29T19:15:40.641979] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-29T19:15:40.642706] [INFO ] [MAIN ] Update Progress: 1057/2367 symbols completed. HTB took 1.5s. Estimated remaining: 2h 48m 6s. Rate: 7.8 symbols/min [2025-10-29T19:15:40.643336] [INFO ] [REMOTE ] HSBC: Full fetch complete (74313 records). [2025-10-29T19:15:40.643625] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-29T19:15:40.920940] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T19:15:41.045741] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:15:41.194236] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-29T19:15:41.266899] [DEBUG] [LOCAL ] HTD: Loaded 14039 existing records from primary storage. [2025-10-29T19:15:41.268700] [INFO ] [MAIN ] HTD: Loaded 14039 existing records. [2025-10-29T19:15:41.371570] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-29T19:15:41.383047] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-29T19:15:41.389346] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-29T19:15:41.408802] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-29T19:15:41.470808] [DEBUG] [LOCAL ] HSBC: Trimmed 74313 records to 50950 (keeping 200 days of data) [2025-10-29T19:15:41.491496] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:15:41.551365] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-29T19:15:41.577599] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-29T19:15:41.579413] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-29T19:15:41.579477] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-29T19:15:41.966833] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:15:42.026183] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-29T19:15:42.159411] [DEBUG] [LOCAL ] HSBC: Primary data saved (50950 records). [2025-10-29T19:15:42.159537] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-29T19:15:42.160513] [INFO ] [MAIN ] Update Progress: 1058/2367 symbols completed. HSBC took 27.5s. Estimated remaining: 2h 47m 51s. Rate: 7.8 symbols/min [2025-10-29T19:15:42.328367] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:15:42.328559] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-29T19:15:42.328596] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-29T19:15:42.328729] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-29T19:15:42.328774] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-29T19:15:42.328814] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-29T19:15:42.328846] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-29T19:15:42.683351] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:15:42.692900] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T19:15:42.725362] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-29T19:15:42.793531] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-29T19:15:43.593539] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-29T19:15:44.317353] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-29T19:15:44.393516] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-29T19:15:44.631070] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-29T19:15:45.193578] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-29T19:15:45.680687] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T19:15:45.717435] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T19:15:45.993604] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-29T19:15:46.200222] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.21 seconds). [2025-10-29T19:15:46.793553] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-29T19:15:47.593527] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-29T19:15:47.769627] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T19:15:48.393563] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-29T19:15:48.929692] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T19:15:49.011811] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T19:15:49.193603] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-29T19:15:49.993557] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-29T19:15:50.581899] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-29T19:15:50.676158] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-29T19:15:50.793547] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-29T19:15:51.284128] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-29T19:15:51.593581] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-29T19:15:51.890601] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T19:15:52.393560] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-29T19:15:52.944734] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-29T19:15:53.193557] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-29T19:15:53.993595] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-29T19:15:54.699233] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-29T19:15:54.793573] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-29T19:15:55.037997] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-29T19:15:55.593549] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-29T19:15:55.859386] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-29T19:15:56.373554] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-29T19:15:56.393585] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-29T19:15:56.650623] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-29T19:15:57.193598] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-29T19:15:57.993617] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-29T19:15:58.528093] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T19:15:58.793581] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-29T19:15:59.105112] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T19:15:59.112409] [INFO ] [REMOTE ] HRTG: Full fetch complete (44524 records). [2025-10-29T19:15:59.112563] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-29T19:15:59.505517] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-29T19:15:59.505593] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-29T19:15:59.506361] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-29T19:15:59.506411] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-29T19:15:59.507351] [DEBUG] [LOCAL ] HRTG: Trimmed 44524 records to 34231 (keeping 200 days of data) [2025-10-29T19:15:59.598689] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-29T19:15:59.705502] [DEBUG] [LOCAL ] HRTG: Primary data saved (34231 records). [2025-10-29T19:15:59.705684] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-29T19:15:59.705779] [INFO ] [MAIN ] Update Progress: 1059/2367 symbols completed. HRTG took 46.5s. Estimated remaining: 2h 47m 55s. Rate: 7.8 symbols/min [2025-10-29T19:15:59.863522] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-29T19:15:59.884707] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:15:59.929133] [DEBUG] [LOCAL ] HTGC: Loaded 47495 existing records from primary storage. [2025-10-29T19:15:59.929435] [INFO ] [MAIN ] HTGC: Loaded 47495 existing records. [2025-10-29T19:16:00.117802] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:16:00.118278] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-29T19:16:00.118429] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-29T19:16:00.118983] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-29T19:16:00.119054] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-29T19:16:00.399478] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-29T19:16:00.417283] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-29T19:16:00.538940] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:16:01.181534] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T19:16:01.193509] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-29T19:16:01.754629] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-29T19:16:01.993563] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-29T19:16:02.240333] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-29T19:16:02.793602] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-29T19:16:02.974346] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.18 seconds). [2025-10-29T19:16:03.593572] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-29T19:16:03.766171] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.17 seconds). [2025-10-29T19:16:04.393592] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-29T19:16:04.617997] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-29T19:16:05.193698] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-29T19:16:05.993547] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-29T19:16:06.331380] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-29T19:16:06.332168] [INFO ] [REMOTE ] HTFC: Full fetch complete (834 records). [2025-10-29T19:16:06.332234] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-29T19:16:06.537759] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-29T19:16:06.538123] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:16:06.538324] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:16:06.538435] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-29T19:16:06.538625] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-29T19:16:06.538755] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-29T19:16:06.538914] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-29T19:16:06.539021] [INFO ] [MAIN ] Update Progress: 1060/2367 symbols completed. HTFC took 24.4s. Estimated remaining: 2h 47m 46s. Rate: 7.8 symbols/min [2025-10-29T19:16:06.706092] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-29T19:16:06.798764] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-29T19:16:06.842094] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:16:06.879955] [DEBUG] [LOCAL ] HTH: Loaded 32136 existing records from primary storage. [2025-10-29T19:16:06.880224] [INFO ] [MAIN ] HTH: Loaded 32136 existing records. [2025-10-29T19:16:07.054527] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:16:07.054799] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-29T19:16:07.054869] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-29T19:16:07.055219] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-29T19:16:07.055314] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-29T19:16:07.413568] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:16:07.443428] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-29T19:16:07.454414] [INFO ] [REMOTE ] HSY: Full fetch complete (73551 records). [2025-10-29T19:16:07.454567] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-29T19:16:07.598685] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-29T19:16:07.852366] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-29T19:16:07.852450] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-29T19:16:07.853391] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-29T19:16:07.853453] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-29T19:16:07.854831] [DEBUG] [LOCAL ] HSY: Trimmed 73551 records to 50310 (keeping 200 days of data) [2025-10-29T19:16:08.196476] [DEBUG] [LOCAL ] HSY: Primary data saved (50310 records). [2025-10-29T19:16:08.196603] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-29T19:16:08.196701] [INFO ] [MAIN ] Update Progress: 1061/2367 symbols completed. HSY took 35.9s. Estimated remaining: 2h 47m 31s. Rate: 7.8 symbols/min [2025-10-29T19:16:08.360773] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:16:08.393215] [DEBUG] [LOCAL ] HUBB: Loaded 35648 existing records from primary storage. [2025-10-29T19:16:08.393468] [INFO ] [MAIN ] HUBB: Loaded 35648 existing records. [2025-10-29T19:16:08.393552] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-29T19:16:08.574052] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:16:08.575383] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-29T19:16:08.575443] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-29T19:16:08.576150] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-29T19:16:08.576208] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-29T19:16:08.953873] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:16:08.977891] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-29T19:16:09.167890] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T19:16:09.193534] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-29T19:16:09.993535] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-29T19:16:10.123463] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T19:16:10.127239] [INFO ] [REMOTE ] HTD: Full fetch complete (19506 records). [2025-10-29T19:16:10.127310] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-29T19:16:10.498712] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-29T19:16:10.498794] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-29T19:16:10.499275] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-29T19:16:10.499313] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-29T19:16:10.499928] [DEBUG] [LOCAL ] HTD: Trimmed 19506 records to 14029 (keeping 200 days of data) [2025-10-29T19:16:10.586011] [DEBUG] [LOCAL ] HTD: Primary data saved (14029 records). [2025-10-29T19:16:10.586145] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-29T19:16:10.586221] [INFO ] [MAIN ] Update Progress: 1062/2367 symbols completed. HTD took 29.9s. Estimated remaining: 2h 47m 17s. Rate: 7.8 symbols/min [2025-10-29T19:16:10.757728] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:16:10.794262] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-29T19:16:10.795832] [DEBUG] [LOCAL ] HUBS: Loaded 39593 existing records from primary storage. [2025-10-29T19:16:10.796065] [INFO ] [MAIN ] HUBS: Loaded 39593 existing records. [2025-10-29T19:16:10.973415] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:16:10.973619] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-29T19:16:10.973696] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-29T19:16:10.973989] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-29T19:16:10.974046] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-29T19:16:11.329680] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:16:11.349104] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T19:16:11.593607] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-29T19:16:12.011536] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T19:16:12.393551] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-29T19:16:12.794062] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T19:16:13.193671] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-29T19:16:13.633489] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T19:16:13.816627] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-29T19:16:13.993536] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-29T19:16:14.793721] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-29T19:16:15.283535] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T19:16:15.593691] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-29T19:16:16.165303] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T19:16:16.393592] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-29T19:16:16.872934] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T19:16:17.193605] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-29T19:16:17.491113] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T19:16:17.993629] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-29T19:16:18.316061] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T19:16:18.793617] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-29T19:16:19.080350] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T19:16:19.593572] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-29T19:16:19.688107] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T19:16:20.393594] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-29T19:16:20.793589] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-29T19:16:21.193631] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-29T19:16:21.492486] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T19:16:21.993637] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-29T19:16:22.433983] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T19:16:22.793548] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-29T19:16:22.879088] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-29T19:16:23.593567] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-29T19:16:23.998378] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T19:16:24.393522] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-29T19:16:24.538813] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-29T19:16:25.193604] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-29T19:16:25.377417] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T19:16:25.993586] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-29T19:16:26.147404] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T19:16:26.793546] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-29T19:16:26.963780] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T19:16:27.593602] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-29T19:16:27.669102] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T19:16:28.393570] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-29T19:16:28.984786] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T19:16:29.193589] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-29T19:16:29.435202] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T19:16:29.993562] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-29T19:16:30.437689] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T19:16:30.444961] [INFO ] [REMOTE ] HUBB: Full fetch complete (54365 records). [2025-10-29T19:16:30.445068] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-29T19:16:30.798751] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-29T19:16:30.853563] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-29T19:16:30.853679] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-29T19:16:30.854569] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-29T19:16:30.854634] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-29T19:16:30.855834] [DEBUG] [LOCAL ] HUBB: Trimmed 54365 records to 35620 (keeping 200 days of data) [2025-10-29T19:16:31.003579] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T19:16:31.120710] [DEBUG] [LOCAL ] HUBB: Primary data saved (35620 records). [2025-10-29T19:16:31.120859] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-29T19:16:31.120941] [INFO ] [MAIN ] Update Progress: 1063/2367 symbols completed. HUBB took 22.9s. Estimated remaining: 2h 47m 25s. Rate: 7.8 symbols/min [2025-10-29T19:16:31.309061] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:16:31.351572] [DEBUG] [LOCAL ] HUM: Loaded 48986 existing records from primary storage. [2025-10-29T19:16:31.351907] [INFO ] [MAIN ] HUM: Loaded 48986 existing records. [2025-10-29T19:16:31.551129] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:16:31.551378] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-29T19:16:31.551426] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-29T19:16:31.551731] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-29T19:16:31.551789] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-29T19:16:31.601033] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-29T19:16:31.949771] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:16:32.114142] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T19:16:32.393587] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-29T19:16:32.667355] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T19:16:33.193559] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-29T19:16:33.730917] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T19:16:33.993549] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-29T19:16:34.417436] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T19:16:34.793556] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-29T19:16:35.136940] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T19:16:35.593597] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-29T19:16:36.003515] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T19:16:36.393540] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-29T19:16:36.521799] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T19:16:37.193576] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-29T19:16:37.590241] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T19:16:37.993551] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-29T19:16:38.125352] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T19:16:38.132213] [INFO ] [REMOTE ] HTH: Full fetch complete (46965 records). [2025-10-29T19:16:38.132339] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-29T19:16:38.519588] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-29T19:16:38.519725] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-29T19:16:38.520499] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-29T19:16:38.520552] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-29T19:16:38.521680] [DEBUG] [LOCAL ] HTH: Trimmed 46965 records to 32164 (keeping 200 days of data) [2025-10-29T19:16:38.708455] [DEBUG] [LOCAL ] HTH: Primary data saved (32164 records). [2025-10-29T19:16:38.708583] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-29T19:16:38.708680] [INFO ] [MAIN ] Update Progress: 1064/2367 symbols completed. HTH took 32.2s. Estimated remaining: 2h 47m 17s. Rate: 7.8 symbols/min [2025-10-29T19:16:38.798689] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-29T19:16:38.878244] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:16:38.928625] [DEBUG] [LOCAL ] HUN: Loaded 53207 existing records from primary storage. [2025-10-29T19:16:38.928980] [INFO ] [MAIN ] HUN: Loaded 53207 existing records. [2025-10-29T19:16:39.110031] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:16:39.110307] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-29T19:16:39.110365] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-29T19:16:39.110855] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-29T19:16:39.110943] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-29T19:16:39.479773] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:16:39.510845] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T19:16:39.520991] [INFO ] [REMOTE ] HUBS: Full fetch complete (57192 records). [2025-10-29T19:16:39.521143] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-29T19:16:39.598839] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-29T19:16:39.948297] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-29T19:16:39.948414] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-29T19:16:39.949483] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-29T19:16:39.949547] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-29T19:16:39.950785] [DEBUG] [LOCAL ] HUBS: Trimmed 57192 records to 39510 (keeping 200 days of data) [2025-10-29T19:16:40.206024] [DEBUG] [LOCAL ] HUBS: Primary data saved (39510 records). [2025-10-29T19:16:40.216393] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-29T19:16:40.216515] [INFO ] [MAIN ] Update Progress: 1065/2367 symbols completed. HUBS took 29.6s. Estimated remaining: 2h 47m 2s. Rate: 7.8 symbols/min [2025-10-29T19:16:40.282503] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-29T19:16:40.397167] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-29T19:16:40.399012] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:16:40.440199] [DEBUG] [LOCAL ] HUYA: Loaded 43540 existing records from primary storage. [2025-10-29T19:16:40.440501] [INFO ] [MAIN ] HUYA: Loaded 43540 existing records. [2025-10-29T19:16:40.615499] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:16:40.615753] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-29T19:16:40.615829] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-29T19:16:40.616103] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-29T19:16:40.616160] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-29T19:16:40.975492] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:16:41.021259] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T19:16:41.193537] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-29T19:16:41.700358] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T19:16:41.993638] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-29T19:16:42.236815] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T19:16:42.793628] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-29T19:16:43.159080] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T19:16:43.593568] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-29T19:16:44.287767] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-29T19:16:44.393580] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-29T19:16:44.712362] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T19:16:45.193765] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-29T19:16:45.432930] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T19:16:45.993566] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-29T19:16:46.750518] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-29T19:16:46.793530] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-29T19:16:47.291057] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T19:16:47.593595] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-29T19:16:48.033446] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T19:16:48.393570] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-29T19:16:48.749787] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T19:16:49.193675] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-29T19:16:49.900086] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-29T19:16:49.910691] [INFO ] [REMOTE ] HTGC: Full fetch complete (68873 records). [2025-10-29T19:16:49.910834] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-29T19:16:50.000920] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-29T19:16:50.329220] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-29T19:16:50.329318] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-29T19:16:50.330266] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-29T19:16:50.330329] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-29T19:16:50.331721] [DEBUG] [LOCAL ] HTGC: Trimmed 68873 records to 47464 (keeping 200 days of data) [2025-10-29T19:16:50.621133] [DEBUG] [LOCAL ] HTGC: Primary data saved (47464 records). [2025-10-29T19:16:50.621512] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-29T19:16:50.621625] [INFO ] [MAIN ] Update Progress: 1066/2367 symbols completed. HTGC took 50.9s. Estimated remaining: 2h 46m 58s. Rate: 7.8 symbols/min [2025-10-29T19:16:50.795578] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-29T19:16:50.799156] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:16:50.816379] [DEBUG] [LOCAL ] HVT: Loaded 14478 existing records from primary storage. [2025-10-29T19:16:50.817231] [INFO ] [MAIN ] HVT: Loaded 14478 existing records. [2025-10-29T19:16:51.082016] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-29T19:16:51.077953] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:16:51.094742] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-29T19:16:51.096587] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-29T19:16:51.097121] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-29T19:16:51.097228] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-29T19:16:51.298590] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T19:16:51.568503] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:16:51.593559] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-29T19:16:52.178250] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T19:16:52.235566] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T19:16:52.393588] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-29T19:16:53.193592] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-29T19:16:53.495137] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T19:16:53.993546] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-29T19:16:54.485791] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T19:16:54.793570] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-29T19:16:55.180906] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T19:16:55.593581] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-29T19:16:56.018068] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T19:16:56.393604] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-29T19:16:56.883376] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T19:16:57.193582] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-29T19:16:57.787251] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T19:16:57.826115] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T19:16:57.993593] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-29T19:16:58.793694] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-29T19:16:59.136113] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-29T19:16:59.592181] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T19:16:59.597050] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-29T19:17:00.393685] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-29T19:17:01.184370] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-29T19:17:01.195133] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-29T19:17:01.409530] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-29T19:17:01.993638] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-29T19:17:02.717854] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T19:17:02.728716] [INFO ] [REMOTE ] HUM: Full fetch complete (71029 records). [2025-10-29T19:17:02.728951] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-29T19:17:02.798773] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-29T19:17:03.191171] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-29T19:17:03.191339] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-29T19:17:03.192378] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-29T19:17:03.192523] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-29T19:17:03.220803] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T19:17:03.219337] [DEBUG] [LOCAL ] HUM: Trimmed 71029 records to 48944 (keeping 200 days of data) [2025-10-29T19:17:03.536563] [DEBUG] [LOCAL ] HUM: Primary data saved (48944 records). [2025-10-29T19:17:03.536734] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-29T19:17:03.536824] [INFO ] [MAIN ] Update Progress: 1067/2367 symbols completed. HUM took 32.4s. Estimated remaining: 2h 46m 56s. Rate: 7.8 symbols/min [2025-10-29T19:17:03.603906] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-29T19:17:03.672168] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-29T19:17:03.734568] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:03.788846] [DEBUG] [LOCAL ] HWM: Loaded 52640 existing records from primary storage. [2025-10-29T19:17:03.789212] [INFO ] [MAIN ] HWM: Loaded 52640 existing records. [2025-10-29T19:17:03.981538] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:17:03.981829] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-29T19:17:03.981881] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-29T19:17:03.982277] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-29T19:17:03.982319] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-29T19:17:04.341326] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:17:04.393570] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-29T19:17:04.978966] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T19:17:05.193601] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-29T19:17:05.841933] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-29T19:17:05.842672] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T19:17:05.993557] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-29T19:17:06.793617] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-29T19:17:07.329834] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T19:17:07.436342] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-29T19:17:07.593600] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-29T19:17:08.393568] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-29T19:17:08.896038] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T19:17:08.916407] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-29T19:17:09.193580] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-29T19:17:09.993597] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-29T19:17:10.646996] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T19:17:10.793599] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-29T19:17:11.311144] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T19:17:11.320790] [INFO ] [REMOTE ] HUYA: Full fetch complete (64101 records). [2025-10-29T19:17:11.320930] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-29T19:17:11.598681] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-29T19:17:11.723827] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-29T19:17:11.723949] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-29T19:17:11.725147] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-29T19:17:11.725226] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-29T19:17:11.726697] [DEBUG] [LOCAL ] HUYA: Trimmed 64101 records to 43549 (keeping 200 days of data) [2025-10-29T19:17:11.968375] [DEBUG] [LOCAL ] HUYA: Primary data saved (43549 records). [2025-10-29T19:17:11.968499] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-29T19:17:11.968574] [INFO ] [MAIN ] Update Progress: 1068/2367 symbols completed. HUYA took 31.8s. Estimated remaining: 2h 46m 50s. Rate: 7.8 symbols/min [2025-10-29T19:17:12.140093] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:12.182182] [DEBUG] [LOCAL ] HXL: Loaded 45798 existing records from primary storage. [2025-10-29T19:17:12.192295] [INFO ] [MAIN ] HXL: Loaded 45798 existing records. [2025-10-29T19:17:12.232470] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-29T19:17:12.393632] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-29T19:17:12.396959] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:17:12.398111] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-29T19:17:12.398187] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-29T19:17:12.422755] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-29T19:17:12.425798] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-29T19:17:12.493997] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-29T19:17:12.806035] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:17:13.193585] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-29T19:17:13.753755] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T19:17:13.993619] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-29T19:17:14.424378] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T19:17:14.661742] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-29T19:17:14.665065] [INFO ] [REMOTE ] HVT: Full fetch complete (22887 records). [2025-10-29T19:17:14.665161] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-29T19:17:14.798691] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-29T19:17:15.040181] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-29T19:17:15.040252] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-29T19:17:15.040757] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-29T19:17:15.040823] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-29T19:17:15.041402] [DEBUG] [LOCAL ] HVT: Trimmed 22887 records to 14472 (keeping 200 days of data) [2025-10-29T19:17:15.125678] [DEBUG] [LOCAL ] HVT: Primary data saved (14472 records). [2025-10-29T19:17:15.125825] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-29T19:17:15.125908] [INFO ] [MAIN ] Update Progress: 1069/2367 symbols completed. HVT took 24.5s. Estimated remaining: 2h 46m 36s. Rate: 7.8 symbols/min [2025-10-29T19:17:15.292165] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:15.302865] [DEBUG] [LOCAL ] HY: Loaded 9548 existing records from primary storage. [2025-10-29T19:17:15.303065] [INFO ] [MAIN ] HY: Loaded 9548 existing records. [2025-10-29T19:17:15.475515] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:17:15.479016] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-29T19:17:15.479073] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-29T19:17:15.479272] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-29T19:17:15.479328] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-29T19:17:15.598800] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-29T19:17:15.829751] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:17:16.230800] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-29T19:17:16.393527] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-29T19:17:17.193529] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-29T19:17:17.271444] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-29T19:17:17.750735] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-29T19:17:17.999310] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-29T19:17:18.014518] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-29T19:17:18.026769] [INFO ] [REMOTE ] HUN: Full fetch complete (77038 records). [2025-10-29T19:17:18.026944] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-29T19:17:18.424123] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-29T19:17:18.424220] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-29T19:17:18.425218] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-29T19:17:18.425278] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-29T19:17:18.426685] [DEBUG] [LOCAL ] HUN: Trimmed 77038 records to 53208 (keeping 200 days of data) [2025-10-29T19:17:18.552481] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T19:17:18.746409] [DEBUG] [LOCAL ] HUN: Primary data saved (53208 records). [2025-10-29T19:17:18.746534] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-29T19:17:18.747468] [INFO ] [MAIN ] Update Progress: 1070/2367 symbols completed. HUN took 40.0s. Estimated remaining: 2h 46m 24s. Rate: 7.8 symbols/min [2025-10-29T19:17:18.800007] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-29T19:17:18.920522] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:18.920720] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-29T19:17:18.920773] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-29T19:17:18.920888] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-29T19:17:18.920930] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-29T19:17:18.920971] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-29T19:17:18.921007] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-29T19:17:19.283626] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:17:19.593608] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-29T19:17:19.804408] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.21 seconds). [2025-10-29T19:17:19.988468] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T19:17:20.393537] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-29T19:17:21.193557] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-29T19:17:21.406967] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-29T19:17:21.677306] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T19:17:21.993554] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-29T19:17:22.793575] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-29T19:17:22.963315] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.17 seconds). [2025-10-29T19:17:23.554324] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-29T19:17:23.593511] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-29T19:17:24.393636] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-29T19:17:24.978776] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-29T19:17:25.193532] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-29T19:17:25.228360] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-29T19:17:25.458990] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-29T19:17:25.993552] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-29T19:17:26.555185] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-29T19:17:26.793550] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-29T19:17:27.158764] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-29T19:17:27.593552] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-29T19:17:28.393554] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-29T19:17:29.082583] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-29T19:17:29.193529] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-29T19:17:29.976139] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-29T19:17:29.993537] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-29T19:17:30.313062] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-29T19:17:30.793569] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-29T19:17:31.007716] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-29T19:17:31.368410] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T19:17:31.593541] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-29T19:17:31.813853] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-29T19:17:32.393549] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-29T19:17:32.696873] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-29T19:17:33.193579] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-29T19:17:33.993572] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-29T19:17:34.187630] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-10-29T19:17:34.446155] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:17:34.793553] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-29T19:17:35.593573] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-29T19:17:35.822027] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-29T19:17:36.169966] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T19:17:36.393579] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-29T19:17:37.193567] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-29T19:17:37.568015] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T19:17:37.653907] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T19:17:37.993546] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-29T19:17:38.291672] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-29T19:17:38.292593] [INFO ] [REMOTE ] HYAC: Full fetch complete (906 records). [2025-10-29T19:17:38.292701] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-29T19:17:38.490045] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-29T19:17:38.490252] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:17:38.490324] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:17:38.490374] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-29T19:17:38.490429] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-29T19:17:38.490465] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-29T19:17:38.490507] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-29T19:17:38.490561] [INFO ] [MAIN ] Update Progress: 1071/2367 symbols completed. HYAC took 19.7s. Estimated remaining: 2h 46m 31s. Rate: 7.8 symbols/min [2025-10-29T19:17:38.668965] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:38.669132] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-29T19:17:38.669172] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-29T19:17:38.669285] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-29T19:17:38.669326] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-29T19:17:38.669368] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-29T19:17:38.669400] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-29T19:17:38.798725] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-29T19:17:39.047549] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:17:39.593629] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-29T19:17:39.969316] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T19:17:40.073740] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T19:17:40.393580] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-29T19:17:40.924967] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T19:17:41.193575] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-29T19:17:41.993551] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-29T19:17:42.638912] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T19:17:42.649194] [INFO ] [REMOTE ] HXL: Full fetch complete (66775 records). [2025-10-29T19:17:42.649338] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-29T19:17:42.804416] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-29T19:17:43.050911] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-29T19:17:43.050993] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-29T19:17:43.051868] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-29T19:17:43.051931] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-29T19:17:43.053201] [DEBUG] [LOCAL ] HXL: Trimmed 66775 records to 45805 (keeping 200 days of data) [2025-10-29T19:17:43.115783] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-29T19:17:43.323534] [DEBUG] [LOCAL ] HXL: Primary data saved (45805 records). [2025-10-29T19:17:43.323719] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-29T19:17:43.323814] [INFO ] [MAIN ] Update Progress: 1072/2367 symbols completed. HXL took 31.4s. Estimated remaining: 2h 46m 19s. Rate: 7.8 symbols/min [2025-10-29T19:17:43.495071] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:43.506902] [DEBUG] [LOCAL ] HYI: Loaded 9430 existing records from primary storage. [2025-10-29T19:17:43.507132] [INFO ] [MAIN ] HYI: Loaded 9430 existing records. [2025-10-29T19:17:43.604010] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-29T19:17:43.697844] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:17:43.698131] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-29T19:17:43.698266] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-29T19:17:43.708461] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-29T19:17:43.722968] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-29T19:17:43.811736] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-29T19:17:43.854317] [INFO ] [REMOTE ] HWM: Full fetch complete (76592 records). [2025-10-29T19:17:43.864992] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-29T19:17:44.350383] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T19:17:44.399342] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-29T19:17:44.463056] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:17:44.565015] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-29T19:17:44.565103] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-29T19:17:44.566226] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-29T19:17:44.566298] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-29T19:17:44.567824] [DEBUG] [LOCAL ] HWM: Trimmed 76592 records to 52628 (keeping 200 days of data) [2025-10-29T19:17:44.670514] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-29T19:17:44.902285] [DEBUG] [LOCAL ] HWM: Primary data saved (52628 records). [2025-10-29T19:17:44.902417] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-29T19:17:44.902492] [INFO ] [MAIN ] Update Progress: 1073/2367 symbols completed. HWM took 41.4s. Estimated remaining: 2h 46m 4s. Rate: 7.8 symbols/min [2025-10-29T19:17:45.094403] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:45.127083] [DEBUG] [LOCAL ] HYT: Loaded 33000 existing records from primary storage. [2025-10-29T19:17:45.127352] [INFO ] [MAIN ] HYT: Loaded 33000 existing records. [2025-10-29T19:17:45.198844] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-29T19:17:45.335180] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:17:45.335410] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-29T19:17:45.335458] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-29T19:17:45.335793] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-29T19:17:45.335851] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-29T19:17:45.728276] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:17:45.860167] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T19:17:45.862446] [INFO ] [REMOTE ] HY: Full fetch complete (14690 records). [2025-10-29T19:17:45.862529] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-29T19:17:45.998619] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-29T19:17:46.220089] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-29T19:17:46.220164] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-29T19:17:46.220470] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-29T19:17:46.220508] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-29T19:17:46.220985] [DEBUG] [LOCAL ] HY: Trimmed 14690 records to 9537 (keeping 200 days of data) [2025-10-29T19:17:46.276101] [DEBUG] [LOCAL ] HY: Primary data saved (9537 records). [2025-10-29T19:17:46.276213] [INFO ] [MAIN ] HY: Full history saved. [2025-10-29T19:17:46.276287] [INFO ] [MAIN ] Update Progress: 1074/2367 symbols completed. HY took 31.2s. Estimated remaining: 2h 45m 49s. Rate: 7.8 symbols/min [2025-10-29T19:17:46.442080] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:46.447215] [DEBUG] [LOCAL ] HYTR: Loaded 3090 existing records from primary storage. [2025-10-29T19:17:46.447364] [INFO ] [MAIN ] HYTR: Loaded 3090 existing records. [2025-10-29T19:17:46.619905] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:17:46.620088] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-29T19:17:46.620134] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-29T19:17:46.620256] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-29T19:17:46.620292] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-29T19:17:46.803753] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-29T19:17:46.973815] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:17:47.047897] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T19:17:47.107739] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-29T19:17:47.593586] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-29T19:17:47.820273] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-29T19:17:48.393610] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-29T19:17:48.901904] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-29T19:17:49.193585] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-29T19:17:49.993582] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-29T19:17:50.079935] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T19:17:50.209762] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-29T19:17:50.793606] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-29T19:17:51.130917] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-29T19:17:51.593595] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-29T19:17:52.056308] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-29T19:17:52.393571] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-29T19:17:52.686822] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-29T19:17:53.193630] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-29T19:17:53.438275] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-29T19:17:53.993576] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-29T19:17:54.207539] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-29T19:17:54.793575] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-29T19:17:55.305980] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T19:17:55.593580] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-29T19:17:55.809961] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-29T19:17:56.393525] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-29T19:17:57.193561] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-29T19:17:57.247210] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T19:17:57.375621] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-10-29T19:17:57.993574] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-29T19:17:58.793569] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-29T19:17:59.130107] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-29T19:17:59.131195] [INFO ] [REMOTE ] HYBX: Full fetch complete (692 records). [2025-10-29T19:17:59.131277] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-29T19:17:59.324812] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-29T19:17:59.325213] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:17:59.325372] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:17:59.325545] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-29T19:17:59.325701] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-29T19:17:59.325776] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-29T19:17:59.326067] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-29T19:17:59.326161] [INFO ] [MAIN ] Update Progress: 1075/2367 symbols completed. HYBX took 20.8s. Estimated remaining: 2h 45m 48s. Rate: 7.8 symbols/min [2025-10-29T19:17:59.458959] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T19:17:59.542059] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:17:59.570407] [DEBUG] [LOCAL ] HZO: Loaded 28055 existing records from primary storage. [2025-10-29T19:17:59.570680] [INFO ] [MAIN ] HZO: Loaded 28055 existing records. [2025-10-29T19:17:59.601565] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-29T19:17:59.758898] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:17:59.759146] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-29T19:17:59.759200] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-29T19:17:59.759373] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-29T19:17:59.759411] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-29T19:18:00.142411] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:18:00.393569] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-29T19:18:00.731676] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T19:18:01.193748] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-29T19:18:01.305434] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-29T19:18:01.569736] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T19:18:01.993565] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-29T19:18:02.351138] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-29T19:18:02.793585] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-29T19:18:03.172207] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-29T19:18:03.593595] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-29T19:18:03.977362] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T19:18:04.393683] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-29T19:18:04.800360] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-29T19:18:05.193602] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-29T19:18:05.993571] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-29T19:18:06.212217] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T19:18:06.372680] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-29T19:18:06.793583] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-29T19:18:07.593635] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-29T19:18:07.983433] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T19:18:08.259553] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T19:18:08.393570] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-29T19:18:08.778569] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-29T19:18:09.193580] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-29T19:18:09.706729] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-29T19:18:09.708100] [INFO ] [REMOTE ] HYTR: Full fetch complete (4717 records). [2025-10-29T19:18:09.708173] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-29T19:18:09.999508] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-29T19:18:10.094179] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-29T19:18:10.094262] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-29T19:18:10.094434] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-29T19:18:10.094474] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-29T19:18:10.095008] [DEBUG] [LOCAL ] HYTR: Trimmed 4717 records to 3083 (keeping 200 days of data) [2025-10-29T19:18:10.114602] [DEBUG] [LOCAL ] HYTR: Primary data saved (3083 records). [2025-10-29T19:18:10.114760] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-29T19:18:10.114848] [INFO ] [MAIN ] Update Progress: 1076/2367 symbols completed. HYTR took 23.8s. Estimated remaining: 2h 45m 44s. Rate: 7.8 symbols/min [2025-10-29T19:18:10.290613] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:18:10.299108] [DEBUG] [LOCAL ] IAE: Loaded 6432 existing records from primary storage. [2025-10-29T19:18:10.299321] [INFO ] [MAIN ] IAE: Loaded 6432 existing records. [2025-10-29T19:18:10.478670] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:18:10.478878] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-29T19:18:10.478925] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-29T19:18:10.479085] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-29T19:18:10.479127] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-29T19:18:10.609427] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-29T19:18:10.798770] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-29T19:18:10.869823] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:18:11.593579] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-29T19:18:11.852793] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T19:18:12.105387] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-29T19:18:12.393613] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-29T19:18:13.193566] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-29T19:18:13.293991] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T19:18:13.685469] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-29T19:18:13.993556] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-29T19:18:14.793561] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-29T19:18:14.905479] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T19:18:15.303928] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T19:18:15.593561] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-29T19:18:16.393563] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-29T19:18:16.728491] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T19:18:16.866409] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-29T19:18:17.193583] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-29T19:18:17.581757] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-29T19:18:17.993563] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-29T19:18:18.793560] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-29T19:18:19.016935] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-29T19:18:19.593551] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-29T19:18:20.016805] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T19:18:20.025292] [INFO ] [REMOTE ] HYT: Full fetch complete (47724 records). [2025-10-29T19:18:20.025433] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-29T19:18:20.396363] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-29T19:18:20.545573] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-29T19:18:20.545880] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-29T19:18:20.546772] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-29T19:18:20.546852] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-29T19:18:20.563848] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-29T19:18:20.563066] [DEBUG] [LOCAL ] HYT: Trimmed 47724 records to 32893 (keeping 200 days of data) [2025-10-29T19:18:20.790135] [DEBUG] [LOCAL ] HYT: Primary data saved (32893 records). [2025-10-29T19:18:20.790272] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-29T19:18:20.790356] [INFO ] [MAIN ] Update Progress: 1077/2367 symbols completed. HYT took 35.9s. Estimated remaining: 2h 45m 40s. Rate: 7.8 symbols/min [2025-10-29T19:18:20.915748] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T19:18:21.193557] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-29T19:18:21.978232] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-29T19:18:21.993529] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-29T19:18:22.793638] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-29T19:18:22.932241] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T19:18:23.165992] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-29T19:18:23.593564] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-29T19:18:24.393588] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-29T19:18:24.482714] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T19:18:24.822430] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-29T19:18:25.193591] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-29T19:18:25.993553] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-29T19:18:26.040702] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-29T19:18:26.415579] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-29T19:18:26.793558] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-29T19:18:27.593573] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-29T19:18:27.817859] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T19:18:27.823495] [INFO ] [REMOTE ] HZO: Full fetch complete (41339 records). [2025-10-29T19:18:27.823604] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-29T19:18:28.057553] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-29T19:18:28.218996] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-29T19:18:28.219080] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-29T19:18:28.219929] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-29T19:18:28.219993] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-29T19:18:28.220953] [DEBUG] [LOCAL ] HZO: Trimmed 41339 records to 27982 (keeping 200 days of data) [2025-10-29T19:18:28.381246] [DEBUG] [LOCAL ] HZO: Primary data saved (27982 records). [2025-10-29T19:18:28.381372] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-29T19:18:28.381468] [INFO ] [MAIN ] Update Progress: 1078/2367 symbols completed. HZO took 29.0s. Estimated remaining: 2h 45m 32s. Rate: 7.8 symbols/min [2025-10-29T19:18:28.393608] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-29T19:18:29.113559] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-29T19:18:29.116795] [INFO ] [REMOTE ] HYI: Full fetch complete (14081 records). [2025-10-29T19:18:29.116931] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-29T19:18:29.200812] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-29T19:18:29.521226] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-29T19:18:29.521332] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-29T19:18:29.521889] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-29T19:18:29.521955] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-29T19:18:29.522677] [DEBUG] [LOCAL ] HYI: Trimmed 14081 records to 9472 (keeping 200 days of data) [2025-10-29T19:18:29.596739] [DEBUG] [LOCAL ] HYI: Primary data saved (9472 records). [2025-10-29T19:18:29.597153] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-29T19:18:29.597271] [INFO ] [MAIN ] Update Progress: 1079/2367 symbols completed. HYI took 46.3s. Estimated remaining: 2h 45m 16s. Rate: 7.8 symbols/min [2025-10-29T19:18:29.684144] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T19:18:29.993552] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-29T19:18:30.431264] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-29T19:18:30.793610] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-29T19:18:31.374524] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-29T19:18:31.593561] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-29T19:18:32.362700] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T19:18:32.365142] [INFO ] [REMOTE ] IAE: Full fetch complete (9213 records). [2025-10-29T19:18:32.365219] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-29T19:18:32.746290] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-29T19:18:32.746382] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-29T19:18:32.746784] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-29T19:18:32.746862] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-29T19:18:32.747724] [DEBUG] [LOCAL ] IAE: Trimmed 9213 records to 6480 (keeping 200 days of data) [2025-10-29T19:18:32.786303] [DEBUG] [LOCAL ] IAE: Primary data saved (6480 records). [2025-10-29T19:18:32.786436] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-29T19:18:32.786512] [INFO ] [MAIN ] Update Progress: 1080/2367 symbols completed. IAE took 22.7s. Estimated remaining: 2h 45m 3s. Rate: 7.8 symbols/min [2025-10-29T19:18:33.350010] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:18:33.477175] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:18:33.556216] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:18:33.560295] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:18:33.649916] [DEBUG] [LOCAL ] IBP: Loaded 28152 existing records from primary storage. [2025-10-29T19:18:33.651756] [INFO ] [MAIN ] IBP: Loaded 28152 existing records. [2025-10-29T19:18:33.651321] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-29T19:18:33.695266] [INFO ] [MAIN ] IAG: Loaded 53492 existing records. [2025-10-29T19:18:33.793766] [DEBUG] [LOCAL ] IBN: Loaded 52793 existing records from primary storage. [2025-10-29T19:18:33.830001] [INFO ] [MAIN ] IBN: Loaded 52793 existing records. [2025-10-29T19:18:33.842372] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-29T19:18:33.893529] [INFO ] [MAIN ] IBM: Loaded 53628 existing records. [2025-10-29T19:18:34.355868] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:18:34.388024] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:18:34.295570] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:18:34.406898] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-29T19:18:34.417448] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-29T19:18:34.428166] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-29T19:18:34.442639] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-29T19:18:34.448046] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:18:34.445054] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-29T19:18:34.442860] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-29T19:18:34.448628] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-29T19:18:34.448791] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-29T19:18:34.448594] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-29T19:18:34.448977] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-29T19:18:34.454440] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-29T19:18:34.454634] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-29T19:18:34.459904] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-29T19:18:34.460021] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-29T19:18:34.535756] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-29T19:18:34.555186] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-29T19:18:35.717952] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:18:35.733726] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-29T19:18:35.923855] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:18:35.962340] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-29T19:18:36.027824] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:18:36.059875] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:18:36.060387] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-29T19:18:36.060772] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-29T19:18:36.580067] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-29T19:18:36.585255] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-29T19:18:37.360296] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-29T19:18:37.370626] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-29T19:18:37.445214] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T19:18:37.452497] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-29T19:18:37.485064] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-29T19:18:37.530221] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T19:18:37.993579] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-29T19:18:38.460673] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T19:18:38.805353] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-29T19:18:38.813219] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-29T19:18:39.230321] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-29T19:18:39.593592] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-29T19:18:40.238364] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-29T19:18:40.393579] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-29T19:18:41.041638] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T19:18:41.193624] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-29T19:18:41.993568] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-29T19:18:42.174884] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-29T19:18:42.278902] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T19:18:42.793590] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-29T19:18:43.329546] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T19:18:43.593578] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-29T19:18:44.364429] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-29T19:18:44.393527] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-29T19:18:45.021254] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-29T19:18:45.193577] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-29T19:18:45.751110] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-29T19:18:45.993552] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-29T19:18:46.798784] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-29T19:18:46.810250] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-29T19:18:46.853633] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-29T19:18:47.593564] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-29T19:18:48.297242] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-29T19:18:48.393544] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-29T19:18:48.463809] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-29T19:18:49.193570] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-29T19:18:49.924100] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-29T19:18:49.993539] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-29T19:18:50.048560] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-29T19:18:50.793588] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-29T19:18:51.511087] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-29T19:18:51.593613] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-29T19:18:51.776501] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T19:18:52.393631] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-29T19:18:53.040083] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-29T19:18:53.193619] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-29T19:18:53.230035] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T19:18:53.993540] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-29T19:18:54.793554] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-29T19:18:55.069861] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-29T19:18:55.598676] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-29T19:18:55.614859] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-29T19:18:55.844214] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T19:18:56.393566] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-29T19:18:57.193559] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-29T19:18:57.665682] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-29T19:18:57.788818] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-29T19:18:57.983884] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T19:18:57.989495] [INFO ] [REMOTE ] IBP: Full fetch complete (41127 records). [2025-10-29T19:18:57.989597] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-29T19:18:58.000740] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-29T19:18:58.354788] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-29T19:18:58.354862] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-29T19:18:58.355496] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-29T19:18:58.355534] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-29T19:18:58.356363] [DEBUG] [LOCAL ] IBP: Trimmed 41127 records to 28038 (keeping 200 days of data) [2025-10-29T19:18:58.524187] [DEBUG] [LOCAL ] IBP: Primary data saved (28038 records). [2025-10-29T19:18:58.524306] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-29T19:18:58.524382] [INFO ] [MAIN ] Update Progress: 1081/2367 symbols completed. IBP took 25.7s. Estimated remaining: 2h 45m 17s. Rate: 7.8 symbols/min [2025-10-29T19:18:58.690796] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:18:58.722327] [DEBUG] [LOCAL ] IBTA: Loaded 35416 existing records from primary storage. [2025-10-29T19:18:58.722580] [INFO ] [MAIN ] IBTA: Loaded 35416 existing records. [2025-10-29T19:18:58.799884] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-29T19:18:58.902635] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:18:58.902836] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-29T19:18:58.902883] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-29T19:18:58.903057] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-29T19:18:58.903095] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-29T19:18:59.246861] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:18:59.593579] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-29T19:18:59.939973] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-29T19:19:00.385913] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-29T19:19:00.396497] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-29T19:19:00.495484] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T19:19:01.193601] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-29T19:19:01.840568] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T19:19:01.993520] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-29T19:19:02.793626] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-29T19:19:03.162144] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-29T19:19:03.173702] [INFO ] [REMOTE ] IAG: Full fetch complete (77537 records). [2025-10-29T19:19:03.173831] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-29T19:19:03.604882] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-29T19:19:03.604630] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-29T19:19:03.605239] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-29T19:19:03.608816] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-29T19:19:03.607412] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-29T19:19:03.619677] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-29T19:19:03.622568] [DEBUG] [LOCAL ] IAG: Trimmed 77537 records to 53492 (keeping 200 days of data) [2025-10-29T19:19:03.933164] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-29T19:19:03.933328] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-29T19:19:03.933420] [INFO ] [MAIN ] Update Progress: 1082/2367 symbols completed. IAG took 31.1s. Estimated remaining: 2h 45m 6s. Rate: 7.8 symbols/min [2025-10-29T19:19:04.104804] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:19:04.156623] [DEBUG] [LOCAL ] ICE: Loaded 53007 existing records from primary storage. [2025-10-29T19:19:04.156959] [INFO ] [MAIN ] ICE: Loaded 53007 existing records. [2025-10-29T19:19:04.347179] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:19:04.347378] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-29T19:19:04.347425] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-29T19:19:04.347616] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-29T19:19:04.347719] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-29T19:19:04.411017] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-29T19:19:04.720768] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:19:04.734359] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T19:19:04.772724] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-29T19:19:05.193607] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-29T19:19:05.993539] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-29T19:19:06.185716] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-29T19:19:06.198986] [INFO ] [REMOTE ] IBN: Full fetch complete (76668 records). [2025-10-29T19:19:06.199220] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-29T19:19:06.511421] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T19:19:06.676266] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-29T19:19:06.676387] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-29T19:19:06.677713] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-29T19:19:06.677783] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-29T19:19:06.680841] [DEBUG] [LOCAL ] IBN: Trimmed 76668 records to 52787 (keeping 200 days of data) [2025-10-29T19:19:06.799715] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-29T19:19:07.038059] [DEBUG] [LOCAL ] IBN: Primary data saved (52787 records). [2025-10-29T19:19:07.038427] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-29T19:19:07.038679] [INFO ] [MAIN ] Update Progress: 1083/2367 symbols completed. IBN took 34.2s. Estimated remaining: 2h 44m 53s. Rate: 7.8 symbols/min [2025-10-29T19:19:07.222416] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:19:07.255132] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T19:19:07.299024] [DEBUG] [LOCAL ] ICL: Loaded 37606 existing records from primary storage. [2025-10-29T19:19:07.299384] [INFO ] [MAIN ] ICL: Loaded 37606 existing records. [2025-10-29T19:19:07.484921] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:19:07.485205] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-29T19:19:07.485257] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-29T19:19:07.485802] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-29T19:19:07.485867] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-29T19:19:07.598786] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-29T19:19:07.873201] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:19:08.252104] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T19:19:08.393559] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-29T19:19:09.193529] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-29T19:19:09.239855] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-29T19:19:09.428528] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T19:19:09.993619] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-29T19:19:10.793564] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-29T19:19:11.149168] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T19:19:11.447121] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-29T19:19:11.458376] [INFO ] [REMOTE ] IBM: Full fetch complete (77745 records). [2025-10-29T19:19:11.458521] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-29T19:19:11.598732] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-29T19:19:11.858528] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-29T19:19:11.858601] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-29T19:19:11.859566] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-29T19:19:11.859629] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-29T19:19:11.861018] [DEBUG] [LOCAL ] IBM: Trimmed 77745 records to 53628 (keeping 200 days of data) [2025-10-29T19:19:12.199402] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-29T19:19:12.199549] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-29T19:19:12.199797] [INFO ] [MAIN ] Update Progress: 1084/2367 symbols completed. IBM took 39.4s. Estimated remaining: 2h 44m 43s. Rate: 7.8 symbols/min [2025-10-29T19:19:12.377160] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:19:12.377438] [DEBUG] [LOCAL ] IDA: No existing data file found in primary storage. [2025-10-29T19:19:12.377509] [WARN ] [MAIN ] IDA: No existing data found, performing full refresh instead. [2025-10-29T19:19:12.377734] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-29T19:19:12.377843] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-29T19:19:12.377967] [DEBUG] [LOCAL ] IDA: No primary data file found to delete. [2025-10-29T19:19:12.378097] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-29T19:19:12.408925] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-29T19:19:12.678269] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-29T19:19:12.803431] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:19:12.823527] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T19:19:13.193523] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-29T19:19:13.270564] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T19:19:13.993607] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-29T19:19:14.281462] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T19:19:14.793537] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-29T19:19:14.925305] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T19:19:15.593570] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-29T19:19:16.187287] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T19:19:16.393545] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-29T19:19:16.495759] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T19:19:17.193564] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-29T19:19:17.787496] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T19:19:17.993575] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-29T19:19:18.098098] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T19:19:18.793571] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-29T19:19:19.090300] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-29T19:19:19.593626] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-29T19:19:19.803521] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-29T19:19:20.393578] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-29T19:19:20.945298] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T19:19:21.193548] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-29T19:19:21.457562] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T19:19:21.993583] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-29T19:19:22.512073] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T19:19:22.793545] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-29T19:19:23.004762] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T19:19:23.593605] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-29T19:19:23.886873] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T19:19:24.393580] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-29T19:19:24.873756] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:19:25.193560] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-29T19:19:25.426156] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-29T19:19:25.993574] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-29T19:19:26.591934] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T19:19:26.793559] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-29T19:19:26.883703] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T19:19:27.593559] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-29T19:19:27.905150] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-29T19:19:27.912757] [INFO ] [REMOTE ] IBTA: Full fetch complete (51144 records). [2025-10-29T19:19:27.912964] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-29T19:19:28.317208] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-29T19:19:28.317324] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-29T19:19:28.318471] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-29T19:19:28.318536] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-29T19:19:28.319940] [DEBUG] [LOCAL ] IBTA: Trimmed 51144 records to 35293 (keeping 200 days of data) [2025-10-29T19:19:28.408001] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-29T19:19:28.551994] [DEBUG] [LOCAL ] IBTA: Primary data saved (35293 records). [2025-10-29T19:19:28.552363] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-29T19:19:28.552512] [INFO ] [MAIN ] Update Progress: 1085/2367 symbols completed. IBTA took 30.0s. Estimated remaining: 2h 44m 45s. Rate: 7.8 symbols/min [2025-10-29T19:19:28.729091] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T19:19:28.786087] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:19:28.800882] [DEBUG] [LOCAL ] IDE: Loaded 9108 existing records from primary storage. [2025-10-29T19:19:28.801204] [INFO ] [MAIN ] IDE: Loaded 9108 existing records. [2025-10-29T19:19:28.988048] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:19:28.988410] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-29T19:19:28.988462] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-29T19:19:28.988702] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-29T19:19:28.988761] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-29T19:19:29.198735] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-29T19:19:29.344891] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:19:29.489089] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T19:19:29.993555] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-29T19:19:30.462373] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T19:19:30.793590] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-29T19:19:31.061357] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T19:19:31.593575] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-29T19:19:31.734485] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T19:19:32.393586] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-29T19:19:33.193559] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-29T19:19:33.275682] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-29T19:19:33.287453] [INFO ] [REMOTE ] ICE: Full fetch complete (77025 records). [2025-10-29T19:19:33.287678] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-29T19:19:33.586268] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-29T19:19:33.755698] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-29T19:19:33.755822] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-29T19:19:33.756959] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-29T19:19:33.757062] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-29T19:19:33.758858] [DEBUG] [LOCAL ] ICE: Trimmed 77025 records to 53008 (keeping 200 days of data) [2025-10-29T19:19:33.856042] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-29T19:19:33.993754] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-29T19:19:34.097452] [DEBUG] [LOCAL ] ICE: Primary data saved (53008 records). [2025-10-29T19:19:34.097588] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-29T19:19:34.097689] [INFO ] [MAIN ] Update Progress: 1086/2367 symbols completed. ICE took 30.2s. Estimated remaining: 2h 44m 35s. Rate: 7.8 symbols/min [2025-10-29T19:19:34.269522] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:19:34.287670] [DEBUG] [LOCAL ] IDT: Loaded 18480 existing records from primary storage. [2025-10-29T19:19:34.287912] [INFO ] [MAIN ] IDT: Loaded 18480 existing records. [2025-10-29T19:19:34.467505] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:19:34.467764] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-29T19:19:34.467814] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-29T19:19:34.468005] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-29T19:19:34.468059] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-29T19:19:34.793925] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-29T19:19:34.814076] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:19:35.309258] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T19:19:35.317246] [INFO ] [REMOTE ] ICL: Full fetch complete (55555 records). [2025-10-29T19:19:35.317400] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-29T19:19:35.594389] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-29T19:19:35.744567] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-29T19:19:35.744710] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-29T19:19:35.745885] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-29T19:19:35.745970] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-29T19:19:35.764671] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T19:19:35.771302] [DEBUG] [LOCAL ] ICL: Trimmed 55555 records to 37515 (keeping 200 days of data) [2025-10-29T19:19:35.981676] [DEBUG] [LOCAL ] ICL: Primary data saved (37515 records). [2025-10-29T19:19:35.981817] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-29T19:19:35.981899] [INFO ] [MAIN ] Update Progress: 1087/2367 symbols completed. ICL took 28.9s. Estimated remaining: 2h 44m 20s. Rate: 7.8 symbols/min [2025-10-29T19:19:36.153497] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:19:36.163205] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T19:19:36.200627] [DEBUG] [LOCAL ] IEX: Loaded 37974 existing records from primary storage. [2025-10-29T19:19:36.200927] [INFO ] [MAIN ] IEX: Loaded 37974 existing records. [2025-10-29T19:19:36.376158] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:19:36.376422] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-29T19:19:36.376471] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-29T19:19:36.376840] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-29T19:19:36.376897] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-29T19:19:36.398692] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-29T19:19:36.748899] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:19:37.193575] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-29T19:19:37.278631] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-29T19:19:37.669322] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-29T19:19:37.993557] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-29T19:19:38.647793] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-29T19:19:38.793591] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-29T19:19:39.481624] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-29T19:19:39.593572] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-29T19:19:40.198402] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T19:19:40.393559] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-29T19:19:41.193616] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-29T19:19:41.471370] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-29T19:19:41.887714] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T19:19:41.993562] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-29T19:19:42.705807] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T19:19:42.793531] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-29T19:19:43.399805] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-29T19:19:43.593547] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-29T19:19:44.284550] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T19:19:44.393538] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-29T19:19:44.859261] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-29T19:19:45.193564] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-29T19:19:45.993559] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-29T19:19:46.336408] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-29T19:19:46.343394] [INFO ] [REMOTE ] IDA: Full fetch complete (45383 records). [2025-10-29T19:19:46.343500] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-29T19:19:46.738797] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-29T19:19:46.739013] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-29T19:19:46.739859] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-29T19:19:46.739941] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-29T19:19:46.741115] [DEBUG] [LOCAL ] IDA: Trimmed 45383 records to 32552 (keeping 200 days of data) [2025-10-29T19:19:46.794476] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-29T19:19:46.882602] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-29T19:19:46.925984] [INFO ] [REMOTE ] IDT: Full fetch complete (24303 records). [2025-10-29T19:19:46.926333] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-29T19:19:47.043024] [DEBUG] [LOCAL ] IDA: Primary data saved (32552 records). [2025-10-29T19:19:47.059586] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-29T19:19:47.070522] [INFO ] [MAIN ] Update Progress: 1088/2367 symbols completed. IDA took 34.9s. Estimated remaining: 2h 44m 17s. Rate: 7.8 symbols/min [2025-10-29T19:19:47.308448] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T19:19:47.461397] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:19:47.550561] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-29T19:19:47.550698] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-29T19:19:47.551430] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-29T19:19:47.551493] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-29T19:19:47.552919] [DEBUG] [LOCAL ] IDT: Trimmed 24303 records to 18487 (keeping 200 days of data) [2025-10-29T19:19:47.602029] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-29T19:19:47.691449] [DEBUG] [LOCAL ] IDT: Primary data saved (18487 records). [2025-10-29T19:19:47.691721] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-29T19:19:47.691827] [INFO ] [MAIN ] Update Progress: 1089/2367 symbols completed. IDT took 13.6s. Estimated remaining: 2h 44m 1s. Rate: 7.8 symbols/min [2025-10-29T19:19:47.853141] [DEBUG] [LOCAL ] IFF: Loaded 51191 existing records from primary storage. [2025-10-29T19:19:47.868059] [INFO ] [MAIN ] IFF: Loaded 51191 existing records. [2025-10-29T19:19:47.932260] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:19:48.097577] [DEBUG] [LOCAL ] IFN: Loaded 18129 existing records from primary storage. [2025-10-29T19:19:48.105720] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:19:48.106258] [INFO ] [MAIN ] IFN: Loaded 18129 existing records. [2025-10-29T19:19:48.106480] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-29T19:19:48.127742] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-29T19:19:48.151123] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-29T19:19:48.177789] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-29T19:19:48.396962] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-29T19:19:48.412214] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-29T19:19:48.457822] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:19:48.469125] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-29T19:19:48.476586] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-29T19:19:48.493423] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-29T19:19:48.494197] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-29T19:19:48.883391] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:19:49.061572] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:19:49.193582] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-29T19:19:49.445629] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T19:19:49.863944] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T19:19:49.993585] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-29T19:19:50.701937] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T19:19:50.793560] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-29T19:19:51.551574] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T19:19:51.593700] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-29T19:19:52.309426] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T19:19:52.393565] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-29T19:19:53.048784] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-29T19:19:53.193563] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-29T19:19:53.993564] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-29T19:19:54.290846] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T19:19:54.613898] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-29T19:19:54.793584] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-29T19:19:55.303097] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-29T19:19:55.593552] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-29T19:19:56.393581] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-29T19:19:56.751805] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T19:19:56.973001] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-29T19:19:57.193615] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-29T19:19:57.904606] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T19:19:57.993606] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-29T19:19:58.793556] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-29T19:19:59.085676] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T19:19:59.593598] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-29T19:20:00.095820] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T19:20:00.393571] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-29T19:20:00.789855] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T19:20:00.963997] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-29T19:20:01.193558] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-29T19:20:01.993628] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-29T19:20:02.151381] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-29T19:20:02.629998] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T19:20:02.793589] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-29T19:20:03.491485] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T19:20:03.593547] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-29T19:20:04.122373] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T19:20:04.393604] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-29T19:20:05.164223] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T19:20:05.169200] [INFO ] [REMOTE ] IFN: Full fetch complete (27795 records). [2025-10-29T19:20:05.169379] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-29T19:20:05.198832] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-29T19:20:05.544405] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-29T19:20:05.544484] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-29T19:20:05.545058] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-29T19:20:05.545118] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-29T19:20:05.545870] [DEBUG] [LOCAL ] IFN: Trimmed 27795 records to 18079 (keeping 200 days of data) [2025-10-29T19:20:05.655698] [DEBUG] [LOCAL ] IFN: Primary data saved (18079 records). [2025-10-29T19:20:05.655835] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-29T19:20:05.655915] [INFO ] [MAIN ] Update Progress: 1090/2367 symbols completed. IFN took 18.0s. Estimated remaining: 2h 44m 5s. Rate: 7.8 symbols/min [2025-10-29T19:20:05.823432] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:20:05.843866] [DEBUG] [LOCAL ] IFS: Loaded 21632 existing records from primary storage. [2025-10-29T19:20:05.844099] [INFO ] [MAIN ] IFS: Loaded 21632 existing records. [2025-10-29T19:20:05.994763] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-29T19:20:06.022385] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:20:06.022705] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-29T19:20:06.022775] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-29T19:20:06.022993] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-29T19:20:06.023040] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-29T19:20:06.131715] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-29T19:20:06.161336] [INFO ] [REMOTE ] IDE: Full fetch complete (12761 records). [2025-10-29T19:20:06.186680] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-29T19:20:06.684402] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:20:06.795664] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-29T19:20:06.805195] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-29T19:20:06.805277] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-29T19:20:06.805617] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-29T19:20:06.805716] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-29T19:20:06.806239] [DEBUG] [LOCAL ] IDE: Trimmed 12761 records to 9139 (keeping 200 days of data) [2025-10-29T19:20:06.860286] [DEBUG] [LOCAL ] IDE: Primary data saved (9139 records). [2025-10-29T19:20:06.860403] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-29T19:20:06.860480] [INFO ] [MAIN ] Update Progress: 1091/2367 symbols completed. IDE took 38.3s. Estimated remaining: 2h 43m 50s. Rate: 7.8 symbols/min [2025-10-29T19:20:07.026480] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:20:07.037493] [DEBUG] [LOCAL ] IGA: Loaded 9667 existing records from primary storage. [2025-10-29T19:20:07.037733] [INFO ] [MAIN ] IGA: Loaded 9667 existing records. [2025-10-29T19:20:07.217211] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:20:07.217793] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-29T19:20:07.217921] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-29T19:20:07.218112] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-29T19:20:07.218183] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-29T19:20:07.581545] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:20:07.598127] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-29T19:20:07.612273] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-29T19:20:07.636374] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T19:20:08.393612] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-29T19:20:08.690804] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T19:20:09.106377] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-29T19:20:09.193532] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-29T19:20:09.993563] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-29T19:20:10.317509] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T19:20:10.793542] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-29T19:20:11.369582] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T19:20:11.593591] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-29T19:20:11.989956] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T19:20:12.393560] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-29T19:20:12.818375] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-29T19:20:13.113344] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T19:20:13.193512] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-29T19:20:13.844714] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-29T19:20:13.993606] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-29T19:20:14.793587] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-29T19:20:15.071391] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-29T19:20:15.593558] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-29T19:20:16.076962] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T19:20:16.097307] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-29T19:20:16.393607] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-29T19:20:17.193585] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-29T19:20:17.579936] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T19:20:17.589254] [INFO ] [REMOTE ] IEX: Full fetch complete (54021 records). [2025-10-29T19:20:17.589488] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-29T19:20:17.996967] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-29T19:20:18.000265] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-29T19:20:18.000582] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-29T19:20:18.001745] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-29T19:20:18.001827] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-29T19:20:18.004142] [DEBUG] [LOCAL ] IEX: Trimmed 54021 records to 38044 (keeping 200 days of data) [2025-10-29T19:20:18.165841] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-29T19:20:18.296146] [DEBUG] [LOCAL ] IEX: Primary data saved (38044 records). [2025-10-29T19:20:18.296349] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-29T19:20:18.296449] [INFO ] [MAIN ] Update Progress: 1092/2367 symbols completed. IEX took 42.3s. Estimated remaining: 2h 43m 46s. Rate: 7.8 symbols/min [2025-10-29T19:20:18.477230] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:20:18.499692] [DEBUG] [LOCAL ] IGD: Loaded 19113 existing records from primary storage. [2025-10-29T19:20:18.500029] [INFO ] [MAIN ] IGD: Loaded 19113 existing records. [2025-10-29T19:20:18.622150] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-29T19:20:18.701549] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:20:18.701827] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-29T19:20:18.701876] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-29T19:20:18.702101] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-29T19:20:18.702162] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-29T19:20:18.798701] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-29T19:20:19.051859] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:20:19.536470] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-29T19:20:19.593514] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-29T19:20:20.393530] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-29T19:20:20.465142] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T19:20:20.879572] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-29T19:20:21.193544] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-29T19:20:21.893115] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-29T19:20:21.993542] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-29T19:20:22.755415] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T19:20:22.793537] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-29T19:20:23.593560] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-29T19:20:23.643390] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-29T19:20:24.163598] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-29T19:20:24.393638] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-29T19:20:25.193532] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-29T19:20:25.260521] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-29T19:20:25.993558] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-29T19:20:26.384395] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T19:20:26.460494] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T19:20:26.793556] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-29T19:20:27.593564] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-29T19:20:28.149673] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T19:20:28.337157] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-29T19:20:28.393541] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-29T19:20:29.110386] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-29T19:20:29.193559] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-29T19:20:29.993524] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-29T19:20:30.062592] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T19:20:30.066947] [INFO ] [REMOTE ] IFS: Full fetch complete (32349 records). [2025-10-29T19:20:30.067021] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-29T19:20:30.438309] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-29T19:20:30.438630] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-29T19:20:30.439335] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-29T19:20:30.439398] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-29T19:20:30.440159] [DEBUG] [LOCAL ] IFS: Trimmed 32349 records to 21652 (keeping 200 days of data) [2025-10-29T19:20:30.527449] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-29T19:20:30.570866] [DEBUG] [LOCAL ] IFS: Primary data saved (21652 records). [2025-10-29T19:20:30.570982] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-29T19:20:30.571053] [INFO ] [MAIN ] Update Progress: 1093/2367 symbols completed. IFS took 24.9s. Estimated remaining: 2h 43m 44s. Rate: 7.8 symbols/min [2025-10-29T19:20:30.744629] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:20:30.751052] [DEBUG] [LOCAL ] IGI: Loaded 4082 existing records from primary storage. [2025-10-29T19:20:30.751204] [INFO ] [MAIN ] IGI: Loaded 4082 existing records. [2025-10-29T19:20:30.798797] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-29T19:20:30.934943] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:20:30.935171] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-29T19:20:30.935224] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-29T19:20:30.935678] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-29T19:20:30.935743] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-29T19:20:31.310744] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:20:31.531103] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T19:20:31.593548] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-29T19:20:32.393558] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-29T19:20:32.490943] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-29T19:20:33.193695] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-29T19:20:33.611391] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-29T19:20:33.615137] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T19:20:33.993600] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-29T19:20:34.632111] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-29T19:20:34.793602] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-29T19:20:35.260104] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-29T19:20:35.593608] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-29T19:20:36.393608] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-29T19:20:37.193583] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-29T19:20:37.255392] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-29T19:20:37.384268] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T19:20:37.799733] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-29T19:20:37.993691] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-29T19:20:38.658163] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T19:20:38.661517] [INFO ] [REMOTE ] IGA: Full fetch complete (14275 records). [2025-10-29T19:20:38.661596] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-29T19:20:38.798768] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-29T19:20:39.069569] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-29T19:20:39.069693] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-29T19:20:39.070114] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-29T19:20:39.070156] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-29T19:20:39.070733] [DEBUG] [LOCAL ] IGA: Trimmed 14275 records to 9699 (keeping 200 days of data) [2025-10-29T19:20:39.127129] [DEBUG] [LOCAL ] IGA: Primary data saved (9699 records). [2025-10-29T19:20:39.127261] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-29T19:20:39.127335] [INFO ] [MAIN ] Update Progress: 1094/2367 symbols completed. IGA took 32.3s. Estimated remaining: 2h 43m 37s. Rate: 7.8 symbols/min [2025-10-29T19:20:39.248045] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-29T19:20:39.320087] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:20:39.348398] [DEBUG] [LOCAL ] IGR: Loaded 30039 existing records from primary storage. [2025-10-29T19:20:39.348702] [INFO ] [MAIN ] IGR: Loaded 30039 existing records. [2025-10-29T19:20:39.524971] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:20:39.525194] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-29T19:20:39.525240] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-29T19:20:39.525496] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-29T19:20:39.525561] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-29T19:20:39.598791] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-29T19:20:39.890869] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:20:40.287088] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-29T19:20:40.393564] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-29T19:20:41.193576] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-29T19:20:41.240922] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-29T19:20:41.246001] [INFO ] [REMOTE ] IGD: Full fetch complete (29926 records). [2025-10-29T19:20:41.246100] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-29T19:20:41.630075] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-29T19:20:41.630173] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-29T19:20:41.630908] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-29T19:20:41.630972] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-29T19:20:41.631883] [DEBUG] [LOCAL ] IGD: Trimmed 29926 records to 19192 (keeping 200 days of data) [2025-10-29T19:20:41.749565] [DEBUG] [LOCAL ] IGD: Primary data saved (19192 records). [2025-10-29T19:20:41.749724] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-29T19:20:41.749809] [INFO ] [MAIN ] Update Progress: 1095/2367 symbols completed. IGD took 23.5s. Estimated remaining: 2h 43m 23s. Rate: 7.8 symbols/min [2025-10-29T19:20:41.917790] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:20:41.922842] [DEBUG] [LOCAL ] IH: Loaded 2664 existing records from primary storage. [2025-10-29T19:20:41.923042] [INFO ] [MAIN ] IH: Loaded 2664 existing records. [2025-10-29T19:20:41.998694] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-29T19:20:42.101155] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:20:42.101381] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-29T19:20:42.101436] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-29T19:20:42.101570] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-29T19:20:42.101626] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-29T19:20:42.456480] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:20:42.793528] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-29T19:20:43.063746] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-29T19:20:43.129597] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-29T19:20:43.134829] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-29T19:20:43.147100] [INFO ] [REMOTE ] IFF: Full fetch complete (73816 records). [2025-10-29T19:20:43.147287] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-29T19:20:43.574506] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-29T19:20:43.574593] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-29T19:20:43.575661] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-29T19:20:43.575725] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-29T19:20:43.577186] [DEBUG] [LOCAL ] IFF: Trimmed 73816 records to 51185 (keeping 200 days of data) [2025-10-29T19:20:43.630939] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-29T19:20:43.888589] [DEBUG] [LOCAL ] IFF: Primary data saved (51185 records). [2025-10-29T19:20:43.888747] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-29T19:20:43.888830] [INFO ] [MAIN ] Update Progress: 1096/2367 symbols completed. IFF took 56.8s. Estimated remaining: 2h 43m 9s. Rate: 7.8 symbols/min [2025-10-29T19:20:44.057225] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:20:44.066230] [DEBUG] [LOCAL ] IHD: Loaded 7342 existing records from primary storage. [2025-10-29T19:20:44.066423] [INFO ] [MAIN ] IHD: Loaded 7342 existing records. [2025-10-29T19:20:44.250157] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:20:44.250413] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-29T19:20:44.250469] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-29T19:20:44.250615] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-29T19:20:44.250690] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-29T19:20:44.400361] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-29T19:20:44.637197] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:20:44.654173] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-29T19:20:44.922585] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-29T19:20:45.193570] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-29T19:20:45.490123] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-29T19:20:45.993586] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-29T19:20:46.793617] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-29T19:20:46.837332] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-29T19:20:47.188304] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-29T19:20:47.593589] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-29T19:20:48.152301] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-29T19:20:48.393612] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-29T19:20:48.883982] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T19:20:49.193575] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-29T19:20:49.526821] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-29T19:20:49.993604] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-29T19:20:50.407354] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-29T19:20:50.793570] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-29T19:20:51.113246] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-29T19:20:51.593572] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-29T19:20:52.031199] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-29T19:20:52.393627] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-29T19:20:53.193581] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-29T19:20:53.386072] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T19:20:53.529630] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-29T19:20:53.993595] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-29T19:20:54.472864] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-29T19:20:54.793576] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-29T19:20:55.074594] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-29T19:20:55.593557] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-29T19:20:55.981939] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-29T19:20:56.393614] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-29T19:20:56.915358] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-29T19:20:57.193695] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-29T19:20:57.743909] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-29T19:20:57.993573] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-29T19:20:58.260377] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-29T19:20:58.793556] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-29T19:20:59.197798] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-29T19:20:59.593556] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-29T19:21:00.077776] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T19:21:00.393619] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-29T19:21:01.193564] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-29T19:21:01.453441] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T19:21:01.584713] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-29T19:21:01.993631] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-29T19:21:02.416040] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-29T19:21:02.793556] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-29T19:21:03.461945] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T19:21:03.593571] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-29T19:21:04.081788] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-29T19:21:04.393569] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-29T19:21:04.940157] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T19:21:05.193603] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-29T19:21:05.739255] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-29T19:21:05.741361] [INFO ] [REMOTE ] IGI: Full fetch complete (5570 records). [2025-10-29T19:21:05.741437] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-29T19:21:05.998735] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-29T19:21:06.119457] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-29T19:21:06.119541] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-29T19:21:06.119730] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-29T19:21:06.119792] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-29T19:21:06.120284] [DEBUG] [LOCAL ] IGI: Trimmed 5570 records to 4072 (keeping 200 days of data) [2025-10-29T19:21:06.145763] [DEBUG] [LOCAL ] IGI: Primary data saved (4072 records). [2025-10-29T19:21:06.145910] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-29T19:21:06.145993] [INFO ] [MAIN ] Update Progress: 1097/2367 symbols completed. IGI took 35.6s. Estimated remaining: 2h 43m 18s. Rate: 7.8 symbols/min [2025-10-29T19:21:06.315331] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:21:06.342809] [DEBUG] [LOCAL ] IHG: Loaded 23472 existing records from primary storage. [2025-10-29T19:21:06.343070] [INFO ] [MAIN ] IHG: Loaded 23472 existing records. [2025-10-29T19:21:06.524405] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:21:06.524789] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-29T19:21:06.524844] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-29T19:21:06.525060] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-29T19:21:06.525116] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-29T19:21:06.644961] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-29T19:21:06.682024] [INFO ] [REMOTE ] IHD: Full fetch complete (11660 records). [2025-10-29T19:21:06.697425] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-29T19:21:06.798693] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-29T19:21:07.094214] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:21:07.303358] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-29T19:21:07.303502] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-29T19:21:07.303931] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-29T19:21:07.303998] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-29T19:21:07.304612] [DEBUG] [LOCAL ] IHD: Trimmed 11660 records to 7340 (keeping 200 days of data) [2025-10-29T19:21:07.348263] [DEBUG] [LOCAL ] IHD: Primary data saved (7340 records). [2025-10-29T19:21:07.348441] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-29T19:21:07.348540] [INFO ] [MAIN ] Update Progress: 1098/2367 symbols completed. IHD took 23.5s. Estimated remaining: 2h 43m 3s. Rate: 7.8 symbols/min [2025-10-29T19:21:07.530833] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:21:07.572326] [DEBUG] [LOCAL ] IHS: Loaded 36825 existing records from primary storage. [2025-10-29T19:21:07.572770] [INFO ] [MAIN ] IHS: Loaded 36825 existing records. [2025-10-29T19:21:07.595017] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-29T19:21:07.783444] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:21:07.786744] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-29T19:21:07.786571] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T19:21:07.787014] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-29T19:21:07.793001] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-29T19:21:07.793252] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-29T19:21:08.176792] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:21:08.261222] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-29T19:21:08.393561] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-29T19:21:09.193575] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-29T19:21:09.427304] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T19:21:09.993530] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-29T19:21:10.044312] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T19:21:10.793537] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-29T19:21:10.971455] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-29T19:21:11.593564] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-29T19:21:11.874743] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T19:21:12.393529] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-29T19:21:12.418526] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T19:21:13.193548] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-29T19:21:13.355121] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-29T19:21:13.993538] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-29T19:21:14.138138] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T19:21:14.332281] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-29T19:21:14.793553] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-29T19:21:15.593546] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-29T19:21:15.624460] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T19:21:16.393534] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-29T19:21:16.593294] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T19:21:17.056744] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T19:21:17.057829] [INFO ] [REMOTE ] IH: Full fetch complete (5068 records). [2025-10-29T19:21:17.057896] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-29T19:21:17.198775] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-29T19:21:17.419996] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-29T19:21:17.420074] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-29T19:21:17.420214] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-29T19:21:17.420267] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-29T19:21:17.420632] [DEBUG] [LOCAL ] IH: Trimmed 5068 records to 2662 (keeping 200 days of data) [2025-10-29T19:21:17.435433] [DEBUG] [LOCAL ] IH: Primary data saved (2662 records). [2025-10-29T19:21:17.435501] [INFO ] [MAIN ] IH: Full history saved. [2025-10-29T19:21:17.435565] [INFO ] [MAIN ] Update Progress: 1099/2367 symbols completed. IH took 35.7s. Estimated remaining: 2h 42m 58s. Rate: 7.8 symbols/min [2025-10-29T19:21:17.611154] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:21:17.618632] [DEBUG] [LOCAL ] IIF: Loaded 4964 existing records from primary storage. [2025-10-29T19:21:17.618850] [INFO ] [MAIN ] IIF: Loaded 4964 existing records. [2025-10-29T19:21:17.796058] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:21:17.796276] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-29T19:21:17.796322] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-29T19:21:17.796463] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-29T19:21:17.796500] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-29T19:21:17.998799] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-29T19:21:18.186715] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:21:18.314866] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T19:21:18.324964] [INFO ] [REMOTE ] IGR: Full fetch complete (44419 records). [2025-10-29T19:21:18.325112] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-29T19:21:18.692216] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-29T19:21:18.692286] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-29T19:21:18.692956] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-29T19:21:18.693017] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-29T19:21:18.693935] [DEBUG] [LOCAL ] IGR: Trimmed 44419 records to 29916 (keeping 200 days of data) [2025-10-29T19:21:18.799060] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-29T19:21:18.864813] [DEBUG] [LOCAL ] IGR: Primary data saved (29916 records). [2025-10-29T19:21:18.864924] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-29T19:21:18.864997] [INFO ] [MAIN ] Update Progress: 1100/2367 symbols completed. IGR took 39.7s. Estimated remaining: 2h 42m 43s. Rate: 7.8 symbols/min [2025-10-29T19:21:19.043764] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:21:19.066762] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T19:21:19.087442] [DEBUG] [LOCAL ] IIIN: Loaded 15939 existing records from primary storage. [2025-10-29T19:21:19.087687] [INFO ] [MAIN ] IIIN: Loaded 15939 existing records. [2025-10-29T19:21:19.260258] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:21:19.260460] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-29T19:21:19.260505] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-29T19:21:19.260691] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-29T19:21:19.260767] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-29T19:21:19.549096] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-29T19:21:19.601069] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-29T19:21:19.631005] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:21:20.130996] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T19:21:20.393615] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-29T19:21:21.193556] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-29T19:21:21.256505] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T19:21:21.993548] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-29T19:21:22.114052] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T19:21:22.793584] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-29T19:21:22.836381] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-29T19:21:23.593596] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-29T19:21:23.857079] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T19:21:24.393517] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-29T19:21:24.547302] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T19:21:25.193562] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-29T19:21:25.594417] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T19:21:25.882418] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-29T19:21:25.993597] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-29T19:21:26.662904] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T19:21:26.793597] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-29T19:21:27.582286] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-29T19:21:27.593517] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-29T19:21:28.393534] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-29T19:21:28.449427] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-29T19:21:29.193560] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-29T19:21:29.340268] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T19:21:29.993557] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-29T19:21:30.280429] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-29T19:21:30.400497] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-29T19:21:30.793620] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-29T19:21:31.593581] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-29T19:21:31.754451] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-29T19:21:32.243383] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T19:21:32.393554] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-29T19:21:33.193540] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-29T19:21:33.223053] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T19:21:33.905313] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-29T19:21:33.993559] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-29T19:21:34.793570] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-29T19:21:34.821423] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T19:21:35.593576] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-29T19:21:35.829381] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T19:21:35.835957] [INFO ] [REMOTE ] IHS: Full fetch complete (51535 records). [2025-10-29T19:21:35.836100] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-29T19:21:36.217932] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-29T19:21:36.218104] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-29T19:21:36.218955] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-29T19:21:36.219048] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-29T19:21:36.228983] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T19:21:36.233447] [DEBUG] [LOCAL ] IHS: Trimmed 51535 records to 36857 (keeping 200 days of data) [2025-10-29T19:21:36.403908] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-29T19:21:36.432609] [DEBUG] [LOCAL ] IHS: Primary data saved (36857 records). [2025-10-29T19:21:36.432773] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-29T19:21:36.432856] [INFO ] [MAIN ] Update Progress: 1101/2367 symbols completed. IHS took 29.1s. Estimated remaining: 2h 42m 47s. Rate: 7.8 symbols/min [2025-10-29T19:21:36.596289] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:21:36.611501] [DEBUG] [LOCAL ] IIM: Loaded 15240 existing records from primary storage. [2025-10-29T19:21:36.611752] [INFO ] [MAIN ] IIM: Loaded 15240 existing records. [2025-10-29T19:21:36.782778] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:21:36.783001] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-29T19:21:36.783047] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-29T19:21:36.783232] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-29T19:21:36.783269] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-29T19:21:37.034477] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-29T19:21:37.149337] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:21:37.193516] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-29T19:21:37.917693] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T19:21:37.993526] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-29T19:21:38.771118] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T19:21:38.793534] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-29T19:21:39.370844] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T19:21:39.593633] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-29T19:21:40.314198] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T19:21:40.393622] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-29T19:21:41.193525] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-29T19:21:41.334626] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T19:21:41.341932] [INFO ] [REMOTE ] IHG: Full fetch complete (34664 records). [2025-10-29T19:21:41.342317] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-29T19:21:41.729989] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-29T19:21:41.730227] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-29T19:21:41.730906] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-29T19:21:41.730966] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-29T19:21:41.731770] [DEBUG] [LOCAL ] IHG: Trimmed 34664 records to 23383 (keeping 200 days of data) [2025-10-29T19:21:41.829059] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-29T19:21:41.888105] [DEBUG] [LOCAL ] IHG: Primary data saved (23383 records). [2025-10-29T19:21:41.888225] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-29T19:21:41.888301] [INFO ] [MAIN ] Update Progress: 1102/2367 symbols completed. IHG took 35.7s. Estimated remaining: 2h 42m 37s. Rate: 7.8 symbols/min [2025-10-29T19:21:41.998722] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-29T19:21:42.058258] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:21:42.085522] [DEBUG] [LOCAL ] IIPR: Loaded 28323 existing records from primary storage. [2025-10-29T19:21:42.085825] [INFO ] [MAIN ] IIPR: Loaded 28323 existing records. [2025-10-29T19:21:42.259300] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:21:42.259528] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-29T19:21:42.259582] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-29T19:21:42.259881] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-29T19:21:42.259937] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-29T19:21:42.631986] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:21:42.640194] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-29T19:21:42.793578] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-29T19:21:43.183274] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-29T19:21:43.593605] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-29T19:21:44.196022] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-29T19:21:44.393563] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-29T19:21:45.193546] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-29T19:21:45.431088] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T19:21:45.993599] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-29T19:21:46.027814] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T19:21:46.033555] [INFO ] [REMOTE ] IIIN: Full fetch complete (24967 records). [2025-10-29T19:21:46.033759] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-29T19:21:46.364623] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-29T19:21:46.437262] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-29T19:21:46.437342] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-29T19:21:46.437883] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-29T19:21:46.437943] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-29T19:21:46.438529] [DEBUG] [LOCAL ] IIIN: Trimmed 24967 records to 15873 (keeping 200 days of data) [2025-10-29T19:21:46.531235] [DEBUG] [LOCAL ] IIIN: Primary data saved (15873 records). [2025-10-29T19:21:46.531368] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-29T19:21:46.531442] [INFO ] [MAIN ] Update Progress: 1103/2367 symbols completed. IIIN took 27.7s. Estimated remaining: 2h 42m 25s. Rate: 7.8 symbols/min [2025-10-29T19:21:46.706603] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:21:46.744479] [DEBUG] [LOCAL ] IMAX: Loaded 43353 existing records from primary storage. [2025-10-29T19:21:46.744779] [INFO ] [MAIN ] IMAX: Loaded 43353 existing records. [2025-10-29T19:21:46.798870] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-29T19:21:46.925525] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:21:46.925774] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-29T19:21:46.925824] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-29T19:21:46.926032] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-29T19:21:46.926089] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-29T19:21:47.271047] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:21:47.578546] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T19:21:47.593512] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-29T19:21:48.214153] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-29T19:21:48.393564] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-29T19:21:48.931215] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T19:21:49.193581] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-29T19:21:49.945984] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-29T19:21:49.949585] [INFO ] [REMOTE ] IIM: Full fetch complete (24585 records). [2025-10-29T19:21:49.949685] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-29T19:21:50.002690] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-29T19:21:50.318634] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-29T19:21:50.318743] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-29T19:21:50.319251] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-29T19:21:50.319330] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-29T19:21:50.320052] [DEBUG] [LOCAL ] IIM: Trimmed 24585 records to 15257 (keeping 200 days of data) [2025-10-29T19:21:50.411500] [DEBUG] [LOCAL ] IIM: Primary data saved (15257 records). [2025-10-29T19:21:50.411635] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-29T19:21:50.411750] [INFO ] [MAIN ] Update Progress: 1104/2367 symbols completed. IIM took 14.0s. Estimated remaining: 2h 42m 13s. Rate: 7.8 symbols/min [2025-10-29T19:21:50.528088] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T19:21:50.595159] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:21:50.636673] [DEBUG] [LOCAL ] INFA: Loaded 48282 existing records from primary storage. [2025-10-29T19:21:50.637001] [INFO ] [MAIN ] INFA: Loaded 48282 existing records. [2025-10-29T19:21:50.797510] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-29T19:21:50.821113] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:21:50.822352] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-29T19:21:50.822408] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-29T19:21:50.822711] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-29T19:21:50.822768] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-29T19:21:51.211512] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:21:51.593617] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-29T19:21:51.804998] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:21:52.393526] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-29T19:21:52.647949] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-29T19:21:53.193566] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-29T19:21:53.423057] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-29T19:21:53.993581] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-29T19:21:54.425297] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T19:21:54.793577] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-29T19:21:55.251073] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T19:21:55.593545] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-29T19:21:55.919468] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T19:21:56.393557] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-29T19:21:56.460140] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-29T19:21:57.193559] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-29T19:21:57.484318] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-29T19:21:57.615399] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-29T19:21:57.993576] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-29T19:21:58.793557] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-29T19:21:59.004514] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:21:59.593580] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-29T19:21:59.690547] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-29T19:22:00.393569] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-29T19:22:01.048463] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-29T19:22:01.193576] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-29T19:22:01.326872] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T19:22:01.993565] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-29T19:22:02.522440] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-29T19:22:02.793617] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-29T19:22:03.164418] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T19:22:03.593579] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-29T19:22:04.187113] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T19:22:04.393635] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-29T19:22:04.817067] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-29T19:22:04.994451] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T19:22:05.193559] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-29T19:22:05.993565] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-29T19:22:06.574949] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T19:22:06.793569] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-29T19:22:07.168826] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T19:22:07.593542] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-29T19:22:07.934916] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-29T19:22:08.393569] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-29T19:22:08.693542] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T19:22:09.193564] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-29T19:22:09.315495] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-29T19:22:09.993575] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-29T19:22:10.428953] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T19:22:10.793570] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-29T19:22:11.159265] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T19:22:11.593553] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-29T19:22:12.009066] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T19:22:12.018174] [INFO ] [REMOTE ] INFA: Full fetch complete (70557 records). [2025-10-29T19:22:12.018340] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-29T19:22:12.396785] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-29T19:22:12.413824] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-29T19:22:12.414981] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-29T19:22:12.416038] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-29T19:22:12.416233] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-29T19:22:12.417673] [DEBUG] [LOCAL ] INFA: Trimmed 70557 records to 48192 (keeping 200 days of data) [2025-10-29T19:22:12.715931] [DEBUG] [LOCAL ] INFA: Primary data saved (48192 records). [2025-10-29T19:22:12.717404] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T19:22:12.716628] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-29T19:22:12.717561] [INFO ] [MAIN ] Update Progress: 1105/2367 symbols completed. INFA took 22.3s. Estimated remaining: 2h 42m 22s. Rate: 7.8 symbols/min [2025-10-29T19:22:12.755670] [INFO ] [REMOTE ] IIPR: Full fetch complete (43493 records). [2025-10-29T19:22:12.802112] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-29T19:22:13.050236] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:22:13.200117] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-29T19:22:13.372232] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-29T19:22:13.372314] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-29T19:22:13.373107] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-29T19:22:13.373170] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-29T19:22:13.374446] [DEBUG] [LOCAL ] IIPR: Trimmed 43493 records to 28405 (keeping 200 days of data) [2025-10-29T19:22:13.484192] [DEBUG] [LOCAL ] INFY: Loaded 53594 existing records from primary storage. [2025-10-29T19:22:13.485474] [INFO ] [MAIN ] INFY: Loaded 53594 existing records. [2025-10-29T19:22:13.677047] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-29T19:22:13.702672] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:22:13.704917] [INFO ] [REMOTE ] IIF: Full fetch complete (8623 records). [2025-10-29T19:22:13.712584] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-29T19:22:13.737159] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-29T19:22:13.767151] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-29T19:22:13.797898] [DEBUG] [LOCAL ] IIPR: Primary data saved (28405 records). [2025-10-29T19:22:13.819097] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-29T19:22:13.840667] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-29T19:22:13.829792] [INFO ] [MAIN ] Update Progress: 1106/2367 symbols completed. IIPR took 31.9s. Estimated remaining: 2h 42m 7s. Rate: 7.8 symbols/min [2025-10-29T19:22:13.953109] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-29T19:22:14.304953] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:22:14.355395] [DEBUG] [LOCAL ] ING: No existing data file found in primary storage. [2025-10-29T19:22:14.369237] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-29T19:22:14.414754] [WARN ] [MAIN ] ING: No existing data found, performing full refresh instead. [2025-10-29T19:22:14.426930] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-29T19:22:14.472936] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-29T19:22:14.473558] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-29T19:22:14.589133] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-29T19:22:14.558256] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-10-29T19:22:14.605934] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-29T19:22:14.620769] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-29T19:22:14.626143] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-29T19:22:14.626357] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-29T19:22:14.748971] [DEBUG] [LOCAL ] IIF: Trimmed 8623 records to 4922 (keeping 200 days of data) [2025-10-29T19:22:15.004769] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:22:15.023291] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-29T19:22:15.027068] [DEBUG] [LOCAL ] IIF: Primary data saved (4922 records). [2025-10-29T19:22:15.034613] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-29T19:22:15.069357] [INFO ] [MAIN ] Update Progress: 1107/2367 symbols completed. IIF took 57.6s. Estimated remaining: 2h 41m 52s. Rate: 7.8 symbols/min [2025-10-29T19:22:15.332585] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:22:15.426764] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:22:15.459200] [DEBUG] [LOCAL ] INGM: Loaded 27588 existing records from primary storage. [2025-10-29T19:22:15.459566] [INFO ] [MAIN ] INGM: Loaded 27588 existing records. [2025-10-29T19:22:15.604989] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-29T19:22:15.649741] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:22:15.650105] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-29T19:22:15.650167] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-29T19:22:15.650549] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-29T19:22:15.650610] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-29T19:22:16.046087] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-29T19:22:16.109886] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:22:16.399843] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-29T19:22:16.425477] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-29T19:22:16.960017] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-29T19:22:17.193560] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-29T19:22:17.451636] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T19:22:17.993561] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-29T19:22:18.063535] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T19:22:18.793591] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-29T19:22:19.350810] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T19:22:19.360550] [INFO ] [REMOTE ] IMAX: Full fetch complete (61447 records). [2025-10-29T19:22:19.360701] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-29T19:22:19.598713] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-29T19:22:19.768251] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-29T19:22:19.768337] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-29T19:22:19.769219] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-29T19:22:19.769282] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-29T19:22:19.770505] [DEBUG] [LOCAL ] IMAX: Trimmed 61447 records to 43349 (keeping 200 days of data) [2025-10-29T19:22:20.031431] [DEBUG] [LOCAL ] IMAX: Primary data saved (43349 records). [2025-10-29T19:22:20.047766] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-29T19:22:20.047904] [INFO ] [MAIN ] Update Progress: 1108/2367 symbols completed. IMAX took 33.5s. Estimated remaining: 2h 41m 41s. Rate: 7.8 symbols/min [2025-10-29T19:22:20.115906] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-29T19:22:20.239040] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:22:20.272715] [DEBUG] [LOCAL ] INGR: Loaded 33548 existing records from primary storage. [2025-10-29T19:22:20.272995] [INFO ] [MAIN ] INGR: Loaded 33548 existing records. [2025-10-29T19:22:20.396679] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-29T19:22:20.461155] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:22:20.461669] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-29T19:22:20.461755] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-29T19:22:20.461975] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-29T19:22:20.475879] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-29T19:22:20.509166] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T19:22:20.847935] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:22:21.193556] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-29T19:22:21.993531] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-29T19:22:22.081380] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-29T19:22:22.533745] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T19:22:22.793551] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-29T19:22:22.961052] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T19:22:23.593553] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-29T19:22:24.021401] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T19:22:24.393559] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-29T19:22:25.123726] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T19:22:25.193506] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-29T19:22:25.249025] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T19:22:25.993598] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-29T19:22:26.538453] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T19:22:26.793557] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-29T19:22:27.415209] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T19:22:27.593570] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-29T19:22:28.199072] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T19:22:28.393563] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-29T19:22:28.888255] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T19:22:29.193570] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-29T19:22:29.699272] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T19:22:29.993605] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-29T19:22:30.229708] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-29T19:22:30.793591] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-29T19:22:30.901628] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-29T19:22:31.593548] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-29T19:22:32.090344] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T19:22:32.393539] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-29T19:22:32.528072] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T19:22:33.193562] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-29T19:22:33.691956] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T19:22:33.996811] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-29T19:22:33.999771] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T19:22:34.793579] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-29T19:22:35.569599] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-29T19:22:35.581620] [INFO ] [REMOTE ] ING: Full fetch complete (73764 records). [2025-10-29T19:22:35.581800] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-29T19:22:35.598721] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-29T19:22:35.864082] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T19:22:36.073498] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-29T19:22:36.073583] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-29T19:22:36.074632] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-29T19:22:36.074719] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-29T19:22:36.076174] [DEBUG] [LOCAL ] ING: Trimmed 73764 records to 50591 (keeping 200 days of data) [2025-10-29T19:22:36.370542] [DEBUG] [LOCAL ] ING: Primary data saved (50591 records). [2025-10-29T19:22:36.370692] [INFO ] [MAIN ] ING: Full history saved. [2025-10-29T19:22:36.370777] [INFO ] [MAIN ] Update Progress: 1109/2367 symbols completed. ING took 22.5s. Estimated remaining: 2h 41m 43s. Rate: 7.8 symbols/min [2025-10-29T19:22:36.403305] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-29T19:22:36.569323] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:22:36.606519] [DEBUG] [LOCAL ] INN: Loaded 41032 existing records from primary storage. [2025-10-29T19:22:36.606823] [INFO ] [MAIN ] INN: Loaded 41032 existing records. [2025-10-29T19:22:36.788112] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:22:36.788420] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-29T19:22:36.788480] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-29T19:22:36.789232] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-29T19:22:36.789292] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-29T19:22:37.156608] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:22:37.199369] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-29T19:22:37.206092] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-29T19:22:37.351951] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T19:22:37.993621] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-29T19:22:38.054678] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T19:22:38.793732] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-29T19:22:39.067349] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T19:22:39.593546] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-29T19:22:39.716358] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-29T19:22:40.305623] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-29T19:22:40.393724] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-29T19:22:41.193578] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-29T19:22:41.300344] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-29T19:22:41.993817] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-29T19:22:42.533089] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T19:22:42.793593] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-29T19:22:43.076046] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T19:22:43.593774] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-29T19:22:43.610623] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T19:22:44.393544] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-29T19:22:44.893571] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T19:22:45.193611] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-29T19:22:45.475899] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-29T19:22:45.482298] [INFO ] [REMOTE ] INGM: Full fetch complete (41729 records). [2025-10-29T19:22:45.482433] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-29T19:22:45.893665] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-29T19:22:45.893772] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-29T19:22:45.894475] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-29T19:22:45.894545] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-29T19:22:45.895563] [DEBUG] [LOCAL ] INGM: Trimmed 41729 records to 27590 (keeping 200 days of data) [2025-10-29T19:22:45.997724] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-29T19:22:46.066288] [DEBUG] [LOCAL ] INGM: Primary data saved (27590 records). [2025-10-29T19:22:46.066456] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-29T19:22:46.066575] [INFO ] [MAIN ] Update Progress: 1110/2367 symbols completed. INGM took 31.0s. Estimated remaining: 2h 41m 38s. Rate: 7.8 symbols/min [2025-10-29T19:22:46.237313] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:22:46.237475] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-29T19:22:46.237510] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-29T19:22:46.237618] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-29T19:22:46.237689] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-29T19:22:46.237748] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-29T19:22:46.237823] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-29T19:22:46.589902] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:22:46.635243] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T19:22:46.793582] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-29T19:22:47.062112] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-29T19:22:47.593589] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-29T19:22:47.840326] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-29T19:22:47.883010] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-29T19:22:48.393708] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-29T19:22:49.193585] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-29T19:22:49.540332] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T19:22:49.550581] [INFO ] [REMOTE ] INGR: Full fetch complete (50774 records). [2025-10-29T19:22:49.550782] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-29T19:22:49.973319] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-29T19:22:49.973411] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-29T19:22:49.974306] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-29T19:22:49.974374] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-29T19:22:49.975543] [DEBUG] [LOCAL ] INGR: Trimmed 50774 records to 33579 (keeping 200 days of data) [2025-10-29T19:22:50.031225] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-29T19:22:50.204953] [DEBUG] [LOCAL ] INGR: Primary data saved (33579 records). [2025-10-29T19:22:50.205086] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-29T19:22:50.205691] [INFO ] [MAIN ] Update Progress: 1111/2367 symbols completed. INGR took 30.2s. Estimated remaining: 2h 41m 26s. Rate: 7.8 symbols/min [2025-10-29T19:22:50.375559] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:22:50.415028] [DEBUG] [LOCAL ] INSP: Loaded 38628 existing records from primary storage. [2025-10-29T19:22:50.415507] [INFO ] [MAIN ] INSP: Loaded 38628 existing records. [2025-10-29T19:22:50.625044] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:22:50.625442] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-29T19:22:50.625630] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-29T19:22:50.625928] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-29T19:22:50.626072] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-29T19:22:50.813519] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-29T19:22:50.904322] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-29T19:22:51.091110] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:22:51.593525] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-29T19:22:51.658726] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-29T19:22:51.744548] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-29T19:22:52.393590] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-29T19:22:52.690374] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T19:22:53.193711] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-29T19:22:53.733128] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T19:22:53.993541] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-29T19:22:54.083024] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T19:22:54.793588] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-29T19:22:55.593533] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-29T19:22:55.693703] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-29T19:22:55.704961] [INFO ] [REMOTE ] INFY: Full fetch complete (77750 records). [2025-10-29T19:22:55.705123] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-29T19:22:56.174741] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-29T19:22:56.174865] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-29T19:22:56.175929] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-29T19:22:56.176060] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-29T19:22:56.209228] [DEBUG] [LOCAL ] INFY: Trimmed 77750 records to 53594 (keeping 200 days of data) [2025-10-29T19:22:56.210595] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T19:22:56.404573] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-29T19:22:56.569988] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-29T19:22:56.600557] [DEBUG] [LOCAL ] INFY: Primary data saved (53594 records). [2025-10-29T19:22:56.600716] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-29T19:22:56.600816] [INFO ] [MAIN ] Update Progress: 1112/2367 symbols completed. INFY took 43.9s. Estimated remaining: 2h 41m 17s. Rate: 7.8 symbols/min [2025-10-29T19:22:56.771476] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:22:56.807772] [DEBUG] [LOCAL ] INSW: Loaded 38711 existing records from primary storage. [2025-10-29T19:22:56.808250] [INFO ] [MAIN ] INSW: Loaded 38711 existing records. [2025-10-29T19:22:56.984309] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:22:56.984559] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-29T19:22:56.984626] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-29T19:22:56.985070] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-29T19:22:56.985130] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-29T19:22:57.198743] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-29T19:22:57.349101] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:22:57.487387] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-29T19:22:57.993547] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-29T19:22:58.037622] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T19:22:58.793580] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-29T19:22:59.115481] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-29T19:22:59.593566] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-29T19:23:00.393570] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-29T19:23:01.193699] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-29T19:23:04.863430] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (6.07 seconds). [2025-10-29T19:23:04.869813] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-29T19:23:05.322503] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (5.73 seconds). [2025-10-29T19:23:05.331769] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-29T19:23:06.111984] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (4.92 seconds). [2025-10-29T19:23:06.121365] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-29T19:23:06.254042] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T19:23:06.286633] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-29T19:23:06.289334] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (5.90 seconds). [2025-10-29T19:23:06.297091] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-29T19:23:06.495287] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T19:23:06.504092] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-29T19:23:07.117447] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-29T19:23:07.123778] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-29T19:23:07.156915] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T19:23:07.338941] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T19:23:07.593590] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-29T19:23:07.957293] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-29T19:23:08.055980] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T19:23:08.393571] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-29T19:23:08.681254] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-29T19:23:08.689939] [INFO ] [REMOTE ] INN: Full fetch complete (57583 records). [2025-10-29T19:23:08.690105] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-29T19:23:09.098157] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-29T19:23:09.098243] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-29T19:23:09.099143] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-29T19:23:09.099208] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-29T19:23:09.100419] [DEBUG] [LOCAL ] INN: Trimmed 57583 records to 40908 (keeping 200 days of data) [2025-10-29T19:23:09.195799] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-29T19:23:09.344899] [DEBUG] [LOCAL ] INN: Primary data saved (40908 records). [2025-10-29T19:23:09.345129] [INFO ] [MAIN ] INN: Full history saved. [2025-10-29T19:23:09.345502] [INFO ] [MAIN ] Update Progress: 1113/2367 symbols completed. INN took 33.0s. Estimated remaining: 2h 41m 15s. Rate: 7.8 symbols/min [2025-10-29T19:23:09.544306] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:23:09.548386] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T19:23:09.603432] [DEBUG] [LOCAL ] INVH: Loaded 53180 existing records from primary storage. [2025-10-29T19:23:09.603769] [INFO ] [MAIN ] INVH: Loaded 53180 existing records. [2025-10-29T19:23:09.791936] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:23:09.792146] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-29T19:23:09.792193] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-29T19:23:09.792394] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-29T19:23:09.792452] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-29T19:23:10.004372] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-29T19:23:10.171978] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:23:10.423133] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-29T19:23:10.429267] [INFO ] [REMOTE ] INR: Full fetch complete (38301 records). [2025-10-29T19:23:10.429416] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-29T19:23:10.663020] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-29T19:23:10.663514] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:23:10.663587] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:23:10.663685] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-29T19:23:10.663786] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-29T19:23:10.663877] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-29T19:23:10.663946] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-29T19:23:10.664009] [INFO ] [MAIN ] Update Progress: 1114/2367 symbols completed. INR took 24.6s. Estimated remaining: 2h 40m 60s. Rate: 7.8 symbols/min [2025-10-29T19:23:10.796819] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-29T19:23:10.874602] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:23:10.909036] [DEBUG] [LOCAL ] INVX: Loaded 28510 existing records from primary storage. [2025-10-29T19:23:10.909280] [INFO ] [MAIN ] INVX: Loaded 28510 existing records. [2025-10-29T19:23:11.084601] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:23:11.084828] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-29T19:23:11.084877] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-29T19:23:11.085125] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-29T19:23:11.085180] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-29T19:23:11.444233] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:23:11.470339] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T19:23:11.593554] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-29T19:23:12.072032] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T19:23:12.393545] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-29T19:23:12.758771] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T19:23:13.183307] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-29T19:23:13.193518] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-29T19:23:13.993525] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-29T19:23:14.076166] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T19:23:14.793557] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-29T19:23:14.928132] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T19:23:15.593558] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-29T19:23:15.801877] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:23:16.393547] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-29T19:23:16.766946] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T19:23:17.193592] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-29T19:23:17.687260] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T19:23:17.993532] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-29T19:23:18.157307] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-29T19:23:18.790588] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T19:23:18.796145] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-29T19:23:19.593556] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-29T19:23:19.728006] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-29T19:23:20.393550] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-29T19:23:20.583427] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-29T19:23:21.193601] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-29T19:23:21.638957] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-29T19:23:21.993552] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-29T19:23:22.307482] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T19:23:22.793564] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-29T19:23:23.258977] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T19:23:23.593556] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-29T19:23:23.809453] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T19:23:24.393618] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-29T19:23:24.921226] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T19:23:25.193560] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-29T19:23:25.368133] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-29T19:23:25.993522] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-29T19:23:26.679505] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T19:23:26.793590] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-29T19:23:26.944489] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T19:23:27.593698] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-29T19:23:27.999819] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T19:23:28.008343] [INFO ] [REMOTE ] INSW: Full fetch complete (58905 records). [2025-10-29T19:23:28.008557] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-29T19:23:28.398796] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-29T19:23:28.456729] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-29T19:23:28.456857] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-29T19:23:28.458457] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-29T19:23:28.458532] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-29T19:23:28.460359] [DEBUG] [LOCAL ] INSW: Trimmed 58905 records to 38652 (keeping 200 days of data) [2025-10-29T19:23:28.725121] [DEBUG] [LOCAL ] INSW: Primary data saved (38652 records). [2025-10-29T19:23:28.725328] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-29T19:23:28.726773] [INFO ] [MAIN ] Update Progress: 1115/2367 symbols completed. INSW took 32.1s. Estimated remaining: 2h 41m 4s. Rate: 7.8 symbols/min [2025-10-29T19:23:28.953698] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:23:29.022848] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-29T19:23:29.058398] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-29T19:23:29.058807] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-29T19:23:29.198749] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-29T19:23:29.238731] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:23:29.238946] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-29T19:23:29.238997] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-29T19:23:29.239229] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-29T19:23:29.239288] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-29T19:23:29.597815] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:23:29.748477] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T19:23:29.993564] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-29T19:23:30.294712] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T19:23:30.793585] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-29T19:23:31.086992] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T19:23:31.593623] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-29T19:23:32.272998] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T19:23:32.282153] [INFO ] [REMOTE ] INSP: Full fetch complete (53884 records). [2025-10-29T19:23:32.282284] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-29T19:23:32.398768] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-29T19:23:32.679697] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-29T19:23:32.679790] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-29T19:23:32.680838] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-29T19:23:32.680910] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-29T19:23:32.682257] [DEBUG] [LOCAL ] INSP: Trimmed 53884 records to 38712 (keeping 200 days of data) [2025-10-29T19:23:32.925128] [DEBUG] [LOCAL ] INSP: Primary data saved (38712 records). [2025-10-29T19:23:32.925267] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-29T19:23:32.925347] [INFO ] [MAIN ] Update Progress: 1116/2367 symbols completed. INSP took 42.7s. Estimated remaining: 2h 40m 52s. Rate: 7.8 symbols/min [2025-10-29T19:23:33.090586] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:23:33.138010] [DEBUG] [LOCAL ] IOT: Loaded 53440 existing records from primary storage. [2025-10-29T19:23:33.138315] [INFO ] [MAIN ] IOT: Loaded 53440 existing records. [2025-10-29T19:23:33.200689] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-29T19:23:33.322976] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:23:33.323283] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-29T19:23:33.323337] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-29T19:23:33.323536] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-29T19:23:33.323588] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-29T19:23:33.623948] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T19:23:33.713627] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:23:33.818704] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-29T19:23:33.993569] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-29T19:23:34.533518] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:23:34.545264] [INFO ] [REMOTE ] INVH: Full fetch complete (76992 records). [2025-10-29T19:23:34.545402] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-29T19:23:34.798822] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-29T19:23:34.957748] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-29T19:23:34.957846] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-29T19:23:34.958939] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-29T19:23:34.959021] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-29T19:23:34.960615] [DEBUG] [LOCAL ] INVH: Trimmed 76992 records to 53180 (keeping 200 days of data) [2025-10-29T19:23:35.354244] [DEBUG] [LOCAL ] INVH: Primary data saved (53180 records). [2025-10-29T19:23:35.354413] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-29T19:23:35.354503] [INFO ] [MAIN ] Update Progress: 1117/2367 symbols completed. INVH took 26.0s. Estimated remaining: 2h 40m 38s. Rate: 7.8 symbols/min [2025-10-29T19:23:35.593751] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-29T19:23:35.698204] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-29T19:23:35.926835] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T19:23:36.393564] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-29T19:23:37.043883] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-29T19:23:37.193548] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-29T19:23:37.993540] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-29T19:23:38.131131] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T19:23:38.344139] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-29T19:23:38.793619] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-29T19:23:39.510251] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-29T19:23:39.561307] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-29T19:23:39.593511] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-29T19:23:40.393618] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-29T19:23:40.680791] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-29T19:23:40.686630] [INFO ] [REMOTE ] INVX: Full fetch complete (42430 records). [2025-10-29T19:23:40.686761] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-29T19:23:41.116946] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-29T19:23:41.117042] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-29T19:23:41.117771] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-29T19:23:41.117830] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-29T19:23:41.118721] [DEBUG] [LOCAL ] INVX: Trimmed 42430 records to 28430 (keeping 200 days of data) [2025-10-29T19:23:41.200451] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-29T19:23:41.280411] [DEBUG] [LOCAL ] INVX: Primary data saved (28430 records). [2025-10-29T19:23:41.280546] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-29T19:23:41.280622] [INFO ] [MAIN ] Update Progress: 1118/2367 symbols completed. INVX took 30.6s. Estimated remaining: 2h 40m 29s. Rate: 7.8 symbols/min [2025-10-29T19:23:42.557942] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T19:23:42.569190] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-29T19:23:42.635197] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-29T19:23:42.793625] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-29T19:23:43.871053] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T19:23:43.882561] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-29T19:23:44.859766] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-29T19:23:44.872060] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-29T19:23:45.130780] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T19:23:45.193520] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-29T19:23:46.724935] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T19:23:46.736682] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-29T19:23:47.040396] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-29T19:23:47.051329] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-29T19:23:48.373372] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T19:23:48.385039] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-29T19:23:49.055337] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-29T19:23:49.067302] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-29T19:23:49.853296] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T19:23:49.864962] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-29T19:23:51.094108] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-29T19:23:51.105477] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-29T19:23:51.628188] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-29T19:23:51.639583] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-29T19:23:53.180018] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-29T19:23:53.192033] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-29T19:23:53.306005] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-29T19:23:53.317201] [INFO ] [REMOTE ] IOT: Full fetch complete (77514 records). [2025-10-29T19:23:53.317330] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-29T19:23:53.710519] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-29T19:23:53.710605] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-29T19:23:53.711575] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-29T19:23:53.711638] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-29T19:23:53.713097] [DEBUG] [LOCAL ] IOT: Trimmed 77514 records to 53437 (keeping 200 days of data) [2025-10-29T19:23:54.022999] [DEBUG] [LOCAL ] IOT: Primary data saved (53437 records). [2025-10-29T19:23:54.023133] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-29T19:23:54.023209] [INFO ] [MAIN ] Update Progress: 1119/2367 symbols completed. IOT took 21.1s. Estimated remaining: 2h 40m 27s. Rate: 7.8 symbols/min [2025-10-29T19:23:55.556411] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-29T19:23:55.568076] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-29T19:23:55.568224] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-29T19:23:55.997174] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-29T19:23:55.997253] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-29T19:23:55.998305] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-29T19:23:55.998370] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-29T19:23:55.999834] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-29T19:23:56.325750] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-29T19:23:56.325897] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-29T19:23:56.326838] [INFO ] [MAIN ] Update Progress: 1120/2367 symbols completed. IONQ took 27.6s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min [2025-10-29T19:23:56.989691] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:23:57.043769] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:23:57.075026] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:23:57.099944] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:23:57.121889] [DEBUG] [LOCAL ] IQI: Loaded 17371 existing records from primary storage. [2025-10-29T19:23:57.122263] [INFO ] [MAIN ] IQI: Loaded 17371 existing records. [2025-10-29T19:23:57.207847] [DEBUG] [LOCAL ] IPI: Loaded 21264 existing records from primary storage. [2025-10-29T19:23:57.233743] [INFO ] [MAIN ] IPI: Loaded 21264 existing records. [2025-10-29T19:23:57.399304] [DEBUG] [LOCAL ] IPG: Loaded 53327 existing records from primary storage. [2025-10-29T19:23:57.474116] [INFO ] [MAIN ] IPG: Loaded 53327 existing records. [2025-10-29T19:23:57.473918] [DEBUG] [LOCAL ] IP: Loaded 53297 existing records from primary storage. [2025-10-29T19:23:57.552552] [INFO ] [MAIN ] IP: Loaded 53297 existing records. [2025-10-29T19:23:57.621481] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:23:57.694853] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:23:57.757443] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-29T19:23:57.762755] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-29T19:23:57.762926] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-29T19:23:57.768209] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-29T19:23:57.824528] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-29T19:23:57.836538] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-29T19:23:57.836460] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-29T19:23:57.841940] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-29T19:23:58.123017] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:23:58.183973] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:23:58.211024] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-29T19:23:58.210860] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-29T19:23:58.211393] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-29T19:23:58.211527] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-29T19:23:58.216923] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-29T19:23:58.277559] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-29T19:23:58.282958] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-29T19:23:58.277731] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-29T19:23:59.083571] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:23:59.130801] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-29T19:23:59.142533] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:23:59.190585] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-29T19:23:59.456938] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:23:59.460275] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-29T19:23:59.548258] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:23:59.548563] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-29T19:23:59.954703] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T19:23:59.959396] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-29T19:23:59.999007] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-29T19:24:00.003326] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-29T19:24:00.807043] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-29T19:24:00.814254] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-29T19:24:00.840794] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T19:24:00.845799] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-29T19:24:01.272157] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-29T19:24:01.305054] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-29T19:24:01.308308] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-29T19:24:01.319667] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-29T19:24:01.673264] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-29T19:24:01.679046] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-29T19:24:01.699493] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T19:24:01.703860] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-29T19:24:02.446232] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-29T19:24:02.451750] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-29T19:24:02.600295] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T19:24:02.621258] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T19:24:02.720372] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T19:24:02.793591] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-29T19:24:03.354764] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-29T19:24:03.593588] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-29T19:24:04.221592] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T19:24:04.315502] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-29T19:24:04.393604] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-29T19:24:05.127532] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-29T19:24:05.193603] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-29T19:24:05.957542] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T19:24:05.993583] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-29T19:24:06.793624] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-29T19:24:07.467076] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T19:24:07.550275] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-29T19:24:07.593514] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-29T19:24:08.393527] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-29T19:24:08.573306] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T19:24:08.580191] [INFO ] [REMOTE ] IPI: Full fetch complete (30368 records). [2025-10-29T19:24:08.580347] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-29T19:24:08.990593] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-29T19:24:08.990700] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-29T19:24:08.991787] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-29T19:24:08.991850] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-29T19:24:08.992560] [DEBUG] [LOCAL ] IPI: Trimmed 30368 records to 21234 (keeping 200 days of data) [2025-10-29T19:24:09.113558] [DEBUG] [LOCAL ] IPI: Primary data saved (21234 records). [2025-10-29T19:24:09.113709] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-29T19:24:09.113796] [INFO ] [MAIN ] Update Progress: 1121/2367 symbols completed. IPI took 12.8s. Estimated remaining: 2h 40m 11s. Rate: 7.8 symbols/min [2025-10-29T19:24:09.198727] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-29T19:24:09.310318] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:24:09.356039] [DEBUG] [LOCAL ] IQV: Loaded 49919 existing records from primary storage. [2025-10-29T19:24:09.356448] [INFO ] [MAIN ] IQV: Loaded 49919 existing records. [2025-10-29T19:24:09.535225] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:24:09.535533] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-29T19:24:09.535605] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-29T19:24:09.536088] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-29T19:24:09.536139] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-29T19:24:09.947547] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:24:09.987147] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-29T19:24:09.989210] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-29T19:24:09.994073] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-29T19:24:10.793573] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-29T19:24:11.251870] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T19:24:11.415110] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-29T19:24:11.593598] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-29T19:24:12.393552] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-29T19:24:12.994773] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-29T19:24:13.193571] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-29T19:24:13.841422] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-29T19:24:13.897849] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-29T19:24:13.993531] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-29T19:24:14.793605] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-29T19:24:15.274598] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-29T19:24:15.593606] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-29T19:24:16.326685] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T19:24:16.393525] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-29T19:24:17.035324] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T19:24:17.193516] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-29T19:24:17.604768] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T19:24:17.993571] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-29T19:24:18.479605] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T19:24:18.793558] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-29T19:24:19.374333] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T19:24:19.593568] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-29T19:24:20.332294] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T19:24:20.343769] [INFO ] [REMOTE ] IPG: Full fetch complete (77441 records). [2025-10-29T19:24:20.343919] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-29T19:24:20.402319] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-29T19:24:20.764099] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-29T19:24:20.764176] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-29T19:24:20.765155] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-29T19:24:20.765215] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-29T19:24:20.766764] [DEBUG] [LOCAL ] IPG: Trimmed 77441 records to 53326 (keeping 200 days of data) [2025-10-29T19:24:21.109030] [DEBUG] [LOCAL ] IPG: Primary data saved (53326 records). [2025-10-29T19:24:21.111941] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-29T19:24:21.112088] [INFO ] [MAIN ] Update Progress: 1122/2367 symbols completed. IPG took 24.8s. Estimated remaining: 2h 40m 8s. Rate: 7.8 symbols/min [2025-10-29T19:24:21.183372] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-29T19:24:21.194361] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-29T19:24:21.296364] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:24:21.343976] [DEBUG] [LOCAL ] IR: Loaded 52717 existing records from primary storage. [2025-10-29T19:24:21.344280] [INFO ] [MAIN ] IR: Loaded 52717 existing records. [2025-10-29T19:24:21.516956] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:24:21.517183] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-29T19:24:21.517229] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-29T19:24:21.517505] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-29T19:24:21.517546] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-29T19:24:21.879977] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:24:21.940197] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-29T19:24:21.951947] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T19:24:21.993523] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-29T19:24:22.662009] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T19:24:22.793561] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-29T19:24:23.593572] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-29T19:24:24.145564] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T19:24:24.393585] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-29T19:24:24.449437] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-29T19:24:24.453180] [INFO ] [REMOTE ] IQI: Full fetch complete (25940 records). [2025-10-29T19:24:24.453288] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-29T19:24:24.859172] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-29T19:24:24.859279] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-29T19:24:24.860006] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-29T19:24:24.860082] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-29T19:24:24.861140] [DEBUG] [LOCAL ] IQI: Trimmed 25940 records to 17397 (keeping 200 days of data) [2025-10-29T19:24:24.981613] [DEBUG] [LOCAL ] IQI: Primary data saved (17397 records). [2025-10-29T19:24:24.981782] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-29T19:24:24.981870] [INFO ] [MAIN ] Update Progress: 1123/2367 symbols completed. IQI took 28.6s. Estimated remaining: 2h 39m 56s. Rate: 7.8 symbols/min [2025-10-29T19:24:25.166380] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:24:25.193553] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-29T19:24:25.212345] [DEBUG] [LOCAL ] IRM: Loaded 48597 existing records from primary storage. [2025-10-29T19:24:25.212618] [INFO ] [MAIN ] IRM: Loaded 48597 existing records. [2025-10-29T19:24:25.401774] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:24:25.401988] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-29T19:24:25.402057] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-29T19:24:25.402414] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-29T19:24:25.402471] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-29T19:24:25.786261] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:24:25.817153] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-29T19:24:25.993563] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-29T19:24:26.724094] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T19:24:26.793530] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-29T19:24:27.313392] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T19:24:27.593636] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-29T19:24:28.093107] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-29T19:24:28.393603] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-29T19:24:28.670015] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T19:24:29.193554] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-29T19:24:29.668191] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T19:24:29.993575] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-29T19:24:30.529225] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T19:24:30.793562] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-29T19:24:31.219344] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T19:24:31.593562] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-29T19:24:32.085877] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T19:24:32.393591] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-29T19:24:32.997417] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T19:24:33.193588] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-29T19:24:33.922292] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T19:24:33.993557] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-29T19:24:34.549897] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T19:24:34.793567] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-29T19:24:35.254366] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T19:24:35.593534] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-29T19:24:36.009761] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T19:24:36.393541] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-29T19:24:37.193515] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-29T19:24:37.232464] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T19:24:37.243486] [INFO ] [REMOTE ] IP: Full fetch complete (77423 records). [2025-10-29T19:24:37.243620] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-29T19:24:37.636941] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-29T19:24:37.637023] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-29T19:24:37.637982] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-29T19:24:37.638046] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-29T19:24:37.639425] [DEBUG] [LOCAL ] IP: Trimmed 77423 records to 53298 (keeping 200 days of data) [2025-10-29T19:24:37.961501] [DEBUG] [LOCAL ] IP: Primary data saved (53298 records). [2025-10-29T19:24:37.961865] [INFO ] [MAIN ] IP: Full history saved. [2025-10-29T19:24:37.962095] [INFO ] [MAIN ] Update Progress: 1124/2367 symbols completed. IP took 41.6s. Estimated remaining: 2h 39m 54s. Rate: 7.8 symbols/min [2025-10-29T19:24:38.023472] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-29T19:24:38.052210] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-29T19:24:38.191341] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:24:38.213743] [DEBUG] [LOCAL ] IRS: Loaded 23690 existing records from primary storage. [2025-10-29T19:24:38.214099] [INFO ] [MAIN ] IRS: Loaded 23690 existing records. [2025-10-29T19:24:38.397344] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:24:38.397584] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-29T19:24:38.397803] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-29T19:24:38.398490] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-29T19:24:38.398553] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-29T19:24:38.686728] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-29T19:24:38.798676] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-29T19:24:38.837126] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:24:39.447614] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-29T19:24:39.593538] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-29T19:24:40.207402] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T19:24:40.393583] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-29T19:24:40.935939] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:24:41.193614] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-29T19:24:41.787621] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T19:24:41.993562] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-29T19:24:42.400233] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T19:24:42.793597] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-29T19:24:43.132441] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T19:24:43.593558] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-29T19:24:44.112771] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-29T19:24:44.393556] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-29T19:24:44.761622] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T19:24:45.193567] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-29T19:24:45.644638] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:24:45.993606] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-29T19:24:46.678411] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T19:24:46.793552] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-29T19:24:46.815098] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T19:24:47.593544] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-29T19:24:48.275110] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-29T19:24:48.286459] [INFO ] [REMOTE ] IRM: Full fetch complete (71803 records). [2025-10-29T19:24:48.286772] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-29T19:24:48.400265] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-29T19:24:48.706401] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-29T19:24:48.706543] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-29T19:24:48.708306] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-29T19:24:48.708376] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-29T19:24:48.710379] [DEBUG] [LOCAL ] IRM: Trimmed 71803 records to 48530 (keeping 200 days of data) [2025-10-29T19:24:49.036153] [DEBUG] [LOCAL ] IRM: Primary data saved (48530 records). [2025-10-29T19:24:49.036547] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-29T19:24:49.037879] [INFO ] [MAIN ] Update Progress: 1125/2367 symbols completed. IRM took 24.1s. Estimated remaining: 2h 39m 50s. Rate: 7.8 symbols/min [2025-10-29T19:24:49.209737] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-29T19:24:49.243704] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:24:49.246233] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T19:24:49.291814] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-29T19:24:49.305320] [INFO ] [REMOTE ] IR: Full fetch complete (76488 records). [2025-10-29T19:24:49.305691] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-29T19:24:49.470316] [DEBUG] [LOCAL ] IRT: Loaded 50290 existing records from primary storage. [2025-10-29T19:24:49.495299] [INFO ] [MAIN ] IRT: Loaded 50290 existing records. [2025-10-29T19:24:49.916789] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:24:49.966122] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-29T19:24:49.966052] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-29T19:24:49.966511] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-29T19:24:49.967832] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-29T19:24:49.967764] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-29T19:24:49.968104] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-29T19:24:49.968076] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-29T19:24:49.968202] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-29T19:24:49.996731] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-29T19:24:50.084158] [DEBUG] [LOCAL ] IR: Trimmed 76488 records to 52718 (keeping 200 days of data) [2025-10-29T19:24:50.540564] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:24:50.616391] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:24:50.627539] [INFO ] [REMOTE ] IQV: Full fetch complete (72672 records). [2025-10-29T19:24:50.628314] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-29T19:24:50.815891] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-29T19:24:50.922876] [DEBUG] [LOCAL ] IR: Primary data saved (52718 records). [2025-10-29T19:24:50.929000] [INFO ] [MAIN ] IR: Full history saved. [2025-10-29T19:24:50.968492] [INFO ] [MAIN ] Update Progress: 1126/2367 symbols completed. IR took 29.9s. Estimated remaining: 2h 39m 36s. Rate: 7.8 symbols/min [2025-10-29T19:24:51.109772] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T19:24:51.427390] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-29T19:24:51.433291] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-29T19:24:51.453542] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-29T19:24:51.457117] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-29T19:24:51.459462] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:24:51.461587] [DEBUG] [LOCAL ] IQV: Trimmed 72672 records to 49900 (keeping 200 days of data) [2025-10-29T19:24:51.593923] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-29T19:24:51.612524] [DEBUG] [LOCAL ] ISD: Loaded 15340 existing records from primary storage. [2025-10-29T19:24:51.612954] [INFO ] [MAIN ] ISD: Loaded 15340 existing records. [2025-10-29T19:24:51.970074] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:24:51.991176] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-29T19:24:51.991414] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-29T19:24:52.005673] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-29T19:24:52.005785] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-29T19:24:52.051951] [DEBUG] [LOCAL ] IQV: Primary data saved (49900 records). [2025-10-29T19:24:52.105918] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-29T19:24:52.123953] [INFO ] [MAIN ] Update Progress: 1127/2367 symbols completed. IQV took 43.0s. Estimated remaining: 2h 39m 21s. Rate: 7.8 symbols/min [2025-10-29T19:24:52.561219] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:24:52.657037] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:24:52.668413] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-29T19:24:52.671347] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-29T19:24:52.683535] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T19:24:52.723417] [DEBUG] [LOCAL ] IT: Loaded 42098 existing records from primary storage. [2025-10-29T19:24:52.723806] [INFO ] [MAIN ] IT: Loaded 42098 existing records. [2025-10-29T19:24:52.910004] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:24:52.910248] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-29T19:24:52.910298] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-29T19:24:52.910496] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-29T19:24:52.910553] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-29T19:24:53.198778] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-29T19:24:53.299707] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:24:53.394921] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T19:24:53.993552] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-29T19:24:54.327718] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T19:24:54.793604] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-29T19:24:54.942400] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T19:24:55.593568] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-29T19:24:55.973445] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-29T19:24:56.335445] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-29T19:24:56.393600] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-29T19:24:57.132495] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T19:24:57.193551] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-29T19:24:57.780489] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-29T19:24:57.993557] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-29T19:24:58.793560] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-29T19:24:59.090608] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T19:24:59.522128] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T19:24:59.593555] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-29T19:25:00.393596] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-29T19:25:01.104415] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-29T19:25:01.193557] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-29T19:25:01.539806] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T19:25:01.993631] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-29T19:25:02.681621] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-29T19:25:02.793550] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-29T19:25:03.593677] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-29T19:25:03.879740] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-29T19:25:04.063920] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T19:25:04.367219] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-29T19:25:04.393523] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-29T19:25:05.081152] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-29T19:25:05.193574] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-29T19:25:05.993591] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-29T19:25:06.213431] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T19:25:06.793604] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-29T19:25:07.295566] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T19:25:07.593737] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-29T19:25:07.939542] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T19:25:08.393677] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-29T19:25:08.826135] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T19:25:09.193570] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-29T19:25:09.290839] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T19:25:09.993610] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-29T19:25:10.590717] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-29T19:25:10.663472] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-29T19:25:10.793588] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-29T19:25:11.593589] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-29T19:25:12.204898] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-29T19:25:12.393561] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-29T19:25:12.778762] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T19:25:13.193617] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-29T19:25:13.721196] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:25:13.730798] [INFO ] [REMOTE ] IT: Full fetch complete (58275 records). [2025-10-29T19:25:13.730937] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-29T19:25:14.000328] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-29T19:25:14.000467] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-29T19:25:14.194818] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-29T19:25:14.194918] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-29T19:25:14.195785] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-29T19:25:14.195847] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-29T19:25:14.197084] [DEBUG] [LOCAL ] IT: Trimmed 58275 records to 42118 (keeping 200 days of data) [2025-10-29T19:25:14.447808] [DEBUG] [LOCAL ] IT: Primary data saved (42118 records). [2025-10-29T19:25:14.447940] [INFO ] [MAIN ] IT: Full history saved. [2025-10-29T19:25:14.448021] [INFO ] [MAIN ] Update Progress: 1128/2367 symbols completed. IT took 22.3s. Estimated remaining: 2h 39m 29s. Rate: 7.8 symbols/min [2025-10-29T19:25:14.620803] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:25:14.652635] [DEBUG] [LOCAL ] ITGR: Loaded 31198 existing records from primary storage. [2025-10-29T19:25:14.652969] [INFO ] [MAIN ] ITGR: Loaded 31198 existing records. [2025-10-29T19:25:14.807973] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-29T19:25:14.857052] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:25:14.857398] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-29T19:25:14.857468] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-29T19:25:14.857713] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-29T19:25:14.857772] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-29T19:25:15.397550] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:25:15.593594] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-29T19:25:15.703670] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-29T19:25:15.713933] [INFO ] [REMOTE ] IRS: Full fetch complete (32857 records). [2025-10-29T19:25:15.714145] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-29T19:25:16.276299] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-29T19:25:16.277004] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T19:25:16.281626] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-29T19:25:16.282724] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-29T19:25:16.283140] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-29T19:25:16.283934] [DEBUG] [LOCAL ] IRS: Trimmed 32857 records to 23822 (keeping 200 days of data) [2025-10-29T19:25:16.394593] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-29T19:25:16.426805] [DEBUG] [LOCAL ] IRS: Primary data saved (23822 records). [2025-10-29T19:25:16.426932] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-29T19:25:16.427030] [INFO ] [MAIN ] Update Progress: 1129/2367 symbols completed. IRS took 38.5s. Estimated remaining: 2h 39m 15s. Rate: 7.8 symbols/min [2025-10-29T19:25:16.596629] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:25:16.628109] [DEBUG] [LOCAL ] ITT: Loaded 31933 existing records from primary storage. [2025-10-29T19:25:16.628463] [INFO ] [MAIN ] ITT: Loaded 31933 existing records. [2025-10-29T19:25:16.806058] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:25:16.806271] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-29T19:25:16.806344] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-29T19:25:16.806728] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-29T19:25:16.806800] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-29T19:25:17.008733] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-29T19:25:17.206563] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-29T19:25:17.249510] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:25:17.262354] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T19:25:17.993540] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-29T19:25:18.593820] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-29T19:25:18.793534] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-29T19:25:18.937638] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T19:25:19.465609] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-29T19:25:19.593569] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-29T19:25:20.393530] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-29T19:25:20.516490] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-29T19:25:21.183348] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T19:25:21.187464] [INFO ] [REMOTE ] ISD: Full fetch complete (23790 records). [2025-10-29T19:25:21.187555] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-29T19:25:21.198877] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-29T19:25:21.557283] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-29T19:25:21.557375] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-29T19:25:21.557905] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-29T19:25:21.557965] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-29T19:25:21.558750] [DEBUG] [LOCAL ] ISD: Trimmed 23790 records to 15280 (keeping 200 days of data) [2025-10-29T19:25:21.649679] [DEBUG] [LOCAL ] ISD: Primary data saved (15280 records). [2025-10-29T19:25:21.649819] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-29T19:25:21.649894] [INFO ] [MAIN ] Update Progress: 1130/2367 symbols completed. ISD took 30.7s. Estimated remaining: 2h 39m 5s. Rate: 7.8 symbols/min [2025-10-29T19:25:21.822568] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:25:21.875274] [DEBUG] [LOCAL ] ITUB: Loaded 53301 existing records from primary storage. [2025-10-29T19:25:21.875724] [INFO ] [MAIN ] ITUB: Loaded 53301 existing records. [2025-10-29T19:25:21.998671] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-29T19:25:22.080441] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:25:22.080869] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-29T19:25:22.080992] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-29T19:25:22.081604] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-29T19:25:22.087054] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-29T19:25:22.134101] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T19:25:22.478456] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:25:22.793572] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-29T19:25:23.170553] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T19:25:23.593541] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-29T19:25:23.714979] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T19:25:24.393563] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-29T19:25:24.836419] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T19:25:25.193628] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-29T19:25:25.589030] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T19:25:25.993591] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-29T19:25:26.337103] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T19:25:26.793572] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-29T19:25:27.494205] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T19:25:27.504792] [INFO ] [REMOTE ] IRT: Full fetch complete (72826 records). [2025-10-29T19:25:27.504949] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-29T19:25:27.598758] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-29T19:25:27.945360] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-29T19:25:27.945615] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-29T19:25:27.946719] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-29T19:25:27.946804] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-29T19:25:27.967013] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T19:25:27.974984] [DEBUG] [LOCAL ] IRT: Trimmed 72826 records to 50290 (keeping 200 days of data) [2025-10-29T19:25:28.282088] [DEBUG] [LOCAL ] IRT: Primary data saved (50290 records). [2025-10-29T19:25:28.282223] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-29T19:25:28.283205] [INFO ] [MAIN ] Update Progress: 1131/2367 symbols completed. IRT took 39.2s. Estimated remaining: 2h 38m 56s. Rate: 7.8 symbols/min [2025-10-29T19:25:28.398804] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-29T19:25:28.456010] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:25:28.500537] [DEBUG] [LOCAL ] ITW: Loaded 45547 existing records from primary storage. [2025-10-29T19:25:28.500900] [INFO ] [MAIN ] ITW: Loaded 45547 existing records. [2025-10-29T19:25:28.680708] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:25:28.680942] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-29T19:25:28.680992] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-29T19:25:28.681250] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-29T19:25:28.681317] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-29T19:25:29.035185] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:25:29.065106] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T19:25:29.193581] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-29T19:25:29.440140] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T19:25:29.993534] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-29T19:25:30.463022] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:25:30.792230] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T19:25:30.798117] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-29T19:25:31.593559] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-29T19:25:31.690820] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-29T19:25:32.393580] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-29T19:25:32.532674] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T19:25:33.193578] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-29T19:25:33.446635] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T19:25:33.993569] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-29T19:25:34.497067] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T19:25:34.588780] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-29T19:25:34.793574] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-29T19:25:35.593581] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-29T19:25:35.739279] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T19:25:36.393592] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-29T19:25:36.938728] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T19:25:37.052249] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T19:25:37.193677] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-29T19:25:37.993596] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-29T19:25:38.104974] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T19:25:38.793616] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-29T19:25:39.353399] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T19:25:39.593565] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-29T19:25:40.167159] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T19:25:40.393586] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-29T19:25:40.926854] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T19:25:41.193588] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-29T19:25:41.440285] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T19:25:41.993553] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-29T19:25:42.677710] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-29T19:25:42.793632] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-29T19:25:43.058705] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T19:25:43.593575] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-29T19:25:43.989279] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T19:25:43.997934] [INFO ] [REMOTE ] ITGR: Full fetch complete (44486 records). [2025-10-29T19:25:43.998083] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-29T19:25:44.382793] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-29T19:25:44.382897] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-29T19:25:44.383637] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-29T19:25:44.383717] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-29T19:25:44.384616] [DEBUG] [LOCAL ] ITGR: Trimmed 44486 records to 31348 (keeping 200 days of data) [2025-10-29T19:25:44.433503] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-29T19:25:44.569524] [DEBUG] [LOCAL ] ITGR: Primary data saved (31348 records). [2025-10-29T19:25:44.569708] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-29T19:25:44.569804] [INFO ] [MAIN ] Update Progress: 1132/2367 symbols completed. ITGR took 30.1s. Estimated remaining: 2h 38m 58s. Rate: 7.8 symbols/min [2025-10-29T19:25:44.741564] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:25:44.782399] [DEBUG] [LOCAL ] IVR: Loaded 47650 existing records from primary storage. [2025-10-29T19:25:44.782709] [INFO ] [MAIN ] IVR: Loaded 47650 existing records. [2025-10-29T19:25:44.963736] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:25:44.964006] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-29T19:25:44.964074] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-29T19:25:44.964391] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-29T19:25:44.964519] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-29T19:25:45.205249] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-29T19:25:45.270880] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-29T19:25:45.368496] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:25:45.675061] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T19:25:45.993588] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-29T19:25:46.675159] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-29T19:25:46.682707] [INFO ] [REMOTE ] ITT: Full fetch complete (47820 records). [2025-10-29T19:25:46.682820] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-29T19:25:46.798718] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-29T19:25:47.062321] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-29T19:25:47.062395] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-29T19:25:47.063133] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-29T19:25:47.063193] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-29T19:25:47.064139] [DEBUG] [LOCAL ] ITT: Trimmed 47820 records to 31925 (keeping 200 days of data) [2025-10-29T19:25:47.255520] [DEBUG] [LOCAL ] ITT: Primary data saved (31925 records). [2025-10-29T19:25:47.255707] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-29T19:25:47.255801] [INFO ] [MAIN ] Update Progress: 1133/2367 symbols completed. ITT took 30.8s. Estimated remaining: 2h 38m 44s. Rate: 7.8 symbols/min [2025-10-29T19:25:47.423409] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:25:47.454449] [DEBUG] [LOCAL ] IVT: Loaded 31153 existing records from primary storage. [2025-10-29T19:25:47.454737] [INFO ] [MAIN ] IVT: Loaded 31153 existing records. [2025-10-29T19:25:47.597183] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-29T19:25:47.675515] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:25:47.675874] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-29T19:25:47.676040] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-29T19:25:47.676280] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-29T19:25:47.676424] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-29T19:25:47.848897] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-29T19:25:48.128730] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:25:48.158380] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T19:25:48.393578] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-29T19:25:48.889932] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T19:25:49.193597] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-29T19:25:49.559855] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T19:25:49.993605] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-29T19:25:50.203418] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:25:50.793614] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-29T19:25:50.913113] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-29T19:25:51.593613] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-29T19:25:51.992615] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T19:25:52.393564] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-29T19:25:52.483189] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T19:25:53.193626] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-29T19:25:53.993611] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-29T19:25:54.674746] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-29T19:25:54.793561] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-29T19:25:55.226115] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-29T19:25:55.237224] [INFO ] [REMOTE ] ITW: Full fetch complete (66975 records). [2025-10-29T19:25:55.237414] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-29T19:25:55.602531] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-29T19:25:55.654849] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-29T19:25:55.654977] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-29T19:25:55.656555] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-29T19:25:55.656733] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-29T19:25:55.666624] [DEBUG] [LOCAL ] ITW: Trimmed 66975 records to 45518 (keeping 200 days of data) [2025-10-29T19:25:55.680009] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-29T19:25:55.967580] [DEBUG] [LOCAL ] ITW: Primary data saved (45518 records). [2025-10-29T19:25:55.967752] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-29T19:25:55.968693] [INFO ] [MAIN ] Update Progress: 1134/2367 symbols completed. ITW took 27.7s. Estimated remaining: 2h 38m 38s. Rate: 7.8 symbols/min [2025-10-29T19:25:56.151792] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:25:56.205962] [DEBUG] [LOCAL ] IVZ: Loaded 53126 existing records from primary storage. [2025-10-29T19:25:56.206282] [INFO ] [MAIN ] IVZ: Loaded 53126 existing records. [2025-10-29T19:25:56.395219] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-29T19:25:56.395150] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:25:56.396472] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-29T19:25:56.396534] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-29T19:25:56.397002] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-29T19:25:56.397220] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-29T19:25:56.674601] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-29T19:25:56.833714] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:25:57.126267] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-29T19:25:57.193539] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-29T19:25:57.413883] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-29T19:25:57.993574] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-29T19:25:58.436860] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T19:25:58.721371] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-29T19:25:58.793581] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-29T19:25:59.488150] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T19:25:59.593554] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-29T19:26:00.393615] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-29T19:26:01.193575] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-29T19:26:01.527623] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-29T19:26:01.540873] [INFO ] [REMOTE ] ITUB: Full fetch complete (77301 records). [2025-10-29T19:26:01.541103] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-29T19:26:02.006982] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-29T19:26:02.007210] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-29T19:26:02.008437] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-29T19:26:02.009912] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-29T19:26:02.010152] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-29T19:26:02.011806] [DEBUG] [LOCAL ] ITUB: Trimmed 77301 records to 53293 (keeping 200 days of data) [2025-10-29T19:26:02.125966] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-29T19:26:02.362396] [DEBUG] [LOCAL ] ITUB: Primary data saved (53293 records). [2025-10-29T19:26:02.362681] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-29T19:26:02.362780] [INFO ] [MAIN ] Update Progress: 1135/2367 symbols completed. ITUB took 40.7s. Estimated remaining: 2h 38m 29s. Rate: 7.8 symbols/min [2025-10-29T19:26:02.542802] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:26:02.577438] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T19:26:02.604579] [DEBUG] [LOCAL ] IX: Loaded 21585 existing records from primary storage. [2025-10-29T19:26:02.604916] [INFO ] [MAIN ] IX: Loaded 21585 existing records. [2025-10-29T19:26:02.779586] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:26:02.779841] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-29T19:26:02.779892] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-29T19:26:02.780126] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-29T19:26:02.780185] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-29T19:26:02.802434] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-29T19:26:03.160316] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:26:03.345362] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-29T19:26:03.593737] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-29T19:26:04.007535] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T19:26:04.393598] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-29T19:26:04.838760] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T19:26:05.143485] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-29T19:26:05.193524] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-29T19:26:05.993537] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-29T19:26:06.148201] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-29T19:26:06.793561] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-29T19:26:07.351921] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T19:26:07.352910] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-29T19:26:07.593573] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-29T19:26:08.163739] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T19:26:08.393577] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-29T19:26:09.193581] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-29T19:26:09.834616] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T19:26:09.993563] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-29T19:26:10.750215] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-29T19:26:10.793549] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-29T19:26:11.307338] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T19:26:11.593569] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-29T19:26:12.139696] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T19:26:12.393556] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-29T19:26:12.728453] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-29T19:26:12.736103] [INFO ] [REMOTE ] IVT: Full fetch complete (45651 records). [2025-10-29T19:26:12.736211] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-29T19:26:13.125877] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-29T19:26:13.125966] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-29T19:26:13.126796] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-29T19:26:13.126863] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-29T19:26:13.127986] [DEBUG] [LOCAL ] IVT: Trimmed 45651 records to 31179 (keeping 200 days of data) [2025-10-29T19:26:13.214146] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-29T19:26:13.319615] [DEBUG] [LOCAL ] IVT: Primary data saved (31179 records). [2025-10-29T19:26:13.319780] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-29T19:26:13.319863] [INFO ] [MAIN ] Update Progress: 1136/2367 symbols completed. IVT took 26.1s. Estimated remaining: 2h 38m 24s. Rate: 7.8 symbols/min [2025-10-29T19:26:13.518614] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:26:13.556163] [DEBUG] [LOCAL ] J: Loaded 40501 existing records from primary storage. [2025-10-29T19:26:13.556492] [INFO ] [MAIN ] J: Loaded 40501 existing records. [2025-10-29T19:26:13.738623] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:26:13.738965] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-29T19:26:13.739057] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-29T19:26:13.739403] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-29T19:26:13.739500] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-29T19:26:14.011934] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-29T19:26:14.059178] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-29T19:26:14.169566] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:26:14.172124] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-29T19:26:14.793552] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-29T19:26:15.452616] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T19:26:15.593618] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-29T19:26:16.201670] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T19:26:16.393570] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-29T19:26:16.968092] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T19:26:16.978584] [INFO ] [REMOTE ] IVR: Full fetch complete (68942 records). [2025-10-29T19:26:16.978801] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-29T19:26:17.198956] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-29T19:26:17.382581] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-29T19:26:17.382761] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-29T19:26:17.383849] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-29T19:26:17.383932] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-29T19:26:17.385434] [DEBUG] [LOCAL ] IVR: Trimmed 68942 records to 47584 (keeping 200 days of data) [2025-10-29T19:26:17.492597] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T19:26:17.695530] [DEBUG] [LOCAL ] IVR: Primary data saved (47584 records). [2025-10-29T19:26:17.695728] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-29T19:26:17.695823] [INFO ] [MAIN ] Update Progress: 1137/2367 symbols completed. IVR took 33.1s. Estimated remaining: 2h 38m 13s. Rate: 7.8 symbols/min [2025-10-29T19:26:17.864661] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:26:17.903327] [DEBUG] [LOCAL ] JBGS: Loaded 41208 existing records from primary storage. [2025-10-29T19:26:17.903639] [INFO ] [MAIN ] JBGS: Loaded 41208 existing records. [2025-10-29T19:26:18.001797] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-29T19:26:18.087761] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:26:18.087982] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-29T19:26:18.088032] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-29T19:26:18.088306] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-29T19:26:18.088347] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-29T19:26:18.460689] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:26:18.543928] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T19:26:18.793561] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-29T19:26:19.011135] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T19:26:19.593638] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-29T19:26:19.785891] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T19:26:20.393564] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-29T19:26:20.634059] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T19:26:21.193531] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-29T19:26:21.357446] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-29T19:26:21.993579] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-29T19:26:22.038714] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-29T19:26:22.793556] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-29T19:26:23.274941] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T19:26:23.593634] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-29T19:26:23.631152] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-29T19:26:24.393537] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-29T19:26:25.067302] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-29T19:26:25.143481] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T19:26:25.193622] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-29T19:26:25.993569] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-29T19:26:26.372332] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-29T19:26:26.793766] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-29T19:26:27.596585] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-29T19:26:27.596762] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-29T19:26:27.610742] [INFO ] [REMOTE ] IVZ: Full fetch complete (77076 records). [2025-10-29T19:26:27.611052] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-29T19:26:28.049409] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-29T19:26:28.049566] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-29T19:26:28.050778] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-29T19:26:28.050966] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-29T19:26:28.052741] [DEBUG] [LOCAL ] IVZ: Trimmed 77076 records to 53126 (keeping 200 days of data) [2025-10-29T19:26:28.187345] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T19:26:28.410332] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-29T19:26:28.450925] [DEBUG] [LOCAL ] IVZ: Primary data saved (53126 records). [2025-10-29T19:26:28.451927] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-29T19:26:28.453779] [INFO ] [MAIN ] Update Progress: 1138/2367 symbols completed. IVZ took 32.5s. Estimated remaining: 2h 38m 9s. Rate: 7.8 symbols/min [2025-10-29T19:26:28.452525] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-29T19:26:28.645237] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:26:28.689699] [DEBUG] [LOCAL ] JBI: Loaded 42038 existing records from primary storage. [2025-10-29T19:26:28.690002] [INFO ] [MAIN ] JBI: Loaded 42038 existing records. [2025-10-29T19:26:28.875376] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:26:28.875609] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-29T19:26:28.875699] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-29T19:26:28.875968] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-29T19:26:28.876026] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-29T19:26:29.204292] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-29T19:26:29.247906] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:26:29.559089] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T19:26:29.751927] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T19:26:29.993607] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-29T19:26:30.793568] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-29T19:26:31.060143] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T19:26:31.593570] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-29T19:26:31.941669] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:26:32.393551] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-29T19:26:32.632314] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T19:26:33.193570] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-29T19:26:33.636615] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-29T19:26:33.993577] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-29T19:26:34.345742] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T19:26:34.793632] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-29T19:26:34.912513] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-29T19:26:34.916984] [INFO ] [REMOTE ] IX: Full fetch complete (29146 records). [2025-10-29T19:26:34.917060] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-29T19:26:35.293793] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-29T19:26:35.293866] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-29T19:26:35.294516] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-29T19:26:35.294563] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-29T19:26:35.295403] [DEBUG] [LOCAL ] IX: Trimmed 29146 records to 21480 (keeping 200 days of data) [2025-10-29T19:26:35.420308] [DEBUG] [LOCAL ] IX: Primary data saved (21480 records). [2025-10-29T19:26:35.420447] [INFO ] [MAIN ] IX: Full history saved. [2025-10-29T19:26:35.420551] [INFO ] [MAIN ] Update Progress: 1139/2367 symbols completed. IX took 33.1s. Estimated remaining: 2h 38m 0s. Rate: 7.8 symbols/min [2025-10-29T19:26:35.591381] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:26:35.593544] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-29T19:26:35.637840] [DEBUG] [LOCAL ] JBL: Loaded 48163 existing records from primary storage. [2025-10-29T19:26:35.638168] [INFO ] [MAIN ] JBL: Loaded 48163 existing records. [2025-10-29T19:26:35.818820] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:26:35.819139] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-29T19:26:35.819267] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-29T19:26:35.819679] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-29T19:26:35.819741] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-29T19:26:35.990893] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T19:26:36.217723] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:26:36.393554] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-29T19:26:36.681619] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T19:26:37.193582] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-29T19:26:37.518476] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-29T19:26:37.993546] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-29T19:26:38.461236] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:26:38.793559] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-29T19:26:39.359068] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T19:26:39.368846] [INFO ] [REMOTE ] J: Full fetch complete (60023 records). [2025-10-29T19:26:39.368982] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-29T19:26:39.598702] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-29T19:26:39.764815] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-29T19:26:39.765056] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-29T19:26:39.765992] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-29T19:26:39.766070] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-29T19:26:39.767495] [DEBUG] [LOCAL ] J: Trimmed 60023 records to 40485 (keeping 200 days of data) [2025-10-29T19:26:40.015029] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-29T19:26:40.063590] [DEBUG] [LOCAL ] J: Primary data saved (40485 records). [2025-10-29T19:26:40.063729] [INFO ] [MAIN ] J: Full history saved. [2025-10-29T19:26:40.063810] [INFO ] [MAIN ] Update Progress: 1140/2367 symbols completed. J took 26.7s. Estimated remaining: 2h 37m 49s. Rate: 7.8 symbols/min [2025-10-29T19:26:40.240379] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:26:40.267141] [DEBUG] [LOCAL ] JBND: Loaded 27536 existing records from primary storage. [2025-10-29T19:26:40.267406] [INFO ] [MAIN ] JBND: Loaded 27536 existing records. [2025-10-29T19:26:40.398699] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-29T19:26:40.459724] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:26:40.460105] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-29T19:26:40.460155] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-29T19:26:40.460342] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-29T19:26:40.460397] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-29T19:26:40.822943] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:26:40.852873] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T19:26:41.193606] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-29T19:26:41.725430] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T19:26:41.993597] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-29T19:26:42.705636] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-29T19:26:42.793541] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-29T19:26:43.369255] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T19:26:43.593562] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-29T19:26:44.067808] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T19:26:44.393604] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-29T19:26:44.696678] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T19:26:45.033306] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-29T19:26:45.193690] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-29T19:26:45.764490] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T19:26:45.993553] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-29T19:26:46.793622] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-29T19:26:47.001906] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-29T19:26:47.544416] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-29T19:26:47.593537] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-29T19:26:48.380822] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-29T19:26:48.393511] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-29T19:26:49.141764] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-29T19:26:49.193525] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-29T19:26:49.993531] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-29T19:26:50.071614] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-29T19:26:50.793568] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-29T19:26:51.282450] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T19:26:51.593568] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-29T19:26:51.873817] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-29T19:26:52.393551] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-29T19:26:52.437897] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-29T19:26:53.193563] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-29T19:26:53.769548] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-29T19:26:53.993604] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-29T19:26:54.290486] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-29T19:26:54.793588] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-29T19:26:55.411551] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T19:26:55.593559] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-29T19:26:55.641040] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-29T19:26:56.393586] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-29T19:26:57.085040] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-29T19:26:57.193568] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-29T19:26:57.284442] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T19:26:57.993595] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-29T19:26:58.331522] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-29T19:26:58.340020] [INFO ] [REMOTE ] JBGS: Full fetch complete (59141 records). [2025-10-29T19:26:58.340215] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-29T19:26:58.719865] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-29T19:26:58.719941] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-29T19:26:58.720842] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-29T19:26:58.720903] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-29T19:26:58.722061] [DEBUG] [LOCAL ] JBGS: Trimmed 59141 records to 41217 (keeping 200 days of data) [2025-10-29T19:26:58.808311] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-29T19:26:58.968983] [DEBUG] [LOCAL ] JBGS: Primary data saved (41217 records). [2025-10-29T19:26:58.969108] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-29T19:26:58.969184] [INFO ] [MAIN ] Update Progress: 1141/2367 symbols completed. JBGS took 41.3s. Estimated remaining: 2h 37m 53s. Rate: 7.8 symbols/min [2025-10-29T19:26:59.145413] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:26:59.145862] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-29T19:26:59.145936] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-29T19:26:59.146147] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-29T19:26:59.146307] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-29T19:26:59.146609] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-29T19:26:59.146691] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-29T19:26:59.285797] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T19:26:59.559487] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:26:59.593547] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-29T19:26:59.761522] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T19:26:59.761896] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-29T19:26:59.761986] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:26:59.762032] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-29T19:26:59.762064] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:26:59.762130] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-29T19:26:59.762193] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-29T19:26:59.762228] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-29T19:26:59.762265] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-29T19:26:59.762315] [INFO ] [MAIN ] Update Progress: 1142/2367 symbols completed. JBS took 0.8s. Estimated remaining: 2h 37m 38s. Rate: 7.8 symbols/min [2025-10-29T19:26:59.939688] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:26:59.967472] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T19:26:59.976690] [INFO ] [REMOTE ] JBND: Full fetch complete (36853 records). [2025-10-29T19:26:59.976891] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-29T19:27:00.226031] [DEBUG] [LOCAL ] JBTM: Loaded 33118 existing records from primary storage. [2025-10-29T19:27:00.293446] [INFO ] [MAIN ] JBTM: Loaded 33118 existing records. [2025-10-29T19:27:00.393759] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-29T19:27:00.576127] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-29T19:27:00.581418] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-29T19:27:00.623871] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-29T19:27:00.623993] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-29T19:27:00.622166] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:00.624235] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-29T19:27:00.624306] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-29T19:27:00.624548] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-29T19:27:00.624593] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-29T19:27:00.732629] [DEBUG] [LOCAL ] JBND: Trimmed 36853 records to 27682 (keeping 200 days of data) [2025-10-29T19:27:01.194207] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-29T19:27:01.212922] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:01.231174] [DEBUG] [LOCAL ] JBND: Primary data saved (27682 records). [2025-10-29T19:27:01.231373] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-29T19:27:01.231493] [INFO ] [MAIN ] Update Progress: 1143/2367 symbols completed. JBND took 21.2s. Estimated remaining: 2h 37m 24s. Rate: 7.8 symbols/min [2025-10-29T19:27:01.415093] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:27:01.426284] [DEBUG] [LOCAL ] JCE: Loaded 7103 existing records from primary storage. [2025-10-29T19:27:01.426556] [INFO ] [MAIN ] JCE: Loaded 7103 existing records. [2025-10-29T19:27:01.620745] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:01.621807] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-29T19:27:01.621866] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-29T19:27:01.622087] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-29T19:27:01.622180] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-29T19:27:01.994626] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-29T19:27:02.033980] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:02.067436] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-29T19:27:02.720026] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-29T19:27:02.793570] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-29T19:27:03.338355] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T19:27:03.593559] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-29T19:27:04.127217] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-29T19:27:04.128686] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-29T19:27:04.393560] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-29T19:27:05.193579] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-29T19:27:05.412770] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-29T19:27:05.553382] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T19:27:05.993609] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-29T19:27:06.393865] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T19:27:06.793564] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-29T19:27:07.406832] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-29T19:27:07.593561] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-29T19:27:08.393555] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-29T19:27:09.095090] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T19:27:09.105444] [INFO ] [REMOTE ] JBL: Full fetch complete (70545 records). [2025-10-29T19:27:09.105616] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-29T19:27:09.198722] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-29T19:27:09.512311] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-29T19:27:09.512504] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-29T19:27:09.513711] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-29T19:27:09.513798] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-29T19:27:09.537186] [DEBUG] [LOCAL ] JBL: Trimmed 70545 records to 48129 (keeping 200 days of data) [2025-10-29T19:27:09.539345] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:27:09.847416] [DEBUG] [LOCAL ] JBL: Primary data saved (48129 records). [2025-10-29T19:27:09.847542] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-29T19:27:09.847629] [INFO ] [MAIN ] Update Progress: 1144/2367 symbols completed. JBL took 34.4s. Estimated remaining: 2h 37m 17s. Rate: 7.8 symbols/min [2025-10-29T19:27:09.996484] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-29T19:27:10.015308] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:27:10.069832] [DEBUG] [LOCAL ] JCI: Loaded 53505 existing records from primary storage. [2025-10-29T19:27:10.070125] [INFO ] [MAIN ] JCI: Loaded 53505 existing records. [2025-10-29T19:27:10.268867] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:10.269121] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-29T19:27:10.269176] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-29T19:27:10.269951] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-29T19:27:10.270012] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-29T19:27:10.375271] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T19:27:10.712923] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:10.793570] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-29T19:27:11.085888] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T19:27:11.593525] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-29T19:27:12.081791] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T19:27:12.393631] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-29T19:27:12.750513] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T19:27:12.758746] [INFO ] [REMOTE ] JBI: Full fetch complete (63123 records). [2025-10-29T19:27:12.758851] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-29T19:27:13.167247] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-29T19:27:13.167322] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-29T19:27:13.168194] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-29T19:27:13.168255] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-29T19:27:13.169398] [DEBUG] [LOCAL ] JBI: Trimmed 63123 records to 41952 (keeping 200 days of data) [2025-10-29T19:27:13.219450] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-29T19:27:13.432630] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T19:27:13.454492] [DEBUG] [LOCAL ] JBI: Primary data saved (41952 records). [2025-10-29T19:27:13.454949] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-29T19:27:13.455883] [INFO ] [MAIN ] Update Progress: 1145/2367 symbols completed. JBI took 45.0s. Estimated remaining: 2h 37m 5s. Rate: 7.8 symbols/min [2025-10-29T19:27:13.634342] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:27:13.682974] [DEBUG] [LOCAL ] JEF: Loaded 50140 existing records from primary storage. [2025-10-29T19:27:13.683321] [INFO ] [MAIN ] JEF: Loaded 50140 existing records. [2025-10-29T19:27:13.906428] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:13.906669] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-29T19:27:13.906729] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-29T19:27:13.907052] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-29T19:27:13.907091] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-29T19:27:14.003762] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-29T19:27:14.278587] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:14.516695] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-29T19:27:14.520242] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T19:27:14.793564] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-29T19:27:15.239757] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-29T19:27:15.593562] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-29T19:27:16.077280] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-29T19:27:16.393600] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-29T19:27:17.193606] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-29T19:27:17.688842] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T19:27:17.993562] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-29T19:27:18.397721] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-29T19:27:18.578809] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-29T19:27:18.793532] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-29T19:27:19.273376] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-29T19:27:19.593563] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-29T19:27:20.393614] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-29T19:27:21.193571] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-29T19:27:21.211856] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-29T19:27:21.215065] [INFO ] [REMOTE ] JCE: Full fetch complete (9595 records). [2025-10-29T19:27:21.215216] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-29T19:27:21.449393] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-29T19:27:21.748244] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-29T19:27:21.748352] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-29T19:27:21.748786] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-29T19:27:21.748854] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-29T19:27:21.749339] [DEBUG] [LOCAL ] JCE: Trimmed 9595 records to 7098 (keeping 200 days of data) [2025-10-29T19:27:21.795608] [DEBUG] [LOCAL ] JCE: Primary data saved (7098 records). [2025-10-29T19:27:21.795739] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-29T19:27:21.795824] [INFO ] [MAIN ] Update Progress: 1146/2367 symbols completed. JCE took 20.6s. Estimated remaining: 2h 36m 58s. Rate: 7.8 symbols/min [2025-10-29T19:27:21.990701] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:27:21.993585] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-29T19:27:22.031548] [DEBUG] [LOCAL ] JELD: Loaded 45524 existing records from primary storage. [2025-10-29T19:27:22.031866] [INFO ] [MAIN ] JELD: Loaded 45524 existing records. [2025-10-29T19:27:22.212540] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:22.212765] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-29T19:27:22.212815] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-29T19:27:22.213093] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-29T19:27:22.213145] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-29T19:27:22.574382] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:22.606166] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-29T19:27:22.793559] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-29T19:27:23.263384] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T19:27:23.593569] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-29T19:27:24.147076] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T19:27:24.393581] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-29T19:27:24.907064] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-29T19:27:25.193595] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-29T19:27:25.818328] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T19:27:25.993589] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-29T19:27:26.731246] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-29T19:27:26.793541] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-29T19:27:26.895033] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-29T19:27:27.593599] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-29T19:27:28.297854] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-29T19:27:28.393540] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-29T19:27:28.585912] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-29T19:27:29.193546] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-29T19:27:29.244185] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T19:27:29.993556] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-29T19:27:30.488052] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T19:27:30.793594] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-29T19:27:31.053016] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-29T19:27:31.593566] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-29T19:27:32.047620] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:27:32.393677] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-29T19:27:32.752034] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T19:27:33.193633] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-29T19:27:33.777469] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T19:27:33.993556] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-29T19:27:34.435046] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:27:34.793625] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-29T19:27:35.119543] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T19:27:35.593593] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-29T19:27:35.879471] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T19:27:36.393597] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-29T19:27:36.593560] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-29T19:27:37.193565] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-29T19:27:37.739728] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-29T19:27:37.993606] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-29T19:27:38.288732] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-29T19:27:38.793556] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-29T19:27:39.557577] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-29T19:27:39.570552] [INFO ] [REMOTE ] JCI: Full fetch complete (77651 records). [2025-10-29T19:27:39.570762] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-29T19:27:39.602029] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-29T19:27:40.020368] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-29T19:27:40.020627] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-29T19:27:40.021770] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-29T19:27:40.021850] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-29T19:27:40.049983] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T19:27:40.059873] [DEBUG] [LOCAL ] JCI: Trimmed 77651 records to 53504 (keeping 200 days of data) [2025-10-29T19:27:40.396336] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-29T19:27:40.397672] [DEBUG] [LOCAL ] JCI: Primary data saved (53504 records). [2025-10-29T19:27:40.398775] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-29T19:27:40.398891] [INFO ] [MAIN ] Update Progress: 1147/2367 symbols completed. JCI took 30.6s. Estimated remaining: 2h 37m 2s. Rate: 7.8 symbols/min [2025-10-29T19:27:40.571050] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:27:40.590945] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T19:27:40.622893] [DEBUG] [LOCAL ] JFR: Loaded 30734 existing records from primary storage. [2025-10-29T19:27:40.623158] [INFO ] [MAIN ] JFR: Loaded 30734 existing records. [2025-10-29T19:27:40.795732] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:40.795970] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-29T19:27:40.796016] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-29T19:27:40.796784] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-29T19:27:40.796842] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-29T19:27:41.143496] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:41.193521] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-29T19:27:41.783996] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T19:27:41.993616] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-29T19:27:42.213271] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-29T19:27:42.793539] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-29T19:27:42.897126] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T19:27:43.593547] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-29T19:27:44.244403] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T19:27:44.255682] [INFO ] [REMOTE ] JEF: Full fetch complete (73292 records). [2025-10-29T19:27:44.255812] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-29T19:27:44.398776] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-29T19:27:44.648799] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-29T19:27:44.648917] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-29T19:27:44.649905] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-29T19:27:44.649983] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-29T19:27:44.671591] [DEBUG] [LOCAL ] JEF: Trimmed 73292 records to 50135 (keeping 200 days of data) [2025-10-29T19:27:44.672608] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T19:27:44.977359] [DEBUG] [LOCAL ] JEF: Primary data saved (50135 records). [2025-10-29T19:27:44.977484] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-29T19:27:44.978342] [INFO ] [MAIN ] Update Progress: 1148/2367 symbols completed. JEF took 31.5s. Estimated remaining: 2h 36m 51s. Rate: 7.8 symbols/min [2025-10-29T19:27:45.143419] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:27:45.157824] [DEBUG] [LOCAL ] JGH: Loaded 12300 existing records from primary storage. [2025-10-29T19:27:45.158038] [INFO ] [MAIN ] JGH: Loaded 12300 existing records. [2025-10-29T19:27:45.199747] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-29T19:27:45.335413] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:45.335640] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-29T19:27:45.335729] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-29T19:27:45.335970] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-29T19:27:45.336027] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-29T19:27:45.694809] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:45.744765] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T19:27:45.752619] [INFO ] [REMOTE ] JBTM: Full fetch complete (46927 records). [2025-10-29T19:27:45.752763] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-29T19:27:45.998706] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-29T19:27:46.152576] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-29T19:27:46.152706] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-29T19:27:46.153551] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-29T19:27:46.153599] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-29T19:27:46.154588] [DEBUG] [LOCAL ] JBTM: Trimmed 46927 records to 33010 (keeping 200 days of data) [2025-10-29T19:27:46.384171] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T19:27:46.383173] [DEBUG] [LOCAL ] JBTM: Primary data saved (33010 records). [2025-10-29T19:27:46.393094] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-29T19:27:46.393790] [INFO ] [MAIN ] Update Progress: 1149/2367 symbols completed. JBTM took 46.6s. Estimated remaining: 2h 36m 36s. Rate: 7.8 symbols/min [2025-10-29T19:27:46.564156] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:27:46.615236] [DEBUG] [LOCAL ] JHG: Loaded 47435 existing records from primary storage. [2025-10-29T19:27:46.615149] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-29T19:27:46.618265] [INFO ] [MAIN ] JHG: Loaded 47435 existing records. [2025-10-29T19:27:46.795896] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-29T19:27:46.800012] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:46.801169] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-29T19:27:46.801274] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-29T19:27:46.801472] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-29T19:27:46.801512] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-29T19:27:47.150952] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:47.283207] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T19:27:47.593571] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-29T19:27:48.105553] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T19:27:48.393575] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-29T19:27:49.193558] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-29T19:27:49.417068] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T19:27:49.993607] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-29T19:27:50.363528] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T19:27:50.793587] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-29T19:27:51.242134] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T19:27:51.251230] [INFO ] [REMOTE ] JELD: Full fetch complete (64492 records). [2025-10-29T19:27:51.251389] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-29T19:27:51.617111] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-29T19:27:51.639482] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-29T19:27:51.639597] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-29T19:27:51.640698] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-29T19:27:51.640805] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-29T19:27:51.643212] [DEBUG] [LOCAL ] JELD: Trimmed 64492 records to 45472 (keeping 200 days of data) [2025-10-29T19:27:51.905262] [DEBUG] [LOCAL ] JELD: Primary data saved (45472 records). [2025-10-29T19:27:51.918152] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-29T19:27:51.918322] [INFO ] [MAIN ] Update Progress: 1150/2367 symbols completed. JELD took 30.1s. Estimated remaining: 2h 36m 26s. Rate: 7.8 symbols/min [2025-10-29T19:27:51.920252] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T19:27:52.100119] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:27:52.106193] [DEBUG] [LOCAL ] JHI: Loaded 4056 existing records from primary storage. [2025-10-29T19:27:52.106373] [INFO ] [MAIN ] JHI: Loaded 4056 existing records. [2025-10-29T19:27:52.274926] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-29T19:27:52.297458] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:27:52.298018] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-29T19:27:52.298066] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-29T19:27:52.298191] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-29T19:27:52.298229] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-29T19:27:52.398813] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-29T19:27:52.651387] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:27:53.193534] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-29T19:27:53.274106] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T19:27:53.993619] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-29T19:27:54.290424] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T19:27:54.793544] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-29T19:27:54.851580] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-29T19:27:55.593556] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-29T19:27:55.976863] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T19:27:56.032532] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T19:27:56.393561] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-29T19:27:57.193548] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-29T19:27:57.804301] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-29T19:27:57.993594] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-29T19:27:58.060997] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-29T19:27:58.311610] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-29T19:27:58.793574] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-29T19:27:59.593580] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-29T19:28:00.072880] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T19:28:00.393604] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-29T19:28:00.923816] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T19:28:01.193552] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-29T19:28:01.390012] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T19:28:01.993596] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-29T19:28:02.472076] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T19:28:02.793619] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-29T19:28:03.288460] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T19:28:03.593689] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-29T19:28:04.126538] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-29T19:28:04.391498] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-29T19:28:04.399798] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-29T19:28:04.402275] [INFO ] [REMOTE ] JFR: Full fetch complete (48479 records). [2025-10-29T19:28:04.402511] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-29T19:28:04.798276] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-29T19:28:04.798355] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-29T19:28:04.799145] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-29T19:28:04.799207] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-29T19:28:04.800206] [DEBUG] [LOCAL ] JFR: Trimmed 48479 records to 30688 (keeping 200 days of data) [2025-10-29T19:28:04.973940] [DEBUG] [LOCAL ] JFR: Primary data saved (30688 records). [2025-10-29T19:28:04.974288] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-29T19:28:04.974462] [INFO ] [MAIN ] Update Progress: 1151/2367 symbols completed. JFR took 24.6s. Estimated remaining: 2h 36m 24s. Rate: 7.8 symbols/min [2025-10-29T19:28:05.155560] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T19:28:05.155243] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:28:05.164086] [DEBUG] [LOCAL ] JHS: Loaded 2960 existing records from primary storage. [2025-10-29T19:28:05.164249] [INFO ] [MAIN ] JHS: Loaded 2960 existing records. [2025-10-29T19:28:05.198684] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-29T19:28:05.344898] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:28:05.345111] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-29T19:28:05.345158] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-29T19:28:05.345317] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-29T19:28:05.345374] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-29T19:28:05.697484] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:28:05.726268] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-29T19:28:05.993558] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-29T19:28:06.533904] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-29T19:28:06.793558] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-29T19:28:07.593569] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-29T19:28:07.920547] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T19:28:08.129867] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T19:28:08.393559] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-29T19:28:08.803319] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-29T19:28:09.193548] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-29T19:28:09.993549] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-29T19:28:10.277930] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T19:28:10.374825] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-29T19:28:10.793639] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-29T19:28:11.593590] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-29T19:28:11.767213] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-29T19:28:11.771882] [INFO ] [REMOTE ] JGH: Full fetch complete (16499 records). [2025-10-29T19:28:11.771952] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-29T19:28:12.053112] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-29T19:28:12.133091] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-29T19:28:12.133167] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-29T19:28:12.133504] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-29T19:28:12.133542] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-29T19:28:12.134068] [DEBUG] [LOCAL ] JGH: Trimmed 16499 records to 12292 (keeping 200 days of data) [2025-10-29T19:28:12.207951] [DEBUG] [LOCAL ] JGH: Primary data saved (12292 records). [2025-10-29T19:28:12.208073] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-29T19:28:12.208151] [INFO ] [MAIN ] Update Progress: 1152/2367 symbols completed. JGH took 27.2s. Estimated remaining: 2h 36m 16s. Rate: 7.8 symbols/min [2025-10-29T19:28:12.393160] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:28:12.393535] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-29T19:28:12.449269] [DEBUG] [LOCAL ] JHX: Loaded 53186 existing records from primary storage. [2025-10-29T19:28:12.449570] [INFO ] [MAIN ] JHX: Loaded 53186 existing records. [2025-10-29T19:28:12.663280] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:28:12.663510] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-29T19:28:12.663611] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-29T19:28:12.664081] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-29T19:28:12.664142] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-29T19:28:13.079406] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:28:13.193531] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-29T19:28:13.500036] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T19:28:13.951794] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T19:28:13.993513] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-29T19:28:14.557025] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-29T19:28:14.793550] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-29T19:28:15.593552] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-29T19:28:15.928711] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-29T19:28:16.131932] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T19:28:16.142133] [INFO ] [REMOTE ] JHG: Full fetch complete (68857 records). [2025-10-29T19:28:16.142253] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-29T19:28:16.398636] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-29T19:28:16.565276] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-29T19:28:16.565356] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-29T19:28:16.566392] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-29T19:28:16.566469] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-29T19:28:16.568087] [DEBUG] [LOCAL ] JHG: Trimmed 68857 records to 47439 (keeping 200 days of data) [2025-10-29T19:28:16.856599] [DEBUG] [LOCAL ] JHG: Primary data saved (47439 records). [2025-10-29T19:28:16.856812] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-29T19:28:16.856896] [INFO ] [MAIN ] Update Progress: 1153/2367 symbols completed. JHG took 30.5s. Estimated remaining: 2h 36m 5s. Rate: 7.8 symbols/min [2025-10-29T19:28:17.029604] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:28:17.049241] [DEBUG] [LOCAL ] JILL: Loaded 14956 existing records from primary storage. [2025-10-29T19:28:17.049463] [INFO ] [MAIN ] JILL: Loaded 14956 existing records. [2025-10-29T19:28:17.205265] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-29T19:28:17.246161] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:28:17.247232] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-29T19:28:17.247344] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-29T19:28:17.247597] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-29T19:28:17.247786] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-29T19:28:17.353029] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-29T19:28:17.592565] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-29T19:28:17.673331] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:28:17.993589] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-29T19:28:18.403576] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T19:28:18.793547] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-29T19:28:19.213998] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-29T19:28:19.593578] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-29T19:28:19.896818] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-29T19:28:20.393578] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-29T19:28:20.705870] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-29T19:28:21.193614] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-29T19:28:21.845077] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-29T19:28:21.993568] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-29T19:28:22.793584] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-29T19:28:23.274728] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-29T19:28:23.350493] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T19:28:23.593575] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-29T19:28:24.119949] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T19:28:24.122846] [INFO ] [REMOTE ] JHI: Full fetch complete (5806 records). [2025-10-29T19:28:24.122933] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-29T19:28:24.398718] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-29T19:28:24.493810] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-29T19:28:24.493892] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-29T19:28:24.494100] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-29T19:28:24.494140] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-29T19:28:24.494597] [DEBUG] [LOCAL ] JHI: Trimmed 5806 records to 4059 (keeping 200 days of data) [2025-10-29T19:28:24.519742] [DEBUG] [LOCAL ] JHI: Primary data saved (4059 records). [2025-10-29T19:28:24.519877] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-29T19:28:24.519961] [INFO ] [MAIN ] Update Progress: 1154/2367 symbols completed. JHI took 32.6s. Estimated remaining: 2h 35m 57s. Rate: 7.8 symbols/min [2025-10-29T19:28:24.690331] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:28:24.725950] [DEBUG] [LOCAL ] JKS: Loaded 38705 existing records from primary storage. [2025-10-29T19:28:24.726234] [INFO ] [MAIN ] JKS: Loaded 38705 existing records. [2025-10-29T19:28:24.917844] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:28:24.918203] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-29T19:28:24.918363] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-29T19:28:24.926096] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-29T19:28:24.926195] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-29T19:28:24.986976] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-29T19:28:25.198760] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-29T19:28:25.310821] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:28:25.993561] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-29T19:28:26.355664] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-29T19:28:26.564805] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-29T19:28:26.793562] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-29T19:28:27.593555] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-29T19:28:28.135568] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:28:28.393541] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-29T19:28:28.895697] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T19:28:29.193549] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-29T19:28:29.591627] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T19:28:29.724548] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T19:28:29.993575] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-29T19:28:30.793563] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-29T19:28:31.593536] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-29T19:28:31.636794] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-29T19:28:31.929040] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-29T19:28:31.964091] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T19:28:32.393572] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-29T19:28:33.193573] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-29T19:28:33.547912] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:28:33.993561] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-29T19:28:34.715954] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-29T19:28:34.793620] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-29T19:28:35.153949] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T19:28:35.222354] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-29T19:28:35.593563] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-29T19:28:36.393600] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-29T19:28:37.193537] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-29T19:28:37.227124] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-29T19:28:37.238334] [INFO ] [REMOTE ] JHX: Full fetch complete (63947 records). [2025-10-29T19:28:37.238476] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-29T19:28:37.648407] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-29T19:28:37.648535] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-29T19:28:37.649689] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-29T19:28:37.649828] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-29T19:28:37.651226] [DEBUG] [LOCAL ] JHX: Trimmed 63947 records to 53185 (keeping 200 days of data) [2025-10-29T19:28:37.780690] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T19:28:37.905996] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-29T19:28:37.998911] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-29T19:28:38.023492] [DEBUG] [LOCAL ] JHX: Primary data saved (53185 records). [2025-10-29T19:28:38.023625] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-29T19:28:38.024737] [INFO ] [MAIN ] Update Progress: 1155/2367 symbols completed. JHX took 25.8s. Estimated remaining: 2h 35m 56s. Rate: 7.8 symbols/min [2025-10-29T19:28:38.192638] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:28:38.226960] [DEBUG] [LOCAL ] JLL: Loaded 30962 existing records from primary storage. [2025-10-29T19:28:38.227243] [INFO ] [MAIN ] JLL: Loaded 30962 existing records. [2025-10-29T19:28:38.406768] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:28:38.407054] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-29T19:28:38.407103] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-29T19:28:38.407443] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-29T19:28:38.407500] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-29T19:28:38.765433] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:28:38.793527] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-29T19:28:39.063246] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T19:28:39.593551] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-29T19:28:39.730424] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T19:28:40.217571] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-29T19:28:40.393709] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-29T19:28:41.193573] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-29T19:28:41.653439] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T19:28:41.793087] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-29T19:28:41.993571] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-29T19:28:42.340835] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-29T19:28:42.793558] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-29T19:28:43.483830] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T19:28:43.593565] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-29T19:28:44.393588] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-29T19:28:44.481523] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T19:28:45.004636] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-29T19:28:45.193613] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-29T19:28:45.738875] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-29T19:28:45.740118] [INFO ] [REMOTE ] JHS: Full fetch complete (4584 records). [2025-10-29T19:28:45.740186] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-29T19:28:45.998745] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-29T19:28:46.096761] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-29T19:28:46.096835] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-29T19:28:46.096964] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-29T19:28:46.097000] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-29T19:28:46.097332] [DEBUG] [LOCAL ] JHS: Trimmed 4584 records to 2949 (keeping 200 days of data) [2025-10-29T19:28:46.114450] [DEBUG] [LOCAL ] JHS: Primary data saved (2949 records). [2025-10-29T19:28:46.114510] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-29T19:28:46.114573] [INFO ] [MAIN ] Update Progress: 1156/2367 symbols completed. JHS took 41.1s. Estimated remaining: 2h 35m 48s. Rate: 7.8 symbols/min [2025-10-29T19:28:46.316883] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:28:46.317096] [DEBUG] [LOCAL ] JLS: No existing data file found in primary storage. [2025-10-29T19:28:46.317142] [WARN ] [MAIN ] JLS: No existing data found, performing full refresh instead. [2025-10-29T19:28:46.317256] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-29T19:28:46.317298] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-29T19:28:46.317339] [DEBUG] [LOCAL ] JLS: No primary data file found to delete. [2025-10-29T19:28:46.317394] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-29T19:28:46.730695] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:28:46.793547] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-29T19:28:47.034349] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T19:28:47.598665] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-29T19:28:47.609052] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T19:28:47.978165] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T19:28:48.393561] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-29T19:28:49.193614] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-29T19:28:49.432780] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-29T19:28:49.779507] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T19:28:49.993609] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-29T19:28:50.400604] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T19:28:50.793683] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-29T19:28:51.593559] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-29T19:28:51.685950] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T19:28:52.393590] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-29T19:28:52.690246] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-29T19:28:53.193523] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-29T19:28:53.400609] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T19:28:53.856747] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T19:28:53.993549] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-29T19:28:54.696443] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-29T19:28:54.699524] [INFO ] [REMOTE ] JILL: Full fetch complete (22177 records). [2025-10-29T19:28:54.699595] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-29T19:28:54.798205] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-29T19:28:55.059787] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-29T19:28:55.059866] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-29T19:28:55.060315] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-29T19:28:55.060353] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-29T19:28:55.060938] [DEBUG] [LOCAL ] JILL: Trimmed 22177 records to 14935 (keeping 200 days of data) [2025-10-29T19:28:55.152110] [DEBUG] [LOCAL ] JILL: Primary data saved (14935 records). [2025-10-29T19:28:55.152270] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-29T19:28:55.152374] [INFO ] [MAIN ] Update Progress: 1157/2367 symbols completed. JILL took 38.3s. Estimated remaining: 2h 35m 42s. Rate: 7.8 symbols/min [2025-10-29T19:28:55.593538] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-29T19:28:55.902966] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-29T19:28:55.999633] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-29T19:28:56.009036] [INFO ] [REMOTE ] JKS: Full fetch complete (58477 records). [2025-10-29T19:28:56.009207] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-29T19:28:56.396749] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-29T19:28:56.397930] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-29T19:28:56.398004] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-29T19:28:56.399140] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-29T19:28:56.399294] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-29T19:28:56.400460] [DEBUG] [LOCAL ] JKS: Trimmed 58477 records to 38685 (keeping 200 days of data) [2025-10-29T19:28:56.627072] [DEBUG] [LOCAL ] JKS: Primary data saved (38685 records). [2025-10-29T19:28:56.627202] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-29T19:28:56.627275] [INFO ] [MAIN ] Update Progress: 1158/2367 symbols completed. JKS took 32.1s. Estimated remaining: 2h 35m 28s. Rate: 7.8 symbols/min [2025-10-29T19:28:56.844534] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-29T19:28:57.193618] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-29T19:28:57.598052] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-29T19:28:57.993569] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-29T19:28:58.359612] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-29T19:28:58.793728] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-29T19:28:59.593554] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-29T19:28:59.680902] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-29T19:28:59.971415] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-29T19:29:00.393558] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-29T19:29:01.193615] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-29T19:29:01.792941] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T19:29:01.993560] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-29T19:29:02.878820] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T19:29:02.880382] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-29T19:29:02.945277] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-29T19:29:03.593553] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-29T19:29:04.471416] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T19:29:04.472961] [INFO ] [REMOTE ] JLS: Full fetch complete (5780 records). [2025-10-29T19:29:04.473047] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-29T19:29:04.765471] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-29T19:29:04.806357] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-29T19:29:04.888561] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-29T19:29:04.888669] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-29T19:29:04.888875] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-29T19:29:04.888916] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-29T19:29:04.889279] [DEBUG] [LOCAL ] JLS: Trimmed 5780 records to 3884 (keeping 200 days of data) [2025-10-29T19:29:04.912321] [DEBUG] [LOCAL ] JLS: Primary data saved (3884 records). [2025-10-29T19:29:04.912408] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-29T19:29:04.912472] [INFO ] [MAIN ] Update Progress: 1159/2367 symbols completed. JLS took 18.8s. Estimated remaining: 2h 35m 21s. Rate: 7.8 symbols/min [2025-10-29T19:29:05.865947] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T19:29:05.871494] [INFO ] [REMOTE ] JLL: Full fetch complete (44980 records). [2025-10-29T19:29:05.871575] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-29T19:29:06.243665] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-29T19:29:06.243755] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-29T19:29:06.244493] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-29T19:29:06.244534] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-29T19:29:06.245415] [DEBUG] [LOCAL ] JLL: Trimmed 44980 records to 30857 (keeping 200 days of data) [2025-10-29T19:29:06.427354] [DEBUG] [LOCAL ] JLL: Primary data saved (30857 records). [2025-10-29T19:29:06.427485] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-29T19:29:06.427563] [INFO ] [MAIN ] Update Progress: 1160/2367 symbols completed. JLL took 28.4s. Estimated remaining: 2h 35m 6s. Rate: 7.8 symbols/min [2025-10-29T19:29:07.028397] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:07.155937] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:07.153966] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:07.162752] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-29T19:29:07.178152] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-29T19:29:07.182873] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-29T19:29:07.182514] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:07.183226] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-29T19:29:07.183376] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-29T19:29:07.183425] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-29T19:29:07.514336] [DEBUG] [LOCAL ] JMIA: Loaded 51198 existing records from primary storage. [2025-10-29T19:29:07.550317] [INFO ] [MAIN ] JMIA: Loaded 51198 existing records. [2025-10-29T19:29:07.566689] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-29T19:29:07.653944] [INFO ] [MAIN ] JOBY: Loaded 53809 existing records. [2025-10-29T19:29:07.723474] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-29T19:29:07.749461] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-29T19:29:08.030362] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:08.080394] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-29T19:29:08.103338] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:29:08.171071] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-29T19:29:08.234381] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:29:08.260229] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:29:08.260426] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-29T19:29:08.234464] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-29T19:29:08.260554] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-29T19:29:08.260680] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-29T19:29:08.260796] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-29T19:29:08.260958] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-29T19:29:08.261017] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-29T19:29:08.272676] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-29T19:29:08.266568] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-29T19:29:08.272791] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-29T19:29:08.292359] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-29T19:29:08.518579] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T19:29:08.553474] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-29T19:29:09.002396] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-29T19:29:09.105381] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-29T19:29:09.387744] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:09.432987] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:09.438185] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:09.430087] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-29T19:29:09.439436] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-29T19:29:09.439232] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-29T19:29:09.539889] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-29T19:29:09.993560] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-29T19:29:10.279578] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-29T19:29:10.793531] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-29T19:29:10.972244] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-29T19:29:11.050980] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-29T19:29:11.328105] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-29T19:29:11.545032] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-29T19:29:11.593545] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-29T19:29:12.393567] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-29T19:29:13.193598] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-29T19:29:13.577351] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T19:29:13.616328] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-29T19:29:13.782873] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-29T19:29:13.993555] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-29T19:29:14.793563] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-29T19:29:15.564898] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-29T19:29:15.593608] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-29T19:29:16.393639] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-29T19:29:16.775184] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-29T19:29:16.924556] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-29T19:29:17.189302] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-29T19:29:17.200992] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-29T19:29:17.993634] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-29T19:29:18.284537] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-29T19:29:18.690843] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-29T19:29:18.793589] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-29T19:29:19.094246] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-29T19:29:19.593598] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-29T19:29:20.393705] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-29T19:29:21.037358] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T19:29:21.193629] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-29T19:29:21.993607] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-29T19:29:22.254486] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-29T19:29:22.366973] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-29T19:29:22.368144] [INFO ] [REMOTE ] JMM: Full fetch complete (2324 records). [2025-10-29T19:29:22.368273] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-29T19:29:22.621215] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-29T19:29:22.621466] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:29:22.621547] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:29:22.621623] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-29T19:29:22.621725] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-29T19:29:22.621770] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-29T19:29:22.621812] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-29T19:29:22.621871] [INFO ] [MAIN ] Update Progress: 1161/2367 symbols completed. JMM took 16.2s. Estimated remaining: 2h 35m 7s. Rate: 7.8 symbols/min [2025-10-29T19:29:22.793914] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-29T19:29:22.802937] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:22.844424] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-29T19:29:22.876294] [DEBUG] [LOCAL ] JOE: Loaded 23070 existing records from primary storage. [2025-10-29T19:29:22.876566] [INFO ] [MAIN ] JOE: Loaded 23070 existing records. [2025-10-29T19:29:23.084898] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:29:23.085134] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-29T19:29:23.085181] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-29T19:29:23.085526] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-29T19:29:23.085606] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-29T19:29:23.426567] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:23.593627] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-29T19:29:24.393606] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-29T19:29:24.465258] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T19:29:25.114929] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-29T19:29:25.193540] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-29T19:29:25.993711] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-29T19:29:26.343705] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-29T19:29:26.768946] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-29T19:29:26.793603] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-29T19:29:27.388947] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-29T19:29:27.593551] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-29T19:29:27.692604] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T19:29:28.393627] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-29T19:29:29.193542] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-29T19:29:29.297108] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-29T19:29:29.563686] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-29T19:29:29.993586] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-29T19:29:30.793549] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-29T19:29:30.892882] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-29T19:29:31.598711] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-29T19:29:31.618349] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-29T19:29:32.031961] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-29T19:29:32.393579] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-29T19:29:32.446516] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T19:29:33.193601] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-29T19:29:33.993597] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-29T19:29:34.695083] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-29T19:29:34.793584] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-29T19:29:35.000580] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-29T19:29:35.370633] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T19:29:35.593561] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-29T19:29:36.393744] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-29T19:29:37.139750] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-29T19:29:37.194554] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-29T19:29:37.194476] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-29T19:29:37.331475] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T19:29:37.993584] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-29T19:29:38.793535] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-29T19:29:38.916549] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-29T19:29:39.190345] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-29T19:29:39.593548] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-29T19:29:40.393568] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-29T19:29:41.153986] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-29T19:29:41.193539] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-29T19:29:41.241020] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-29T19:29:41.542498] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-29T19:29:41.555109] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-29T19:29:41.555335] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-29T19:29:41.985403] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-29T19:29:41.985520] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-29T19:29:41.987259] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-29T19:29:41.987328] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-29T19:29:41.989353] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53810 (keeping 200 days of data) [2025-10-29T19:29:42.038156] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-29T19:29:42.246900] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-29T19:29:42.255683] [INFO ] [REMOTE ] JOE: Full fetch complete (35074 records). [2025-10-29T19:29:42.257313] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-29T19:29:42.568542] [DEBUG] [LOCAL ] JOBY: Primary data saved (53810 records). [2025-10-29T19:29:42.585069] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-29T19:29:42.639008] [INFO ] [MAIN ] Update Progress: 1162/2367 symbols completed. JOBY took 36.2s. Estimated remaining: 2h 35m 13s. Rate: 7.8 symbols/min [2025-10-29T19:29:42.796731] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-29T19:29:42.946841] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-29T19:29:42.954249] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-29T19:29:42.973388] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-29T19:29:42.972639] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:42.973535] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-29T19:29:42.974817] [DEBUG] [LOCAL ] JOE: Trimmed 35074 records to 23055 (keeping 200 days of data) [2025-10-29T19:29:43.072624] [DEBUG] [LOCAL ] JOF: Loaded 6891 existing records from primary storage. [2025-10-29T19:29:43.073195] [INFO ] [MAIN ] JOF: Loaded 6891 existing records. [2025-10-29T19:29:43.285727] [DEBUG] [LOCAL ] JOE: Primary data saved (23055 records). [2025-10-29T19:29:43.306249] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-29T19:29:43.306387] [INFO ] [MAIN ] Update Progress: 1163/2367 symbols completed. JOE took 20.7s. Estimated remaining: 2h 34m 57s. Rate: 7.8 symbols/min [2025-10-29T19:29:43.306138] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:29:43.369939] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-29T19:29:43.383013] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-29T19:29:43.412396] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-29T19:29:43.412597] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-29T19:29:43.621549] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:43.929685] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:43.931770] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-29T19:29:43.933844] [DEBUG] [LOCAL ] JPC: Loaded 36664 existing records from primary storage. [2025-10-29T19:29:43.934532] [INFO ] [MAIN ] JPC: Loaded 36664 existing records. [2025-10-29T19:29:44.136594] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:29:44.149787] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-29T19:29:44.158008] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-29T19:29:44.169348] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-29T19:29:44.169821] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-29T19:29:44.171482] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-29T19:29:44.393546] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-29T19:29:44.499594] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T19:29:44.630036] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:44.682195] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-29T19:29:44.693370] [INFO ] [REMOTE ] JMIA: Full fetch complete (73515 records). [2025-10-29T19:29:44.693512] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-29T19:29:45.082043] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-29T19:29:45.082143] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-29T19:29:45.083155] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-29T19:29:45.083229] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-29T19:29:45.084760] [DEBUG] [LOCAL ] JMIA: Trimmed 73515 records to 51201 (keeping 200 days of data) [2025-10-29T19:29:45.193564] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-29T19:29:45.368477] [DEBUG] [LOCAL ] JMIA: Primary data saved (51201 records). [2025-10-29T19:29:45.368606] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-29T19:29:45.368709] [INFO ] [MAIN ] Update Progress: 1164/2367 symbols completed. JMIA took 38.9s. Estimated remaining: 2h 34m 44s. Rate: 7.8 symbols/min [2025-10-29T19:29:45.534451] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:45.582824] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-29T19:29:45.583149] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-29T19:29:45.760831] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:29:45.761144] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-29T19:29:45.761220] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-29T19:29:45.763952] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-29T19:29:45.767115] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-29T19:29:45.767279] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T19:29:46.003260] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-29T19:29:46.136599] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:46.218740] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-29T19:29:46.613461] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-29T19:29:46.793597] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-29T19:29:47.593594] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-29T19:29:48.393608] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-29T19:29:48.801758] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T19:29:49.193539] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-29T19:29:49.375357] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-29T19:29:49.386841] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-29T19:29:49.387008] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-29T19:29:49.705981] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T19:29:49.801832] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-29T19:29:49.801935] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-29T19:29:49.802996] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-29T19:29:49.803063] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-29T19:29:49.804824] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-29T19:29:49.999505] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-29T19:29:50.147285] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-29T19:29:50.147430] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-29T19:29:50.147517] [INFO ] [MAIN ] Update Progress: 1165/2367 symbols completed. JNJ took 43.7s. Estimated remaining: 2h 34m 33s. Rate: 7.8 symbols/min [2025-10-29T19:29:50.320338] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:29:50.371249] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-29T19:29:50.396237] [DEBUG] [LOCAL ] JQC: Loaded 33418 existing records from primary storage. [2025-10-29T19:29:50.396540] [INFO ] [MAIN ] JQC: Loaded 33418 existing records. [2025-10-29T19:29:50.569987] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:29:50.570230] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-29T19:29:50.570278] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-29T19:29:50.570685] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-29T19:29:50.570744] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-29T19:29:50.803022] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-29T19:29:50.932288] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:29:51.070097] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T19:29:51.250367] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-29T19:29:51.593592] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-29T19:29:51.982935] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-29T19:29:52.393598] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-29T19:29:53.193594] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-29T19:29:53.312188] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-29T19:29:53.993588] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-29T19:29:54.798959] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-29T19:29:54.809553] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-29T19:29:55.081421] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-29T19:29:55.204484] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-29T19:29:55.593586] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-29T19:29:56.393598] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-29T19:29:56.704395] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T19:29:56.829325] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-29T19:29:57.193616] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-29T19:29:57.993602] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-29T19:29:58.137112] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-29T19:29:58.371231] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-29T19:29:58.793587] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-29T19:29:59.593573] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-29T19:30:00.207250] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-29T19:30:00.209485] [INFO ] [REMOTE ] JOF: Full fetch complete (9628 records). [2025-10-29T19:30:00.209565] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-29T19:30:00.402518] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-29T19:30:00.603138] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-29T19:30:00.603288] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-29T19:30:00.603882] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-29T19:30:00.604083] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-29T19:30:00.605194] [DEBUG] [LOCAL ] JOF: Trimmed 9628 records to 6892 (keeping 200 days of data) [2025-10-29T19:30:00.671004] [DEBUG] [LOCAL ] JOF: Primary data saved (6892 records). [2025-10-29T19:30:00.671289] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-29T19:30:00.671433] [INFO ] [MAIN ] Update Progress: 1166/2367 symbols completed. JOF took 18.0s. Estimated remaining: 2h 34m 28s. Rate: 7.8 symbols/min [2025-10-29T19:30:00.943044] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-29T19:30:01.042091] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:30:01.065009] [DEBUG] [LOCAL ] JRI: Loaded 15017 existing records from primary storage. [2025-10-29T19:30:01.065337] [INFO ] [MAIN ] JRI: Loaded 15017 existing records. [2025-10-29T19:30:01.201831] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-29T19:30:01.331013] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:30:01.331559] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-29T19:30:01.331636] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-29T19:30:01.331938] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-29T19:30:01.332014] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-29T19:30:01.755116] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-29T19:30:01.869112] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:30:01.993606] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-29T19:30:02.461475] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T19:30:02.793590] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-29T19:30:03.221436] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-29T19:30:03.593574] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-29T19:30:03.886252] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-29T19:30:04.189369] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-29T19:30:04.393581] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-29T19:30:05.193515] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-29T19:30:05.993550] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-29T19:30:06.419494] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T19:30:06.534386] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-29T19:30:06.764034] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T19:30:06.793554] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-29T19:30:07.593623] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-29T19:30:07.910794] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T19:30:08.393534] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-29T19:30:09.193726] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-29T19:30:09.485685] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-29T19:30:09.663537] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-29T19:30:09.993635] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-29T19:30:10.011422] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-29T19:30:10.793578] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-29T19:30:11.341726] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T19:30:11.543681] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-29T19:30:11.593533] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-29T19:30:12.393624] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-29T19:30:13.193545] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-29T19:30:13.245523] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-29T19:30:13.521986] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T19:30:13.993620] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-29T19:30:14.434160] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T19:30:14.442150] [INFO ] [REMOTE ] JPC: Full fetch complete (54832 records). [2025-10-29T19:30:14.442266] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-29T19:30:14.798747] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-29T19:30:14.854604] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-29T19:30:14.854870] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-29T19:30:14.856007] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-29T19:30:14.856069] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-29T19:30:14.857332] [DEBUG] [LOCAL ] JPC: Trimmed 54832 records to 36593 (keeping 200 days of data) [2025-10-29T19:30:15.072448] [DEBUG] [LOCAL ] JPC: Primary data saved (36593 records). [2025-10-29T19:30:15.072669] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-29T19:30:15.072880] [INFO ] [MAIN ] Update Progress: 1167/2367 symbols completed. JPC took 31.8s. Estimated remaining: 2h 34m 27s. Rate: 7.8 symbols/min [2025-10-29T19:30:15.192940] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T19:30:15.286069] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:30:15.298426] [DEBUG] [LOCAL ] JRS: Loaded 11407 existing records from primary storage. [2025-10-29T19:30:15.298675] [INFO ] [MAIN ] JRS: Loaded 11407 existing records. [2025-10-29T19:30:15.485525] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:30:15.495747] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-29T19:30:15.495834] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-29T19:30:15.496599] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-29T19:30:15.497127] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-29T19:30:15.497045] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T19:30:15.600673] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-29T19:30:15.861134] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:30:16.393562] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-29T19:30:17.003940] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-29T19:30:17.193573] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-29T19:30:17.432044] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-29T19:30:17.807201] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-29T19:30:17.993570] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-29T19:30:18.662195] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T19:30:18.793578] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-29T19:30:19.326510] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-29T19:30:19.593558] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-29T19:30:20.129506] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-29T19:30:20.393526] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-29T19:30:21.148895] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-29T19:30:21.193537] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-29T19:30:21.749593] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-29T19:30:21.993585] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-29T19:30:22.793562] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-29T19:30:23.523640] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T19:30:23.593553] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-29T19:30:23.835832] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-29T19:30:24.071718] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-29T19:30:24.393575] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-29T19:30:25.161583] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-29T19:30:25.165370] [INFO ] [REMOTE ] JRI: Full fetch complete (22676 records). [2025-10-29T19:30:25.165443] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-29T19:30:25.198744] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-29T19:30:25.538723] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-29T19:30:25.538812] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-29T19:30:25.539276] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-29T19:30:25.539316] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-29T19:30:25.540043] [DEBUG] [LOCAL ] JRI: Trimmed 22676 records to 15034 (keeping 200 days of data) [2025-10-29T19:30:25.632471] [DEBUG] [LOCAL ] JRI: Primary data saved (15034 records). [2025-10-29T19:30:25.632606] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-29T19:30:25.632715] [INFO ] [MAIN ] Update Progress: 1168/2367 symbols completed. JRI took 25.0s. Estimated remaining: 2h 34m 23s. Rate: 7.8 symbols/min [2025-10-29T19:30:25.808500] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-29T19:30:25.810973] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:30:25.854601] [DEBUG] [LOCAL ] JXN: Loaded 43769 existing records from primary storage. [2025-10-29T19:30:25.854928] [INFO ] [MAIN ] JXN: Loaded 43769 existing records. [2025-10-29T19:30:26.002244] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-29T19:30:26.032723] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:30:26.033672] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-29T19:30:26.033733] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-29T19:30:26.034215] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-29T19:30:26.034275] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-29T19:30:26.383533] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:30:26.677985] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T19:30:26.793568] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-29T19:30:27.593580] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-29T19:30:28.252928] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-29T19:30:28.393621] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-29T19:30:28.611445] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-29T19:30:29.186202] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-29T19:30:29.193508] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-29T19:30:29.993591] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-29T19:30:30.386320] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T19:30:30.394002] [INFO ] [REMOTE ] JQC: Full fetch complete (49876 records). [2025-10-29T19:30:30.394159] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-29T19:30:30.697909] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T19:30:30.785450] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-29T19:30:30.785542] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-29T19:30:30.786381] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-29T19:30:30.786443] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-29T19:30:30.787570] [DEBUG] [LOCAL ] JQC: Trimmed 49876 records to 33356 (keeping 200 days of data) [2025-10-29T19:30:30.833931] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-29T19:30:30.977960] [DEBUG] [LOCAL ] JQC: Primary data saved (33356 records). [2025-10-29T19:30:30.978088] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-29T19:30:30.978163] [INFO ] [MAIN ] Update Progress: 1169/2367 symbols completed. JQC took 40.8s. Estimated remaining: 2h 34m 13s. Rate: 7.8 symbols/min [2025-10-29T19:30:31.143031] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:30:31.186306] [DEBUG] [LOCAL ] K: Loaded 50245 existing records from primary storage. [2025-10-29T19:30:31.186604] [INFO ] [MAIN ] K: Loaded 50245 existing records. [2025-10-29T19:30:31.368209] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:30:31.376632] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-29T19:30:31.377265] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-29T19:30:31.377782] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T19:30:31.377846] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-29T19:30:31.378068] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-29T19:30:31.598742] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-29T19:30:31.757623] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:30:32.393611] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-29T19:30:32.758695] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T19:30:33.193699] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-29T19:30:33.504392] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T19:30:33.993589] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-29T19:30:34.269918] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T19:30:34.791571] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T19:30:34.794583] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-29T19:30:34.795271] [INFO ] [REMOTE ] JRS: Full fetch complete (16093 records). [2025-10-29T19:30:34.796368] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-29T19:30:35.161544] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-29T19:30:35.161628] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-29T19:30:35.162006] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-29T19:30:35.162056] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-29T19:30:35.162638] [DEBUG] [LOCAL ] JRS: Trimmed 16093 records to 11429 (keeping 200 days of data) [2025-10-29T19:30:35.227074] [DEBUG] [LOCAL ] JRS: Primary data saved (11429 records). [2025-10-29T19:30:35.227202] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-29T19:30:35.227281] [INFO ] [MAIN ] Update Progress: 1170/2367 symbols completed. JRS took 20.2s. Estimated remaining: 2h 34m 1s. Rate: 7.8 symbols/min [2025-10-29T19:30:35.394947] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:30:35.409918] [DEBUG] [LOCAL ] KAI: Loaded 13188 existing records from primary storage. [2025-10-29T19:30:35.410186] [INFO ] [MAIN ] KAI: Loaded 13188 existing records. [2025-10-29T19:30:35.605394] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-29T19:30:35.611527] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:30:35.612718] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-29T19:30:35.612813] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-29T19:30:35.613074] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-29T19:30:35.613131] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-29T19:30:35.974106] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:30:36.151492] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T19:30:36.393568] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-29T19:30:36.855442] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T19:30:37.193570] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-29T19:30:37.657164] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T19:30:37.774101] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-29T19:30:37.993619] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-29T19:30:38.676279] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-29T19:30:38.793594] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-29T19:30:39.593743] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-29T19:30:39.959297] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T19:30:40.228076] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-29T19:30:40.393577] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-29T19:30:41.193616] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-29T19:30:41.993530] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-29T19:30:42.012295] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-29T19:30:42.533353] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-29T19:30:42.544805] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-29T19:30:42.545020] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-29T19:30:42.800698] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-29T19:30:42.932960] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-29T19:30:42.933041] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-29T19:30:42.934049] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-29T19:30:42.934114] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-29T19:30:42.935529] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-29T19:30:43.285993] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T19:30:43.312095] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-29T19:30:43.312236] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-29T19:30:43.312318] [INFO ] [MAIN ] Update Progress: 1171/2367 symbols completed. JPM took 57.9s. Estimated remaining: 2h 33m 54s. Rate: 7.8 symbols/min [2025-10-29T19:30:43.478437] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:30:43.514383] [DEBUG] [LOCAL ] KAR: Loaded 39565 existing records from primary storage. [2025-10-29T19:30:43.514757] [INFO ] [MAIN ] KAR: Loaded 39565 existing records. [2025-10-29T19:30:43.602600] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-29T19:30:43.689546] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:30:43.689808] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-29T19:30:43.689854] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-29T19:30:43.690435] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-29T19:30:43.690493] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-29T19:30:44.048764] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:30:44.092070] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T19:30:44.380953] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-29T19:30:44.393509] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-29T19:30:44.927450] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-29T19:30:45.193565] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-29T19:30:45.993599] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-29T19:30:46.029142] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-29T19:30:46.793627] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-29T19:30:47.139795] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T19:30:47.593520] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-29T19:30:47.647400] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-29T19:30:48.393679] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-29T19:30:48.725852] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-29T19:30:48.987344] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-29T19:30:49.193574] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-29T19:30:49.706369] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T19:30:49.993603] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-29T19:30:50.793604] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-29T19:30:51.064594] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T19:30:51.343535] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T19:30:51.593572] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-29T19:30:52.393635] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-29T19:30:52.927721] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T19:30:53.193571] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-29T19:30:53.431617] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-29T19:30:53.993628] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-29T19:30:54.463446] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T19:30:54.647015] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-29T19:30:54.650734] [INFO ] [REMOTE ] KAI: Full fetch complete (19547 records). [2025-10-29T19:30:54.650816] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-29T19:30:54.800089] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-29T19:30:55.025163] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-29T19:30:55.025243] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-29T19:30:55.025713] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-29T19:30:55.025774] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-29T19:30:55.026301] [DEBUG] [LOCAL ] KAI: Trimmed 19547 records to 13231 (keeping 200 days of data) [2025-10-29T19:30:55.107800] [DEBUG] [LOCAL ] KAI: Primary data saved (13231 records). [2025-10-29T19:30:55.107930] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-29T19:30:55.108009] [INFO ] [MAIN ] Update Progress: 1172/2367 symbols completed. KAI took 19.9s. Estimated remaining: 2h 33m 50s. Rate: 7.8 symbols/min [2025-10-29T19:30:55.280484] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:30:55.301176] [DEBUG] [LOCAL ] KB: Loaded 22618 existing records from primary storage. [2025-10-29T19:30:55.301417] [INFO ] [MAIN ] KB: Loaded 22618 existing records. [2025-10-29T19:30:55.480734] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:30:55.480978] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-29T19:30:55.481030] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-29T19:30:55.481444] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-29T19:30:55.481500] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-29T19:30:55.598701] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-29T19:30:55.843213] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:30:56.049241] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:30:56.393552] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-29T19:30:56.628849] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-29T19:30:57.193550] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-29T19:30:57.596110] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T19:30:57.993572] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-29T19:30:58.304731] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T19:30:58.793600] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-29T19:30:59.138816] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-29T19:30:59.147028] [INFO ] [REMOTE ] JXN: Full fetch complete (65060 records). [2025-10-29T19:30:59.147150] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-29T19:30:59.529110] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-29T19:30:59.529191] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-29T19:30:59.530064] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-29T19:30:59.530126] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-29T19:30:59.531476] [DEBUG] [LOCAL ] JXN: Trimmed 65060 records to 43637 (keeping 200 days of data) [2025-10-29T19:30:59.619584] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-29T19:30:59.802260] [DEBUG] [LOCAL ] JXN: Primary data saved (43637 records). [2025-10-29T19:30:59.802474] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-29T19:30:59.803314] [INFO ] [MAIN ] Update Progress: 1173/2367 symbols completed. JXN took 34.2s. Estimated remaining: 2h 33m 40s. Rate: 7.8 symbols/min [2025-10-29T19:30:59.975699] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:00.001834] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T19:31:00.029046] [DEBUG] [LOCAL ] KBDC: Loaded 22598 existing records from primary storage. [2025-10-29T19:31:00.029282] [INFO ] [MAIN ] KBDC: Loaded 22598 existing records. [2025-10-29T19:31:00.204624] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:31:00.204869] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-29T19:31:00.204916] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-29T19:31:00.205358] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-29T19:31:00.205416] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-29T19:31:00.399822] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-29T19:31:00.558188] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:31:01.080711] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T19:31:01.193553] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-29T19:31:01.885197] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T19:31:01.993568] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-29T19:31:02.686139] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-29T19:31:02.793553] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-29T19:31:02.888477] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T19:31:03.476517] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-29T19:31:03.593557] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-29T19:31:04.260569] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-29T19:31:04.393555] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-29T19:31:05.193615] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-29T19:31:05.331896] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T19:31:05.993599] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-29T19:31:06.575469] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T19:31:06.721793] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-29T19:31:06.793575] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-29T19:31:07.593590] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-29T19:31:07.999892] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T19:31:08.008726] [INFO ] [REMOTE ] KAR: Full fetch complete (57066 records). [2025-10-29T19:31:08.008941] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-29T19:31:08.391524] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-29T19:31:08.391605] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-29T19:31:08.392431] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-29T19:31:08.392494] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-29T19:31:08.393743] [DEBUG] [LOCAL ] KAR: Trimmed 57066 records to 39528 (keeping 200 days of data) [2025-10-29T19:31:08.393560] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-29T19:31:08.608959] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-29T19:31:08.646296] [DEBUG] [LOCAL ] KAR: Primary data saved (39528 records). [2025-10-29T19:31:08.646432] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-29T19:31:08.646510] [INFO ] [MAIN ] Update Progress: 1174/2367 symbols completed. KAR took 25.3s. Estimated remaining: 2h 33m 33s. Rate: 7.8 symbols/min [2025-10-29T19:31:08.823827] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:08.868428] [DEBUG] [LOCAL ] KBH: Loaded 48535 existing records from primary storage. [2025-10-29T19:31:08.868784] [INFO ] [MAIN ] KBH: Loaded 48535 existing records. [2025-10-29T19:31:09.048392] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:31:09.048601] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-29T19:31:09.048669] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-29T19:31:09.049186] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-29T19:31:09.049227] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-29T19:31:09.202702] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-29T19:31:09.483125] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:31:09.837578] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T19:31:09.993533] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-29T19:31:10.070071] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-29T19:31:10.793555] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-29T19:31:11.567165] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-29T19:31:11.593527] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-29T19:31:11.651810] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-29T19:31:11.662268] [INFO ] [REMOTE ] K: Full fetch complete (72280 records). [2025-10-29T19:31:11.662406] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-29T19:31:12.055248] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-29T19:31:12.055337] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-29T19:31:12.056311] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-29T19:31:12.056377] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-29T19:31:12.057780] [DEBUG] [LOCAL ] K: Trimmed 72280 records to 50248 (keeping 200 days of data) [2025-10-29T19:31:12.315988] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T19:31:12.390115] [DEBUG] [LOCAL ] K: Primary data saved (50248 records). [2025-10-29T19:31:12.390264] [INFO ] [MAIN ] K: Full history saved. [2025-10-29T19:31:12.390352] [INFO ] [MAIN ] Update Progress: 1175/2367 symbols completed. K took 41.4s. Estimated remaining: 2h 33m 21s. Rate: 7.8 symbols/min [2025-10-29T19:31:12.401712] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-29T19:31:12.562892] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:12.605265] [DEBUG] [LOCAL ] KBR: Loaded 47937 existing records from primary storage. [2025-10-29T19:31:12.605588] [INFO ] [MAIN ] KBR: Loaded 47937 existing records. [2025-10-29T19:31:12.784170] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:31:12.784382] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-29T19:31:12.784428] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-29T19:31:12.785218] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-29T19:31:12.785275] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-29T19:31:13.138851] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:31:13.193557] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-29T19:31:13.821735] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-29T19:31:13.993625] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-29T19:31:14.347398] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T19:31:14.793540] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-29T19:31:15.217075] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-29T19:31:15.593627] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-29T19:31:16.393547] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-29T19:31:16.433259] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-29T19:31:17.051027] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-29T19:31:17.148091] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-29T19:31:17.193557] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-29T19:31:17.915001] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T19:31:17.993583] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-29T19:31:18.793564] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-29T19:31:19.115383] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T19:31:19.503236] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-29T19:31:19.593560] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-29T19:31:20.393556] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-29T19:31:20.528862] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T19:31:21.193572] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-29T19:31:21.727729] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T19:31:21.921552] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-29T19:31:21.993559] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-29T19:31:22.793557] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-29T19:31:22.857165] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-29T19:31:23.593630] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-29T19:31:23.612538] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-29T19:31:24.393630] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-29T19:31:24.798069] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T19:31:25.178348] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-29T19:31:25.193511] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-29T19:31:25.984194] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T19:31:25.988161] [INFO ] [REMOTE ] KB: Full fetch complete (33199 records). [2025-10-29T19:31:25.988236] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-29T19:31:25.999378] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-29T19:31:26.378243] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-29T19:31:26.378333] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-29T19:31:26.378982] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-29T19:31:26.379043] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-29T19:31:26.379952] [DEBUG] [LOCAL ] KB: Trimmed 33199 records to 22563 (keeping 200 days of data) [2025-10-29T19:31:26.509335] [DEBUG] [LOCAL ] KB: Primary data saved (22563 records). [2025-10-29T19:31:26.509453] [INFO ] [MAIN ] KB: Full history saved. [2025-10-29T19:31:26.509525] [INFO ] [MAIN ] Update Progress: 1176/2367 symbols completed. KB took 31.4s. Estimated remaining: 2h 33m 20s. Rate: 7.8 symbols/min [2025-10-29T19:31:26.679364] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:26.725717] [DEBUG] [LOCAL ] KD: Loaded 52294 existing records from primary storage. [2025-10-29T19:31:26.726030] [INFO ] [MAIN ] KD: Loaded 52294 existing records. [2025-10-29T19:31:26.801290] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-29T19:31:26.924087] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:31:26.924277] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-29T19:31:26.924322] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-29T19:31:26.925151] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-29T19:31:26.925209] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-29T19:31:27.275121] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:31:27.454969] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T19:31:27.593588] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-29T19:31:28.130423] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T19:31:28.393589] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-29T19:31:28.671587] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-29T19:31:28.678581] [INFO ] [REMOTE ] KBDC: Full fetch complete (31423 records). [2025-10-29T19:31:28.678726] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-29T19:31:29.055489] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-29T19:31:29.055576] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-29T19:31:29.056299] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-29T19:31:29.056350] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-29T19:31:29.057188] [DEBUG] [LOCAL ] KBDC: Trimmed 31423 records to 22648 (keeping 200 days of data) [2025-10-29T19:31:29.191104] [DEBUG] [LOCAL ] KBDC: Primary data saved (22648 records). [2025-10-29T19:31:29.191227] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-29T19:31:29.191303] [INFO ] [MAIN ] Update Progress: 1177/2367 symbols completed. KBDC took 29.4s. Estimated remaining: 2h 33m 7s. Rate: 7.8 symbols/min [2025-10-29T19:31:29.202421] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-29T19:31:29.402846] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:29.408985] [DEBUG] [LOCAL ] KEN: Loaded 4287 existing records from primary storage. [2025-10-29T19:31:29.409230] [INFO ] [MAIN ] KEN: Loaded 4287 existing records. [2025-10-29T19:31:29.601408] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:31:29.601762] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-29T19:31:29.601841] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-29T19:31:29.602173] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-29T19:31:29.602287] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-29T19:31:29.807044] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-29T19:31:30.002538] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:31:30.002680] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-29T19:31:30.365620] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T19:31:30.793565] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-29T19:31:31.281042] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T19:31:31.593607] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-29T19:31:32.084014] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T19:31:32.393775] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-29T19:31:32.767125] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T19:31:33.193547] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-29T19:31:33.463922] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T19:31:33.577137] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-29T19:31:33.993608] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-29T19:31:34.793564] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-29T19:31:35.162565] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T19:31:35.593607] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-29T19:31:36.264319] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T19:31:36.393560] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-29T19:31:36.881627] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T19:31:37.193591] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-29T19:31:37.807300] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-29T19:31:37.993559] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-29T19:31:38.506477] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-29T19:31:38.516624] [INFO ] [REMOTE ] KBR: Full fetch complete (70149 records). [2025-10-29T19:31:38.516836] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-29T19:31:38.798716] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-29T19:31:38.941173] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-29T19:31:38.941269] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-29T19:31:38.942226] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-29T19:31:38.942292] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-29T19:31:38.943787] [DEBUG] [LOCAL ] KBR: Trimmed 70149 records to 47946 (keeping 200 days of data) [2025-10-29T19:31:39.160944] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-29T19:31:39.238335] [DEBUG] [LOCAL ] KBR: Primary data saved (47946 records). [2025-10-29T19:31:39.238489] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-29T19:31:39.238571] [INFO ] [MAIN ] Update Progress: 1178/2367 symbols completed. KBR took 26.8s. Estimated remaining: 2h 33m 2s. Rate: 7.8 symbols/min [2025-10-29T19:31:39.415060] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:39.446113] [DEBUG] [LOCAL ] KEP: Loaded 32541 existing records from primary storage. [2025-10-29T19:31:39.446579] [INFO ] [MAIN ] KEP: Loaded 32541 existing records. [2025-10-29T19:31:39.601922] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-29T19:31:39.633855] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:31:39.635354] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-29T19:31:39.635476] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-29T19:31:39.636182] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-29T19:31:39.636278] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-29T19:31:39.792039] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-29T19:31:40.109878] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:31:40.393606] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-29T19:31:41.008447] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T19:31:41.083885] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-29T19:31:41.193627] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-29T19:31:41.915581] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T19:31:41.993607] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-29T19:31:42.337564] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-29T19:31:42.793558] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-29T19:31:43.593593] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-29T19:31:44.138969] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-29T19:31:44.178975] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T19:31:44.393601] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-29T19:31:44.780332] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-29T19:31:45.193562] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-29T19:31:45.597030] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T19:31:45.993617] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-29T19:31:46.793601] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-29T19:31:47.479683] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T19:31:47.569369] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-29T19:31:47.593612] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-29T19:31:48.393569] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-29T19:31:48.798120] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-29T19:31:49.004474] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-29T19:31:49.193626] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-29T19:31:49.993576] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-29T19:31:50.034263] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-29T19:31:50.793706] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-29T19:31:51.393047] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T19:31:51.591625] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-29T19:31:51.597721] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-29T19:31:52.393563] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-29T19:31:52.803351] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-29T19:31:52.965981] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-29T19:31:53.193560] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-29T19:31:53.993557] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-29T19:31:54.390045] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T19:31:54.469636] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T19:31:54.793567] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-29T19:31:55.593569] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-29T19:31:56.119243] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:31:56.130402] [INFO ] [REMOTE ] KBH: Full fetch complete (70940 records). [2025-10-29T19:31:56.130591] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-29T19:31:56.402293] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-29T19:31:56.558495] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-29T19:31:56.558825] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-29T19:31:56.560065] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-29T19:31:56.560136] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-29T19:31:56.561940] [DEBUG] [LOCAL ] KBH: Trimmed 70940 records to 48494 (keeping 200 days of data) [2025-10-29T19:31:56.801130] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T19:31:56.891935] [DEBUG] [LOCAL ] KBH: Primary data saved (48494 records). [2025-10-29T19:31:56.892065] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-29T19:31:56.892142] [INFO ] [MAIN ] Update Progress: 1179/2367 symbols completed. KBH took 48.2s. Estimated remaining: 2h 33m 4s. Rate: 7.8 symbols/min [2025-10-29T19:31:56.997953] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T19:31:57.012125] [INFO ] [REMOTE ] KEN: Full fetch complete (5821 records). [2025-10-29T19:31:57.012293] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-29T19:31:57.208146] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:57.203900] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-29T19:31:57.512023] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-29T19:31:57.511864] [DEBUG] [LOCAL ] KEX: Loaded 38656 existing records from primary storage. [2025-10-29T19:31:57.512273] [INFO ] [MAIN ] KEX: Loaded 38656 existing records. [2025-10-29T19:31:57.512191] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-29T19:31:57.546064] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-29T19:31:57.571446] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-29T19:31:57.598494] [DEBUG] [LOCAL ] KEN: Trimmed 5821 records to 4157 (keeping 200 days of data) [2025-10-29T19:31:57.730724] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:31:57.734331] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-29T19:31:57.734411] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-29T19:31:57.735349] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-29T19:31:57.736585] [DEBUG] [LOCAL ] KEN: Primary data saved (4157 records). [2025-10-29T19:31:57.736740] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-29T19:31:57.736836] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-29T19:31:57.771434] [INFO ] [MAIN ] Update Progress: 1180/2367 symbols completed. KEN took 28.6s. Estimated remaining: 2h 32m 49s. Rate: 7.8 symbols/min [2025-10-29T19:31:58.013788] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-29T19:31:58.211797] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:58.236210] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-29T19:31:58.251286] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-29T19:31:58.257301] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-29T19:31:58.272946] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-29T19:31:58.309536] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-29T19:31:58.330756] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:31:58.330895] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-29T19:31:58.702712] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:31:58.778160] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-29T19:31:58.793672] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-29T19:31:58.795712] [INFO ] [REMOTE ] KD: Full fetch complete (76050 records). [2025-10-29T19:31:58.795863] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-29T19:31:59.251049] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-29T19:31:59.251164] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-29T19:31:59.252197] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-29T19:31:59.252348] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-29T19:31:59.274301] [DEBUG] [LOCAL ] KD: Trimmed 76050 records to 52283 (keeping 200 days of data) [2025-10-29T19:31:59.276205] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T19:31:59.585337] [DEBUG] [LOCAL ] KD: Primary data saved (52283 records). [2025-10-29T19:31:59.585534] [INFO ] [MAIN ] KD: Full history saved. [2025-10-29T19:31:59.585665] [INFO ] [MAIN ] Update Progress: 1181/2367 symbols completed. KD took 33.1s. Estimated remaining: 2h 32m 36s. Rate: 7.8 symbols/min [2025-10-29T19:31:59.598726] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-29T19:31:59.763707] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:31:59.801413] [DEBUG] [LOCAL ] KEYS: Loaded 42890 existing records from primary storage. [2025-10-29T19:31:59.801717] [INFO ] [MAIN ] KEYS: Loaded 42890 existing records. [2025-10-29T19:31:59.984322] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:31:59.984675] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-29T19:31:59.984796] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-29T19:31:59.985540] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-29T19:31:59.985745] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-29T19:32:00.120118] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T19:32:00.396769] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-29T19:32:00.396709] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:32:00.766200] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T19:32:01.193562] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-29T19:32:01.705759] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T19:32:01.993580] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-29T19:32:02.257728] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-29T19:32:02.793610] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-29T19:32:03.462893] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T19:32:03.593591] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-29T19:32:04.059950] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:32:04.393614] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-29T19:32:05.041016] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T19:32:05.193601] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-29T19:32:05.532932] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T19:32:05.993619] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-29T19:32:06.543093] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-29T19:32:06.793637] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-29T19:32:07.170756] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-29T19:32:07.179149] [INFO ] [REMOTE ] KEP: Full fetch complete (42721 records). [2025-10-29T19:32:07.179305] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-29T19:32:07.598800] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-29T19:32:07.760321] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-29T19:32:07.760405] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-29T19:32:07.761260] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-29T19:32:07.761327] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-29T19:32:07.762418] [DEBUG] [LOCAL ] KEP: Trimmed 42721 records to 32621 (keeping 200 days of data) [2025-10-29T19:32:07.993614] [DEBUG] [LOCAL ] KEP: Primary data saved (32621 records). [2025-10-29T19:32:07.993772] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-29T19:32:07.993858] [INFO ] [MAIN ] Update Progress: 1182/2367 symbols completed. KEP took 28.8s. Estimated remaining: 2h 32m 29s. Rate: 7.8 symbols/min [2025-10-29T19:32:08.208185] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:32:08.212129] [DEBUG] [LOCAL ] KF: Loaded 2314 existing records from primary storage. [2025-10-29T19:32:08.212292] [INFO ] [MAIN ] KF: Loaded 2314 existing records. [2025-10-29T19:32:08.389189] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:32:08.389560] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-29T19:32:08.389637] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-29T19:32:08.389847] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-29T19:32:08.389901] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-29T19:32:08.400924] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-29T19:32:08.514772] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-29T19:32:08.775621] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:32:09.193532] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-29T19:32:09.567897] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-29T19:32:09.724380] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T19:32:09.993621] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-29T19:32:10.250140] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T19:32:10.304121] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-29T19:32:10.793598] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-29T19:32:11.593599] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-29T19:32:12.155966] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-29T19:32:12.393574] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-29T19:32:12.858131] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T19:32:13.193712] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-29T19:32:13.714856] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-29T19:32:13.993626] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-29T19:32:14.583396] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T19:32:14.793632] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-29T19:32:15.190197] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-29T19:32:15.593549] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-29T19:32:15.934683] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-29T19:32:15.984268] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-29T19:32:16.393631] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-29T19:32:16.746926] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-29T19:32:17.193622] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-29T19:32:17.645831] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-29T19:32:17.993638] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-29T19:32:18.461140] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-29T19:32:18.793600] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-29T19:32:19.593559] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-29T19:32:20.093846] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-29T19:32:20.128833] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T19:32:20.393550] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-29T19:32:21.193582] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-29T19:32:21.543592] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T19:32:21.993586] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-29T19:32:22.548111] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T19:32:22.793554] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-29T19:32:22.997462] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T19:32:23.593700] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-29T19:32:23.906233] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-29T19:32:24.242433] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T19:32:24.253623] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-29T19:32:24.253804] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-29T19:32:24.400953] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-29T19:32:24.448996] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-29T19:32:24.449825] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:32:24.449903] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:32:24.449975] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-29T19:32:24.450042] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-29T19:32:24.450079] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-29T19:32:24.450118] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-29T19:32:24.450173] [INFO ] [MAIN ] Update Progress: 1183/2367 symbols completed. KEY took 26.6s. Estimated remaining: 2h 32m 30s. Rate: 7.8 symbols/min [2025-10-29T19:32:24.620139] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:32:24.638410] [DEBUG] [LOCAL ] KFRC: Loaded 20978 existing records from primary storage. [2025-10-29T19:32:24.638663] [INFO ] [MAIN ] KFRC: Loaded 20978 existing records. [2025-10-29T19:32:24.813502] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:32:24.813785] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-29T19:32:24.813835] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-29T19:32:24.814283] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-29T19:32:24.814339] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-29T19:32:25.160833] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:32:25.193537] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-29T19:32:25.531037] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T19:32:25.857932] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-29T19:32:25.993570] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-29T19:32:26.618012] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T19:32:26.793623] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-29T19:32:27.593614] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-29T19:32:27.962273] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T19:32:28.393628] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-29T19:32:28.736678] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-29T19:32:28.741744] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T19:32:29.193574] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-29T19:32:29.525765] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T19:32:29.993554] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-29T19:32:30.718510] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T19:32:30.793616] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-29T19:32:31.199045] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-29T19:32:31.200109] [INFO ] [REMOTE ] KF: Full fetch complete (3414 records). [2025-10-29T19:32:31.200179] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-29T19:32:31.561959] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-29T19:32:31.562041] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-29T19:32:31.562187] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-29T19:32:31.562228] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-29T19:32:31.562596] [DEBUG] [LOCAL ] KF: Trimmed 3414 records to 2298 (keeping 200 days of data) [2025-10-29T19:32:31.576389] [DEBUG] [LOCAL ] KF: Primary data saved (2298 records). [2025-10-29T19:32:31.576509] [INFO ] [MAIN ] KF: Full history saved. [2025-10-29T19:32:31.576586] [INFO ] [MAIN ] Update Progress: 1184/2367 symbols completed. KF took 23.6s. Estimated remaining: 2h 32m 21s. Rate: 7.8 symbols/min [2025-10-29T19:32:31.598634] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-29T19:32:31.755046] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:32:31.765600] [DEBUG] [LOCAL ] KFS: Loaded 8698 existing records from primary storage. [2025-10-29T19:32:31.765948] [INFO ] [MAIN ] KFS: Loaded 8698 existing records. [2025-10-29T19:32:31.945937] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:32:31.946189] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-29T19:32:31.946253] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-29T19:32:31.946536] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-29T19:32:31.946608] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-29T19:32:32.302956] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:32:32.393540] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-29T19:32:32.851101] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-29T19:32:33.193601] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-29T19:32:33.542378] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T19:32:33.592269] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-29T19:32:33.993563] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-29T19:32:34.793606] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-29T19:32:35.165805] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-29T19:32:35.215462] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T19:32:35.593572] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-29T19:32:36.139493] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-29T19:32:36.393542] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-29T19:32:36.787787] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-29T19:32:37.193687] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-29T19:32:37.993608] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-29T19:32:38.554750] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-29T19:32:38.627572] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-29T19:32:38.637358] [INFO ] [REMOTE ] KEYS: Full fetch complete (63194 records). [2025-10-29T19:32:38.637532] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-29T19:32:38.801819] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-29T19:32:39.077198] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-29T19:32:39.077290] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-29T19:32:39.078324] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-29T19:32:39.078404] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-29T19:32:39.079808] [DEBUG] [LOCAL ] KEYS: Trimmed 63194 records to 42851 (keeping 200 days of data) [2025-10-29T19:32:39.363286] [DEBUG] [LOCAL ] KEYS: Primary data saved (42851 records). [2025-10-29T19:32:39.363419] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-29T19:32:39.363524] [INFO ] [MAIN ] Update Progress: 1185/2367 symbols completed. KEYS took 39.8s. Estimated remaining: 2h 32m 14s. Rate: 7.8 symbols/min [2025-10-29T19:32:39.554356] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:32:39.583431] [DEBUG] [LOCAL ] KFY: Loaded 28988 existing records from primary storage. [2025-10-29T19:32:39.593532] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-29T19:32:39.593719] [INFO ] [MAIN ] KFY: Loaded 28988 existing records. [2025-10-29T19:32:39.607842] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-29T19:32:39.808831] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:32:39.809118] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-29T19:32:39.809193] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-29T19:32:39.809919] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-29T19:32:39.809994] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-29T19:32:40.235140] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-29T19:32:40.258269] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:32:40.393568] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-29T19:32:41.091036] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T19:32:41.193576] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-29T19:32:41.993574] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-29T19:32:42.474090] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-29T19:32:42.483696] [INFO ] [REMOTE ] KEX: Full fetch complete (56275 records). [2025-10-29T19:32:42.483868] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-29T19:32:42.605222] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T19:32:42.798690] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-29T19:32:42.885278] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-29T19:32:42.885373] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-29T19:32:42.886250] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-29T19:32:42.886315] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-29T19:32:42.887536] [DEBUG] [LOCAL ] KEX: Trimmed 56275 records to 38736 (keeping 200 days of data) [2025-10-29T19:32:43.122776] [DEBUG] [LOCAL ] KEX: Primary data saved (38736 records). [2025-10-29T19:32:43.122955] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-29T19:32:43.123040] [INFO ] [MAIN ] Update Progress: 1186/2367 symbols completed. KEX took 46.2s. Estimated remaining: 2h 32m 2s. Rate: 7.8 symbols/min [2025-10-29T19:32:43.295638] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:32:43.349940] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-29T19:32:43.350321] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-29T19:32:43.534818] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:32:43.535054] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-29T19:32:43.535101] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-29T19:32:43.535509] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-29T19:32:43.535566] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-29T19:32:43.599191] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-29T19:32:43.911313] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:32:43.929216] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T19:32:44.150694] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-29T19:32:44.393612] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-29T19:32:44.904903] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T19:32:45.193560] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-29T19:32:45.993684] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-29T19:32:46.515031] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T19:32:46.793601] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-29T19:32:46.936436] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T19:32:47.593591] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-29T19:32:48.336142] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-29T19:32:48.365028] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-29T19:32:48.393588] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-29T19:32:48.865304] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-29T19:32:49.193556] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-29T19:32:49.849756] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T19:32:49.852495] [INFO ] [REMOTE ] KFS: Full fetch complete (11379 records). [2025-10-29T19:32:49.852681] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-29T19:32:49.998739] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-29T19:32:50.238837] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-29T19:32:50.238921] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-29T19:32:50.239195] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-29T19:32:50.239233] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-29T19:32:50.239782] [DEBUG] [LOCAL ] KFS: Trimmed 11379 records to 8705 (keeping 200 days of data) [2025-10-29T19:32:50.289453] [DEBUG] [LOCAL ] KFS: Primary data saved (8705 records). [2025-10-29T19:32:50.289585] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-29T19:32:50.289701] [INFO ] [MAIN ] Update Progress: 1187/2367 symbols completed. KFS took 18.7s. Estimated remaining: 2h 31m 54s. Rate: 7.8 symbols/min [2025-10-29T19:32:50.459605] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:32:50.501298] [DEBUG] [LOCAL ] KGS: Loaded 45848 existing records from primary storage. [2025-10-29T19:32:50.501623] [INFO ] [MAIN ] KGS: Loaded 45848 existing records. [2025-10-29T19:32:50.678261] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:32:50.678489] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-29T19:32:50.678536] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-29T19:32:50.679181] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-29T19:32:50.679241] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-29T19:32:50.796463] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-29T19:32:51.096170] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:32:51.119082] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-29T19:32:51.593556] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-29T19:32:52.343680] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T19:32:52.393567] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-29T19:32:52.463729] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-29T19:32:53.193578] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-29T19:32:53.374908] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-29T19:32:53.380410] [INFO ] [REMOTE ] KFRC: Full fetch complete (27504 records). [2025-10-29T19:32:53.380525] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-29T19:32:53.767365] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-29T19:32:53.767472] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-29T19:32:53.768066] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-29T19:32:53.768125] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-29T19:32:53.768874] [DEBUG] [LOCAL ] KFRC: Trimmed 27504 records to 21047 (keeping 200 days of data) [2025-10-29T19:32:53.894252] [DEBUG] [LOCAL ] KFRC: Primary data saved (21047 records). [2025-10-29T19:32:53.894370] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-29T19:32:53.894443] [INFO ] [MAIN ] Update Progress: 1188/2367 symbols completed. KFRC took 29.4s. Estimated remaining: 2h 31m 42s. Rate: 7.8 symbols/min [2025-10-29T19:32:54.002945] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-29T19:32:54.080945] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:32:54.131323] [DEBUG] [LOCAL ] KIM: Loaded 52988 existing records from primary storage. [2025-10-29T19:32:54.131696] [INFO ] [MAIN ] KIM: Loaded 52988 existing records. [2025-10-29T19:32:54.313839] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:32:54.314066] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-29T19:32:54.314115] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-29T19:32:54.315241] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-29T19:32:54.315300] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-29T19:32:54.690796] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:32:54.793554] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-29T19:32:54.989663] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-29T19:32:55.212901] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T19:32:55.593574] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-29T19:32:56.000799] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T19:32:56.393613] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-29T19:32:57.193597] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-29T19:32:57.342715] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-29T19:32:57.493733] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-29T19:32:57.993629] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-29T19:32:58.245570] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T19:32:58.793633] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-29T19:32:59.159026] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T19:32:59.593567] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-29T19:33:00.325899] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T19:33:00.393524] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-29T19:33:00.838571] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-29T19:33:01.193558] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-29T19:33:02.007215] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-29T19:33:02.037599] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T19:33:02.546429] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T19:33:02.793569] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-29T19:33:03.045383] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T19:33:03.593527] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-29T19:33:03.748146] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-29T19:33:04.393599] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-29T19:33:04.912388] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T19:33:05.193610] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-29T19:33:05.993534] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-29T19:33:06.163553] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-29T19:33:06.401901] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-29T19:33:06.793565] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-29T19:33:07.288412] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-29T19:33:07.593556] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-29T19:33:08.274664] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-29T19:33:08.364383] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-29T19:33:08.393540] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-29T19:33:09.193585] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-29T19:33:09.631417] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:33:09.993619] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-29T19:33:10.321981] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-29T19:33:10.793600] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-29T19:33:11.159965] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T19:33:11.593572] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-29T19:33:12.393619] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-29T19:33:12.663065] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-29T19:33:12.712264] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-29T19:33:13.193533] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-29T19:33:13.233447] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-29T19:33:13.993606] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-29T19:33:14.793612] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-29T19:33:15.220529] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-29T19:33:15.411771] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-29T19:33:15.422768] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-29T19:33:15.422894] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-29T19:33:15.598777] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-29T19:33:15.836243] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-29T19:33:15.836406] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-29T19:33:15.837495] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-29T19:33:15.837610] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-29T19:33:15.854213] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T19:33:15.860618] [INFO ] [REMOTE ] KFY: Full fetch complete (43266 records). [2025-10-29T19:33:15.860756] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-29T19:33:15.860970] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 53699 (keeping 200 days of data) [2025-10-29T19:33:16.393678] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-29T19:33:16.461144] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-29T19:33:16.466007] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-29T19:33:16.475547] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-29T19:33:16.480558] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-29T19:33:16.485706] [DEBUG] [LOCAL ] KFY: Trimmed 43266 records to 29008 (keeping 200 days of data) [2025-10-29T19:33:16.680433] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-29T19:33:16.684229] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-29T19:33:16.684811] [INFO ] [MAIN ] Update Progress: 1189/2367 symbols completed. KGC took 33.6s. Estimated remaining: 2h 31m 49s. Rate: 7.8 symbols/min [2025-10-29T19:33:16.914123] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:33:16.927013] [DEBUG] [LOCAL ] KFY: Primary data saved (29008 records). [2025-10-29T19:33:16.927221] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-29T19:33:16.927325] [INFO ] [MAIN ] Update Progress: 1190/2367 symbols completed. KFY took 37.6s. Estimated remaining: 2h 31m 34s. Rate: 7.8 symbols/min [2025-10-29T19:33:17.067156] [DEBUG] [LOCAL ] KIO: Loaded 21659 existing records from primary storage. [2025-10-29T19:33:17.079540] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-29T19:33:17.084772] [INFO ] [MAIN ] KIO: Loaded 21659 existing records. [2025-10-29T19:33:17.221812] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-29T19:33:17.221401] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:33:17.352423] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:33:17.353497] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-29T19:33:17.353554] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-29T19:33:17.353864] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-29T19:33:17.353922] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-29T19:33:17.633797] [DEBUG] [LOCAL ] KKR: Loaded 53492 existing records from primary storage. [2025-10-29T19:33:17.679828] [INFO ] [MAIN ] KKR: Loaded 53492 existing records. [2025-10-29T19:33:17.894870] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:33:17.961562] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:33:17.961862] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-29T19:33:17.962026] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-29T19:33:17.963115] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-29T19:33:17.963173] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-29T19:33:17.996452] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-29T19:33:18.183747] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-29T19:33:18.393713] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:33:18.447789] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-29T19:33:18.793544] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-29T19:33:18.873585] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T19:33:19.593568] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-29T19:33:20.168346] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-29T19:33:20.207725] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T19:33:20.393599] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-29T19:33:21.193582] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-29T19:33:21.644263] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:33:21.993561] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-29T19:33:22.708427] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-29T19:33:22.793551] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-29T19:33:23.326263] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:33:23.336095] [INFO ] [REMOTE ] KGS: Full fetch complete (66586 records). [2025-10-29T19:33:23.336283] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-29T19:33:23.598859] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-29T19:33:23.741286] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-29T19:33:23.741377] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-29T19:33:23.742275] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-29T19:33:23.742340] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-29T19:33:23.743639] [DEBUG] [LOCAL ] KGS: Trimmed 66586 records to 45851 (keeping 200 days of data) [2025-10-29T19:33:24.023374] [DEBUG] [LOCAL ] KGS: Primary data saved (45851 records). [2025-10-29T19:33:24.023526] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-29T19:33:24.023636] [INFO ] [MAIN ] Update Progress: 1191/2367 symbols completed. KGS took 33.7s. Estimated remaining: 2h 31m 26s. Rate: 7.8 symbols/min [2025-10-29T19:33:24.195677] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:33:24.202723] [DEBUG] [LOCAL ] KKRS: Loaded 5436 existing records from primary storage. [2025-10-29T19:33:24.202922] [INFO ] [MAIN ] KKRS: Loaded 5436 existing records. [2025-10-29T19:33:24.396911] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-29T19:33:24.396791] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:33:24.397752] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-29T19:33:24.412094] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-29T19:33:24.413303] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T19:33:24.419232] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-29T19:33:24.419571] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-29T19:33:24.632218] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-29T19:33:24.843852] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:33:25.193542] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-29T19:33:25.955816] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-29T19:33:25.993510] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-29T19:33:26.089542] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-29T19:33:26.100938] [INFO ] [REMOTE ] KIM: Full fetch complete (76974 records). [2025-10-29T19:33:26.101081] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-29T19:33:26.500178] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-29T19:33:26.500265] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-29T19:33:26.501254] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-29T19:33:26.501318] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-29T19:33:26.502736] [DEBUG] [LOCAL ] KIM: Trimmed 76974 records to 52988 (keeping 200 days of data) [2025-10-29T19:33:26.799163] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-29T19:33:26.825228] [DEBUG] [LOCAL ] KIM: Primary data saved (52988 records). [2025-10-29T19:33:26.825444] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-29T19:33:26.826431] [INFO ] [MAIN ] Update Progress: 1192/2367 symbols completed. KIM took 32.9s. Estimated remaining: 2h 31m 13s. Rate: 7.8 symbols/min [2025-10-29T19:33:26.945383] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T19:33:27.019749] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:33:27.019951] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-29T19:33:27.019988] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-29T19:33:27.020098] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-29T19:33:27.020138] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-29T19:33:27.020178] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-29T19:33:27.020209] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-29T19:33:27.250633] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-29T19:33:27.386252] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:33:27.593547] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-29T19:33:27.732083] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T19:33:27.732393] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-29T19:33:27.732519] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:33:27.732603] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-29T19:33:27.732709] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:33:27.732796] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-29T19:33:27.732883] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-29T19:33:27.732936] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-29T19:33:27.732997] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-29T19:33:27.733062] [INFO ] [MAIN ] Update Progress: 1193/2367 symbols completed. KKRT took 0.9s. Estimated remaining: 2h 30m 59s. Rate: 7.8 symbols/min [2025-10-29T19:33:27.900291] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:33:27.900498] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-29T19:33:27.900535] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-29T19:33:27.900670] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-29T19:33:27.900727] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-29T19:33:27.900770] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-29T19:33:27.900801] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-29T19:33:28.244127] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:33:28.393567] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-29T19:33:29.070136] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T19:33:29.193609] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-29T19:33:29.993614] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-29T19:33:30.024658] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-29T19:33:30.793544] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-29T19:33:31.170981] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-29T19:33:31.528386] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T19:33:31.593574] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-29T19:33:31.740989] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T19:33:31.741407] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-29T19:33:31.741532] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:33:31.741623] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-29T19:33:31.741720] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:33:31.741775] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-29T19:33:31.741838] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-29T19:33:31.742057] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-29T19:33:31.742097] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-29T19:33:31.742148] [INFO ] [MAIN ] Update Progress: 1194/2367 symbols completed. KLAR took 4.0s. Estimated remaining: 2h 30m 47s. Rate: 7.8 symbols/min [2025-10-29T19:33:31.933692] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:33:31.969058] [DEBUG] [LOCAL ] KLC: Loaded 35763 existing records from primary storage. [2025-10-29T19:33:31.969332] [INFO ] [MAIN ] KLC: Loaded 35763 existing records. [2025-10-29T19:33:32.141066] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:33:32.141270] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-29T19:33:32.141315] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-29T19:33:32.141907] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-29T19:33:32.141964] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-29T19:33:32.398740] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-29T19:33:32.502974] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:33:33.193538] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-29T19:33:33.238221] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-29T19:33:33.993519] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-29T19:33:34.071569] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-29T19:33:34.793617] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-29T19:33:35.522366] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T19:33:35.559003] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-29T19:33:35.593524] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-29T19:33:36.393671] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-29T19:33:36.633709] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-29T19:33:36.643177] [INFO ] [REMOTE ] KIO: Full fetch complete (32612 records). [2025-10-29T19:33:36.643398] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-29T19:33:36.804098] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-29T19:33:37.136231] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-29T19:33:37.136327] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-29T19:33:37.137082] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-29T19:33:37.137154] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-29T19:33:37.138183] [DEBUG] [LOCAL ] KIO: Trimmed 32612 records to 21640 (keeping 200 days of data) [2025-10-29T19:33:37.203602] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-29T19:33:37.280805] [DEBUG] [LOCAL ] KIO: Primary data saved (21640 records). [2025-10-29T19:33:37.280932] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-29T19:33:37.281008] [INFO ] [MAIN ] Update Progress: 1195/2367 symbols completed. KIO took 20.6s. Estimated remaining: 2h 30m 37s. Rate: 7.8 symbols/min [2025-10-29T19:33:37.456495] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:33:37.503869] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-29T19:33:37.504199] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-29T19:33:37.682849] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:33:37.683083] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-29T19:33:37.683129] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-29T19:33:37.683993] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-29T19:33:37.684050] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-29T19:33:38.006143] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-29T19:33:38.050751] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:33:38.088369] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-29T19:33:38.530237] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-29T19:33:38.793723] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-29T19:33:39.593627] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-29T19:33:40.396607] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-29T19:33:40.402341] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-29T19:33:40.785721] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-29T19:33:41.100231] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-29T19:33:41.193627] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-29T19:33:41.993536] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-29T19:33:42.106227] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-29T19:33:42.793577] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-29T19:33:43.162970] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-29T19:33:43.593530] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-29T19:33:43.803382] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-29T19:33:43.942125] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-29T19:33:44.393561] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-29T19:33:44.919798] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-29T19:33:45.193566] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-29T19:33:45.993547] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-29T19:33:46.389200] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T19:33:46.793552] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-29T19:33:47.102056] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-29T19:33:47.234900] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-29T19:33:47.236139] [INFO ] [REMOTE ] KKRS: Full fetch complete (7465 records). [2025-10-29T19:33:47.236205] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-29T19:33:47.590490] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-29T19:33:47.590568] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-29T19:33:47.590935] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-29T19:33:47.591009] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-29T19:33:47.591430] [DEBUG] [LOCAL ] KKRS: Trimmed 7465 records to 5405 (keeping 200 days of data) [2025-10-29T19:33:47.605169] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-29T19:33:47.626686] [DEBUG] [LOCAL ] KKRS: Primary data saved (5405 records). [2025-10-29T19:33:47.626779] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-29T19:33:47.626857] [INFO ] [MAIN ] Update Progress: 1196/2367 symbols completed. KKRS took 23.6s. Estimated remaining: 2h 30m 32s. Rate: 7.8 symbols/min [2025-10-29T19:33:47.798448] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:33:47.803221] [DEBUG] [LOCAL ] KMPB: Loaded 3417 existing records from primary storage. [2025-10-29T19:33:47.803378] [INFO ] [MAIN ] KMPB: Loaded 3417 existing records. [2025-10-29T19:33:47.976101] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:33:47.976350] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-29T19:33:47.976410] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-29T19:33:47.976588] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-29T19:33:47.976628] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-29T19:33:48.329420] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:33:48.393526] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-29T19:33:48.795468] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-29T19:33:49.175186] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-29T19:33:49.193546] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-29T19:33:49.503762] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-29T19:33:49.993586] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-29T19:33:50.793563] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-29T19:33:51.026900] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T19:33:51.593582] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-29T19:33:52.373462] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-29T19:33:52.393558] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-29T19:33:53.134308] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-29T19:33:53.193521] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-29T19:33:53.846207] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-29T19:33:53.993525] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-29T19:33:54.159000] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-29T19:33:54.370120] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-29T19:33:54.793549] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-29T19:33:55.593583] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-29T19:33:55.733755] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-29T19:33:56.393628] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-29T19:33:57.198763] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-29T19:33:57.218156] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-29T19:33:57.230112] [INFO ] [REMOTE ] KKR: Full fetch complete (77655 records). [2025-10-29T19:33:57.230235] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-29T19:33:57.591771] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-29T19:33:57.659291] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-29T19:33:57.659905] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-29T19:33:57.660948] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-29T19:33:57.661874] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-29T19:33:57.661975] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-29T19:33:57.670574] [DEBUG] [LOCAL ] KKR: Trimmed 77655 records to 53492 (keeping 200 days of data) [2025-10-29T19:33:57.992900] [DEBUG] [LOCAL ] KKR: Primary data saved (53492 records). [2025-10-29T19:33:57.993035] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-29T19:33:57.993113] [INFO ] [MAIN ] Update Progress: 1197/2367 symbols completed. KKR took 41.1s. Estimated remaining: 2h 30m 27s. Rate: 7.8 symbols/min [2025-10-29T19:33:57.993517] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-29T19:33:58.793613] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-29T19:33:58.923439] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-29T19:33:59.043060] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-29T19:33:59.593625] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-29T19:34:00.393603] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-29T19:34:00.981363] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-29T19:34:01.193514] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-29T19:34:01.445710] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-29T19:34:01.811009] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-29T19:34:01.993619] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-29T19:34:02.793632] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-29T19:34:03.009242] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-29T19:34:03.593571] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-29T19:34:04.010376] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-29T19:34:04.230362] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-29T19:34:04.393541] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-29T19:34:05.193538] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-29T19:34:05.523347] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-29T19:34:05.671871] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T19:34:05.993728] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-29T19:34:06.496229] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-29T19:34:06.497283] [INFO ] [REMOTE ] KMPB: Full fetch complete (4909 records). [2025-10-29T19:34:06.497349] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-29T19:34:06.798760] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-29T19:34:06.861919] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-29T19:34:06.862041] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-29T19:34:06.862205] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-29T19:34:06.862244] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-29T19:34:06.862597] [DEBUG] [LOCAL ] KMPB: Trimmed 4909 records to 3398 (keeping 200 days of data) [2025-10-29T19:34:06.883540] [DEBUG] [LOCAL ] KMPB: Primary data saved (3398 records). [2025-10-29T19:34:06.883616] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-29T19:34:06.883731] [INFO ] [MAIN ] Update Progress: 1198/2367 symbols completed. KMPB took 19.3s. Estimated remaining: 2h 30m 21s. Rate: 7.8 symbols/min [2025-10-29T19:34:07.593576] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-29T19:34:08.412327] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-29T19:34:08.424101] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-29T19:34:08.817052] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T19:34:08.824970] [INFO ] [REMOTE ] KLC: Full fetch complete (50763 records). [2025-10-29T19:34:08.825083] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-29T19:34:09.207830] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-29T19:34:09.207910] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-29T19:34:09.208703] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-29T19:34:09.208763] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-29T19:34:09.209863] [DEBUG] [LOCAL ] KLC: Trimmed 50763 records to 35762 (keeping 200 days of data) [2025-10-29T19:34:09.404315] [DEBUG] [LOCAL ] KLC: Primary data saved (35762 records). [2025-10-29T19:34:09.404448] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-29T19:34:09.404525] [INFO ] [MAIN ] Update Progress: 1199/2367 symbols completed. KLC took 37.7s. Estimated remaining: 2h 30m 8s. Rate: 7.8 symbols/min [2025-10-29T19:34:09.918904] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-29T19:34:09.930389] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-29T19:34:11.372611] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-29T19:34:11.385068] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-29T19:34:12.187060] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-29T19:34:12.199707] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-29T19:34:12.199915] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-29T19:34:12.615041] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-29T19:34:12.615160] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-29T19:34:12.616796] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-29T19:34:12.616874] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-29T19:34:12.618923] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-29T19:34:12.988735] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-29T19:34:12.988976] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-29T19:34:12.989086] [INFO ] [MAIN ] Update Progress: 1200/2367 symbols completed. KMI took 35.7s. Estimated remaining: 2h 29m 56s. Rate: 7.8 symbols/min [2025-10-29T19:34:13.630226] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:34:13.750189] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:34:13.795777] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:34:13.800498] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:34:13.850254] [DEBUG] [LOCAL ] KN: Loaded 38185 existing records from primary storage. [2025-10-29T19:34:13.869782] [INFO ] [MAIN ] KN: Loaded 38185 existing records. [2025-10-29T19:34:14.000618] [DEBUG] [LOCAL ] KMX: Loaded 53284 existing records from primary storage. [2025-10-29T19:34:14.017186] [DEBUG] [LOCAL ] KMPR: Loaded 40506 existing records from primary storage. [2025-10-29T19:34:14.017594] [INFO ] [MAIN ] KMX: Loaded 53284 existing records. [2025-10-29T19:34:14.018508] [DEBUG] [LOCAL ] KMT: Loaded 42364 existing records from primary storage. [2025-10-29T19:34:14.052546] [INFO ] [MAIN ] KMPR: Loaded 40506 existing records. [2025-10-29T19:34:14.047200] [INFO ] [MAIN ] KMT: Loaded 42364 existing records. [2025-10-29T19:34:14.347926] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:34:14.389854] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-29T19:34:14.439677] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-29T19:34:14.644903] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:34:14.625625] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-29T19:34:14.654011] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-29T19:34:14.653916] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-29T19:34:14.649354] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:34:14.654375] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-29T19:34:14.660177] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-29T19:34:14.684226] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-29T19:34:14.725382] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-29T19:34:14.739744] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-29T19:34:14.784717] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-29T19:34:14.888011] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:34:14.877873] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-29T19:34:14.922352] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-29T19:34:15.005103] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-29T19:34:15.088292] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-29T19:34:15.199920] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-29T19:34:15.957724] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:34:15.966255] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-29T19:34:15.965863] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:34:16.015875] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-29T19:34:16.176138] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:34:16.206909] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-29T19:34:16.322095] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:34:16.322427] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-29T19:34:17.292578] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T19:34:17.298623] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-29T19:34:17.344068] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T19:34:17.351998] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-29T19:34:17.547341] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-29T19:34:17.555304] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-29T19:34:18.127770] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-29T19:34:18.156485] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T19:34:18.162734] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-29T19:34:18.163282] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-29T19:34:18.253412] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T19:34:18.261405] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-29T19:34:18.565152] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:34:18.793552] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-29T19:34:18.970136] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T19:34:19.301535] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-29T19:34:19.334780] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T19:34:19.593544] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-29T19:34:20.018710] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T19:34:20.393596] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-29T19:34:21.128268] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T19:34:21.193527] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-29T19:34:21.518450] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T19:34:21.993630] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-29T19:34:22.719236] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T19:34:22.793527] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-29T19:34:23.002024] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T19:34:23.593621] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-29T19:34:23.928049] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T19:34:24.393729] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-29T19:34:24.575179] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T19:34:25.193571] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-29T19:34:25.699749] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-29T19:34:25.993558] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-29T19:34:26.111007] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-29T19:34:26.795868] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-29T19:34:26.795684] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-29T19:34:27.593608] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-29T19:34:28.030574] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T19:34:28.393566] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-29T19:34:28.928985] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:34:29.193600] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-29T19:34:29.534395] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T19:34:29.993599] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-29T19:34:30.514114] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T19:34:30.793599] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-29T19:34:31.142737] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T19:34:31.593587] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-29T19:34:32.085616] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T19:34:32.393543] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-29T19:34:32.603265] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T19:34:33.193588] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-29T19:34:33.880495] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T19:34:33.993552] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-29T19:34:34.139547] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-29T19:34:34.793554] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-29T19:34:35.140531] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T19:34:35.593574] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-29T19:34:36.393570] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-29T19:34:36.709469] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-29T19:34:36.727421] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-29T19:34:36.725847] [INFO ] [REMOTE ] KMX: Full fetch complete (76444 records). [2025-10-29T19:34:36.740810] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-29T19:34:37.137543] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-29T19:34:37.137624] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-29T19:34:37.138609] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-29T19:34:37.138689] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-29T19:34:37.140045] [DEBUG] [LOCAL ] KMX: Trimmed 76444 records to 53283 (keeping 200 days of data) [2025-10-29T19:34:37.195609] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-29T19:34:37.471141] [DEBUG] [LOCAL ] KMX: Primary data saved (53283 records). [2025-10-29T19:34:37.471343] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-29T19:34:37.471571] [INFO ] [MAIN ] Update Progress: 1201/2367 symbols completed. KMX took 24.5s. Estimated remaining: 2h 30m 5s. Rate: 7.8 symbols/min [2025-10-29T19:34:37.647047] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:34:37.677221] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T19:34:37.717802] [DEBUG] [LOCAL ] KNF: Loaded 36657 existing records from primary storage. [2025-10-29T19:34:37.718127] [INFO ] [MAIN ] KNF: Loaded 36657 existing records. [2025-10-29T19:34:37.895204] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:34:37.895458] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-29T19:34:37.895537] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-29T19:34:37.896052] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-29T19:34:37.896142] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-29T19:34:37.999252] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-29T19:34:38.278444] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:34:38.376539] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-29T19:34:38.793561] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-29T19:34:39.217934] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T19:34:39.593534] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-29T19:34:39.791000] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-29T19:34:40.393599] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-29T19:34:40.772204] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T19:34:41.193551] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-29T19:34:41.403164] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:34:41.993567] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-29T19:34:42.396976] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-29T19:34:42.793625] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-29T19:34:43.593608] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-29T19:34:43.737371] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-29T19:34:43.747051] [INFO ] [REMOTE ] KMPR: Full fetch complete (54084 records). [2025-10-29T19:34:43.747176] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-29T19:34:44.117274] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T19:34:44.221534] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-29T19:34:44.221688] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-29T19:34:44.223153] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-29T19:34:44.223238] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-29T19:34:44.225085] [DEBUG] [LOCAL ] KMPR: Trimmed 54084 records to 40558 (keeping 200 days of data) [2025-10-29T19:34:44.417496] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-29T19:34:44.501680] [DEBUG] [LOCAL ] KMPR: Primary data saved (40558 records). [2025-10-29T19:34:44.501862] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-29T19:34:44.501961] [INFO ] [MAIN ] Update Progress: 1202/2367 symbols completed. KMPR took 31.5s. Estimated remaining: 2h 29m 56s. Rate: 7.8 symbols/min [2025-10-29T19:34:44.682130] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:34:44.694688] [DEBUG] [LOCAL ] KNOP: Loaded 9773 existing records from primary storage. [2025-10-29T19:34:44.694955] [INFO ] [MAIN ] KNOP: Loaded 9773 existing records. [2025-10-29T19:34:44.876505] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:34:44.876831] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-29T19:34:44.876885] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-29T19:34:44.877109] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-29T19:34:44.877168] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-29T19:34:45.195599] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-29T19:34:45.270263] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:34:45.297480] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-29T19:34:45.306439] [INFO ] [REMOTE ] KMT: Full fetch complete (61784 records). [2025-10-29T19:34:45.306616] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-29T19:34:45.704880] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-29T19:34:45.704979] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-29T19:34:45.706291] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-29T19:34:45.706360] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-29T19:34:45.708187] [DEBUG] [LOCAL ] KMT: Trimmed 61784 records to 42323 (keeping 200 days of data) [2025-10-29T19:34:45.978208] [DEBUG] [LOCAL ] KMT: Primary data saved (42323 records). [2025-10-29T19:34:45.978390] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-29T19:34:45.978490] [INFO ] [MAIN ] Update Progress: 1203/2367 symbols completed. KMT took 33.0s. Estimated remaining: 2h 29m 43s. Rate: 7.8 symbols/min [2025-10-29T19:34:46.013225] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-29T19:34:46.168030] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:34:46.190340] [DEBUG] [LOCAL ] KNSL: Loaded 18536 existing records from primary storage. [2025-10-29T19:34:46.190678] [INFO ] [MAIN ] KNSL: Loaded 18536 existing records. [2025-10-29T19:34:46.388841] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:34:46.389280] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-29T19:34:46.389367] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-29T19:34:46.389932] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-29T19:34:46.390095] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-29T19:34:46.497612] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-29T19:34:46.814716] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:34:46.793895] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-29T19:34:46.849635] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-29T19:34:46.860687] [INFO ] [REMOTE ] KN: Full fetch complete (56844 records). [2025-10-29T19:34:46.861105] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-29T19:34:47.208839] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T19:34:47.316514] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-29T19:34:47.316865] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-29T19:34:47.318265] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-29T19:34:47.318331] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-29T19:34:47.320110] [DEBUG] [LOCAL ] KN: Trimmed 56844 records to 38099 (keeping 200 days of data) [2025-10-29T19:34:47.563010] [DEBUG] [LOCAL ] KN: Primary data saved (38099 records). [2025-10-29T19:34:47.563252] [INFO ] [MAIN ] KN: Full history saved. [2025-10-29T19:34:47.563399] [INFO ] [MAIN ] Update Progress: 1204/2367 symbols completed. KN took 34.5s. Estimated remaining: 2h 29m 29s. Rate: 7.8 symbols/min [2025-10-29T19:34:47.598726] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-29T19:34:47.786568] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:34:47.837934] [DEBUG] [LOCAL ] KNTK: Loaded 47159 existing records from primary storage. [2025-10-29T19:34:47.838465] [INFO ] [MAIN ] KNTK: Loaded 47159 existing records. [2025-10-29T19:34:48.037015] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:34:48.037512] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-29T19:34:48.037680] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-29T19:34:48.046247] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-29T19:34:48.057580] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-29T19:34:48.092893] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T19:34:48.321371] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-29T19:34:48.398750] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-29T19:34:48.480312] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:34:49.193604] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-29T19:34:49.332785] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T19:34:49.703203] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-29T19:34:49.993590] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-29T19:34:50.622336] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-29T19:34:50.793582] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-29T19:34:51.593599] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-29T19:34:51.986007] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T19:34:52.126193] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-29T19:34:52.393534] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-29T19:34:53.146099] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T19:34:53.193521] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-29T19:34:53.914421] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-29T19:34:53.993588] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-29T19:34:54.793624] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-29T19:34:55.086617] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T19:34:55.593555] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-29T19:34:55.836057] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-29T19:34:56.367409] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-29T19:34:56.393538] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-29T19:34:57.037912] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-29T19:34:57.193581] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-29T19:34:57.993543] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-29T19:34:58.188400] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T19:34:58.541790] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-29T19:34:58.793574] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-29T19:34:59.571007] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T19:34:59.593514] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-29T19:35:00.351409] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-29T19:35:00.393515] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-29T19:35:01.193535] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-29T19:35:01.278881] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-29T19:35:01.820762] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-29T19:35:01.993607] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-29T19:35:02.537702] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-29T19:35:02.793693] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-29T19:35:03.593579] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-29T19:35:03.730834] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T19:35:03.735782] [INFO ] [REMOTE ] KNSL: Full fetch complete (27324 records). [2025-10-29T19:35:03.735875] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-29T19:35:04.135848] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-29T19:35:04.135981] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-29T19:35:04.136537] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-29T19:35:04.136899] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-29T19:35:04.137569] [DEBUG] [LOCAL ] KNSL: Trimmed 27324 records to 18670 (keeping 200 days of data) [2025-10-29T19:35:04.251243] [DEBUG] [LOCAL ] KNSL: Primary data saved (18670 records). [2025-10-29T19:35:04.251378] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-29T19:35:04.251455] [INFO ] [MAIN ] Update Progress: 1205/2367 symbols completed. KNSL took 18.3s. Estimated remaining: 2h 29m 30s. Rate: 7.8 symbols/min [2025-10-29T19:35:04.405053] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-29T19:35:04.440838] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:35:04.489848] [DEBUG] [LOCAL ] KNX: Loaded 52642 existing records from primary storage. [2025-10-29T19:35:04.490156] [INFO ] [MAIN ] KNX: Loaded 52642 existing records. [2025-10-29T19:35:04.687847] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:35:04.688100] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-29T19:35:04.688159] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-29T19:35:04.688500] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-29T19:35:04.688542] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-29T19:35:05.076886] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:35:05.108341] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-29T19:35:05.193558] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-29T19:35:05.593040] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-29T19:35:05.611517] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-29T19:35:05.993549] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-29T19:35:06.524682] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-29T19:35:06.793555] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-29T19:35:07.593561] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-29T19:35:08.389670] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-29T19:35:08.400798] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-29T19:35:08.548740] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-29T19:35:09.054074] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-29T19:35:09.057495] [INFO ] [REMOTE ] KNOP: Full fetch complete (14637 records). [2025-10-29T19:35:09.057580] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-29T19:35:09.198772] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-29T19:35:09.473600] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-29T19:35:09.473713] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-29T19:35:09.474112] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-29T19:35:09.474172] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-29T19:35:09.474687] [DEBUG] [LOCAL ] KNOP: Trimmed 14637 records to 9737 (keeping 200 days of data) [2025-10-29T19:35:09.530618] [DEBUG] [LOCAL ] KNOP: Primary data saved (9737 records). [2025-10-29T19:35:09.530781] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-29T19:35:09.530877] [INFO ] [MAIN ] Update Progress: 1206/2367 symbols completed. KNOP took 25.0s. Estimated remaining: 2h 29m 20s. Rate: 7.8 symbols/min [2025-10-29T19:35:09.694885] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:35:09.695043] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-29T19:35:09.695079] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-29T19:35:09.695189] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-29T19:35:09.695228] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-29T19:35:09.695267] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-29T19:35:09.695298] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-29T19:35:10.004243] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-29T19:35:10.044087] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:35:10.532931] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T19:35:10.793577] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-29T19:35:11.305558] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T19:35:11.593557] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-29T19:35:12.393553] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-29T19:35:12.604926] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T19:35:12.923175] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-29T19:35:13.193552] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-29T19:35:13.689686] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T19:35:13.993579] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-29T19:35:14.552919] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T19:35:14.562128] [INFO ] [REMOTE ] KNF: Full fetch complete (51608 records). [2025-10-29T19:35:14.562255] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-29T19:35:14.798852] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-29T19:35:14.956326] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-29T19:35:14.956431] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-29T19:35:14.957344] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-29T19:35:14.957407] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-29T19:35:14.958629] [DEBUG] [LOCAL ] KNF: Trimmed 51608 records to 36648 (keeping 200 days of data) [2025-10-29T19:35:15.172023] [DEBUG] [LOCAL ] KNF: Primary data saved (36648 records). [2025-10-29T19:35:15.172304] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-29T19:35:15.172447] [INFO ] [MAIN ] Update Progress: 1207/2367 symbols completed. KNF took 37.7s. Estimated remaining: 2h 29m 10s. Rate: 7.8 symbols/min [2025-10-29T19:35:15.344023] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:35:15.378435] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T19:35:15.419124] [DEBUG] [LOCAL ] KODK: Loaded 43385 existing records from primary storage. [2025-10-29T19:35:15.419582] [INFO ] [MAIN ] KODK: Loaded 43385 existing records. [2025-10-29T19:35:15.598769] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-29T19:35:15.602906] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:35:15.603930] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-29T19:35:15.603984] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-29T19:35:15.604352] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-29T19:35:15.604394] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-29T19:35:16.004170] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:35:16.051416] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:35:16.393597] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-29T19:35:17.193580] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-29T19:35:17.492815] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-29T19:35:17.699440] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T19:35:17.993727] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-29T19:35:18.589289] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T19:35:18.793580] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-29T19:35:19.158590] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T19:35:19.593569] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-29T19:35:20.393605] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-29T19:35:20.743176] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-29T19:35:20.781106] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T19:35:21.193605] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-29T19:35:21.739263] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-29T19:35:21.993602] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-29T19:35:22.793553] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-29T19:35:23.154715] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-29T19:35:23.307814] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-29T19:35:23.593560] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-29T19:35:24.009087] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-29T19:35:24.393581] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-29T19:35:24.859590] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T19:35:25.193581] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-29T19:35:25.793081] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T19:35:25.993592] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-29T19:35:26.437044] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-29T19:35:26.793567] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-29T19:35:27.593618] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-29T19:35:28.019550] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-29T19:35:28.057737] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T19:35:28.393561] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-29T19:35:29.033481] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-29T19:35:29.193529] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-29T19:35:29.993590] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-29T19:35:30.233052] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-29T19:35:30.479061] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T19:35:30.793597] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-29T19:35:31.105866] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T19:35:31.593594] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-29T19:35:32.221421] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-29T19:35:32.231765] [INFO ] [REMOTE ] KNTK: Full fetch complete (66213 records). [2025-10-29T19:35:32.231881] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-29T19:35:32.397865] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-29T19:35:32.641129] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-29T19:35:32.641206] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-29T19:35:32.642100] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-29T19:35:32.642160] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-29T19:35:32.643366] [DEBUG] [LOCAL ] KNTK: Trimmed 66213 records to 47161 (keeping 200 days of data) [2025-10-29T19:35:32.929184] [DEBUG] [LOCAL ] KNTK: Primary data saved (47161 records). [2025-10-29T19:35:32.929327] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-29T19:35:32.929422] [INFO ] [MAIN ] Update Progress: 1208/2367 symbols completed. KNTK took 45.4s. Estimated remaining: 2h 29m 12s. Rate: 7.8 symbols/min [2025-10-29T19:35:33.123607] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:35:33.152386] [DEBUG] [LOCAL ] KOF: Loaded 25986 existing records from primary storage. [2025-10-29T19:35:33.152699] [INFO ] [MAIN ] KOF: Loaded 25986 existing records. [2025-10-29T19:35:33.206588] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-29T19:35:33.373218] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:35:33.385409] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-29T19:35:33.385532] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-29T19:35:33.387318] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-29T19:35:33.387256] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-29T19:35:33.387493] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-29T19:35:33.487235] [INFO ] [REMOTE ] KNX: Full fetch complete (76346 records). [2025-10-29T19:35:33.497526] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-29T19:35:34.103787] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:35:34.112041] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-29T19:35:34.236798] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-29T19:35:34.251423] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-29T19:35:34.263631] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-29T19:35:34.264860] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-29T19:35:34.274262] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-29T19:35:34.276955] [DEBUG] [LOCAL ] KNX: Trimmed 76346 records to 52638 (keeping 200 days of data) [2025-10-29T19:35:34.596981] [DEBUG] [LOCAL ] KNX: Primary data saved (52638 records). [2025-10-29T19:35:34.597142] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-29T19:35:34.597289] [INFO ] [MAIN ] Update Progress: 1209/2367 symbols completed. KNX took 30.3s. Estimated remaining: 2h 28m 58s. Rate: 7.8 symbols/min [2025-10-29T19:35:34.791864] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:35:34.793531] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-29T19:35:34.812064] [DEBUG] [LOCAL ] KOP: Loaded 17107 existing records from primary storage. [2025-10-29T19:35:34.812394] [INFO ] [MAIN ] KOP: Loaded 17107 existing records. [2025-10-29T19:35:35.002850] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:35:35.003195] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-29T19:35:35.003274] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-29T19:35:35.003717] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-29T19:35:35.003827] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-29T19:35:35.097087] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-29T19:35:35.467582] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:35:35.593532] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-29T19:35:35.636133] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-29T19:35:35.938573] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T19:35:36.393538] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-29T19:35:36.412606] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-29T19:35:37.193530] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-29T19:35:37.343671] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T19:35:37.993593] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-29T19:35:38.733099] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T19:35:38.793496] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-29T19:35:39.219043] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-29T19:35:39.593557] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-29T19:35:40.099158] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T19:35:40.393608] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-29T19:35:40.475703] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T19:35:41.193586] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-29T19:35:41.760532] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-29T19:35:41.993582] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-29T19:35:42.246241] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-29T19:35:42.793533] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-29T19:35:42.826269] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T19:35:43.593540] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-29T19:35:43.630730] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T19:35:44.393562] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-29T19:35:45.185357] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T19:35:45.193517] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-29T19:35:45.898039] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-29T19:35:45.909219] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-29T19:35:45.909360] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-29T19:35:45.998798] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-29T19:35:46.112609] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-29T19:35:46.113445] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:35:46.113705] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:35:46.113780] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-29T19:35:46.113871] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-29T19:35:46.113992] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-29T19:35:46.122041] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-29T19:35:46.134859] [INFO ] [MAIN ] Update Progress: 1210/2367 symbols completed. KO took 36.6s. Estimated remaining: 2h 28m 54s. Rate: 7.8 symbols/min [2025-10-29T19:35:46.202139] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T19:35:46.315558] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:35:46.320063] [DEBUG] [LOCAL ] KORE: Loaded 2278 existing records from primary storage. [2025-10-29T19:35:46.320221] [INFO ] [MAIN ] KORE: Loaded 2278 existing records. [2025-10-29T19:35:46.496074] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:35:46.496273] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-29T19:35:46.496341] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-29T19:35:46.496505] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-29T19:35:46.496562] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-29T19:35:46.798739] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-29T19:35:46.850610] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:35:47.538756] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-29T19:35:47.548075] [INFO ] [REMOTE ] KODK: Full fetch complete (63217 records). [2025-10-29T19:35:47.548213] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-29T19:35:47.594116] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-29T19:35:47.773069] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T19:35:47.975673] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-29T19:35:47.975771] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-29T19:35:47.976688] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-29T19:35:47.976750] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-29T19:35:47.978067] [DEBUG] [LOCAL ] KODK: Trimmed 63217 records to 43360 (keeping 200 days of data) [2025-10-29T19:35:48.213508] [DEBUG] [LOCAL ] KODK: Primary data saved (43360 records). [2025-10-29T19:35:48.213674] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-29T19:35:48.213778] [INFO ] [MAIN ] Update Progress: 1211/2367 symbols completed. KODK took 33.0s. Estimated remaining: 2h 28m 41s. Rate: 7.8 symbols/min [2025-10-29T19:35:48.388954] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:35:48.393533] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-29T19:35:48.431106] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-29T19:35:48.453848] [DEBUG] [LOCAL ] KOS: Loaded 53090 existing records from primary storage. [2025-10-29T19:35:48.454156] [INFO ] [MAIN ] KOS: Loaded 53090 existing records. [2025-10-29T19:35:48.628958] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:35:48.629168] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-29T19:35:48.629214] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-29T19:35:48.629713] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-29T19:35:48.629800] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-29T19:35:48.974696] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:35:49.108770] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T19:35:49.193532] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-29T19:35:49.993563] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-29T19:35:50.626739] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T19:35:50.801624] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-29T19:35:50.803034] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-29T19:35:51.593589] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-29T19:35:52.189717] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-29T19:35:52.400779] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-29T19:35:52.404399] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-29T19:35:53.193570] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-29T19:35:53.456525] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-29T19:35:53.462237] [INFO ] [REMOTE ] KOF: Full fetch complete (37825 records). [2025-10-29T19:35:53.462324] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-29T19:35:53.573770] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-29T19:35:53.844598] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-29T19:35:53.844738] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-29T19:35:53.845420] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-29T19:35:53.845460] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-29T19:35:53.846271] [DEBUG] [LOCAL ] KOF: Trimmed 37825 records to 26019 (keeping 200 days of data) [2025-10-29T19:35:53.999182] [DEBUG] [LOCAL ] KOF: Primary data saved (26019 records). [2025-10-29T19:35:53.999470] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-29T19:35:53.999260] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-29T19:35:54.000384] [INFO ] [MAIN ] Update Progress: 1212/2367 symbols completed. KOF took 21.1s. Estimated remaining: 2h 28m 32s. Rate: 7.8 symbols/min [2025-10-29T19:35:54.167431] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:35:54.218550] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-29T19:35:54.218895] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-29T19:35:54.388455] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-29T19:35:54.413032] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:35:54.413241] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-29T19:35:54.413288] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-29T19:35:54.413910] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-29T19:35:54.413974] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-29T19:35:54.764216] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:35:54.793527] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-29T19:35:55.593623] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-29T19:35:56.393527] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-29T19:35:56.466380] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-29T19:35:56.674460] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-29T19:35:56.917684] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T19:35:57.193559] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-29T19:35:57.904160] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-29T19:35:57.993512] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-29T19:35:58.623202] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-29T19:35:58.793567] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-29T19:35:59.032876] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-29T19:35:59.593555] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-29T19:35:59.947020] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-29T19:36:00.393580] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-29T19:36:01.193539] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-29T19:36:01.852091] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-29T19:36:01.993547] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-29T19:36:02.664836] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T19:36:02.793604] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-29T19:36:03.598200] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-29T19:36:03.635904] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-29T19:36:03.667090] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-29T19:36:04.393578] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-29T19:36:05.149461] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-29T19:36:05.201851] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-29T19:36:05.207574] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-29T19:36:05.993556] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-29T19:36:06.292298] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-29T19:36:06.549487] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-29T19:36:06.793605] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-29T19:36:07.078293] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-29T19:36:07.593558] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-29T19:36:08.393547] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-29T19:36:08.667920] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-29T19:36:08.985024] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T19:36:09.193627] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-29T19:36:09.772075] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-29T19:36:09.773698] [INFO ] [REMOTE ] KORE: Full fetch complete (3720 records). [2025-10-29T19:36:09.773778] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-29T19:36:09.998781] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-29T19:36:10.159515] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-29T19:36:10.159597] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-29T19:36:10.159764] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-29T19:36:10.159826] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-29T19:36:10.160228] [DEBUG] [LOCAL ] KORE: Trimmed 3720 records to 2303 (keeping 200 days of data) [2025-10-29T19:36:10.173606] [DEBUG] [LOCAL ] KORE: Primary data saved (2303 records). [2025-10-29T19:36:10.173732] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-29T19:36:10.173815] [INFO ] [MAIN ] Update Progress: 1213/2367 symbols completed. KORE took 24.0s. Estimated remaining: 2h 28m 32s. Rate: 7.8 symbols/min [2025-10-29T19:36:10.362670] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:36:10.407076] [DEBUG] [LOCAL ] KRC: Loaded 47934 existing records from primary storage. [2025-10-29T19:36:10.407421] [INFO ] [MAIN ] KRC: Loaded 47934 existing records. [2025-10-29T19:36:10.588391] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:36:10.588616] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-29T19:36:10.588691] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-29T19:36:10.589263] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-29T19:36:10.589320] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-29T19:36:10.798784] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-29T19:36:10.949000] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:36:11.527290] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-29T19:36:11.593558] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-29T19:36:12.349786] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-29T19:36:12.393606] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-29T19:36:12.922483] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T19:36:13.193610] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-29T19:36:13.877972] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-29T19:36:13.993681] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-29T19:36:14.427824] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T19:36:14.793562] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-29T19:36:15.595702] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-29T19:36:15.602458] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-29T19:36:15.662821] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-29T19:36:15.666941] [INFO ] [REMOTE ] KOP: Full fetch complete (25346 records). [2025-10-29T19:36:15.667051] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-29T19:36:16.033476] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-29T19:36:16.033578] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-29T19:36:16.034228] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-29T19:36:16.034291] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-29T19:36:16.035156] [DEBUG] [LOCAL ] KOP: Trimmed 25346 records to 17140 (keeping 200 days of data) [2025-10-29T19:36:16.144405] [DEBUG] [LOCAL ] KOP: Primary data saved (17140 records). [2025-10-29T19:36:16.144550] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-29T19:36:16.144629] [INFO ] [MAIN ] Update Progress: 1214/2367 symbols completed. KOP took 41.5s. Estimated remaining: 2h 28m 23s. Rate: 7.8 symbols/min [2025-10-29T19:36:16.322946] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:36:16.358157] [DEBUG] [LOCAL ] KREF: Loaded 37791 existing records from primary storage. [2025-10-29T19:36:16.358444] [INFO ] [MAIN ] KREF: Loaded 37791 existing records. [2025-10-29T19:36:16.402311] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-29T19:36:16.542930] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:36:16.543188] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-29T19:36:16.543256] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-29T19:36:16.543705] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-29T19:36:16.543763] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-29T19:36:16.899392] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:36:16.947232] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-29T19:36:17.193606] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-29T19:36:17.685497] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:36:17.998846] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-29T19:36:18.007440] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-29T19:36:18.793558] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-29T19:36:19.562763] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-29T19:36:19.593520] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-29T19:36:19.830445] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-29T19:36:20.393566] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-29T19:36:21.193624] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-29T19:36:21.291179] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-29T19:36:21.414852] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-29T19:36:21.426044] [INFO ] [REMOTE ] KR: Full fetch complete (77844 records). [2025-10-29T19:36:21.426179] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-29T19:36:21.833234] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-29T19:36:21.833333] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-29T19:36:21.834407] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-29T19:36:21.834474] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-29T19:36:21.836116] [DEBUG] [LOCAL ] KR: Trimmed 77844 records to 53681 (keeping 200 days of data) [2025-10-29T19:36:22.007953] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-29T19:36:22.161068] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-29T19:36:22.161200] [INFO ] [MAIN ] KR: Full history saved. [2025-10-29T19:36:22.161275] [INFO ] [MAIN ] Update Progress: 1215/2367 symbols completed. KR took 28.2s. Estimated remaining: 2h 28m 13s. Rate: 7.8 symbols/min [2025-10-29T19:36:22.329382] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:36:22.371917] [DEBUG] [LOCAL ] KRG: Loaded 49201 existing records from primary storage. [2025-10-29T19:36:22.372201] [INFO ] [MAIN ] KRG: Loaded 49201 existing records. [2025-10-29T19:36:22.549378] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:36:22.549605] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-29T19:36:22.549683] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-29T19:36:22.550238] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-29T19:36:22.550295] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-29T19:36:22.795609] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-29T19:36:22.906671] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:36:22.935273] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T19:36:23.159587] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:36:23.593613] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-29T19:36:23.905968] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-29T19:36:24.393622] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-29T19:36:24.767874] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-29T19:36:25.193589] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-29T19:36:25.620695] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T19:36:25.993637] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-29T19:36:26.360617] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T19:36:26.793600] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-29T19:36:27.121178] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T19:36:27.593580] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-29T19:36:28.158350] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-29T19:36:28.393575] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-29T19:36:28.668834] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-29T19:36:29.193572] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-29T19:36:29.760530] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T19:36:29.993552] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-29T19:36:30.368027] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-29T19:36:30.793564] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-29T19:36:31.337632] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T19:36:31.593612] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-29T19:36:31.867328] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T19:36:32.393589] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-29T19:36:33.193562] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-29T19:36:33.520322] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-29T19:36:33.993636] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-29T19:36:34.408598] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T19:36:34.535067] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-29T19:36:34.546478] [INFO ] [REMOTE ] KOS: Full fetch complete (77034 records). [2025-10-29T19:36:34.546703] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-29T19:36:34.798767] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-29T19:36:34.992928] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-29T19:36:34.993074] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-29T19:36:34.994362] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-29T19:36:34.994446] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-29T19:36:34.996207] [DEBUG] [LOCAL ] KOS: Trimmed 77034 records to 53089 (keeping 200 days of data) [2025-10-29T19:36:35.297617] [DEBUG] [LOCAL ] KOS: Primary data saved (53089 records). [2025-10-29T19:36:35.297966] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-29T19:36:35.298079] [INFO ] [MAIN ] Update Progress: 1216/2367 symbols completed. KOS took 47.1s. Estimated remaining: 2h 28m 11s. Rate: 7.8 symbols/min [2025-10-29T19:36:35.497336] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-29T19:36:35.499673] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:36:35.510255] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-29T19:36:35.510339] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-29T19:36:35.510591] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-29T19:36:35.510636] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-29T19:36:35.510738] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-29T19:36:35.510805] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-29T19:36:35.600582] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-29T19:36:35.869765] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:36:36.010969] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T19:36:36.393606] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-29T19:36:36.557604] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T19:36:36.557949] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-29T19:36:36.558049] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:36:36.558131] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-29T19:36:36.558196] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:36:36.558269] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-29T19:36:36.558329] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-29T19:36:36.558365] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-29T19:36:36.558409] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-29T19:36:36.558465] [INFO ] [MAIN ] Update Progress: 1217/2367 symbols completed. KRMN took 1.3s. Estimated remaining: 2h 27m 57s. Rate: 7.8 symbols/min [2025-10-29T19:36:36.750969] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:36:36.776199] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-29T19:36:36.811712] [DEBUG] [LOCAL ] KRO: Loaded 26457 existing records from primary storage. [2025-10-29T19:36:36.812049] [INFO ] [MAIN ] KRO: Loaded 26457 existing records. [2025-10-29T19:36:36.989950] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:36:36.990182] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-29T19:36:36.990228] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-29T19:36:36.990574] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-29T19:36:36.990612] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-29T19:36:37.199045] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-29T19:36:37.354449] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:36:37.993574] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-29T19:36:38.422584] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-29T19:36:38.431085] [INFO ] [REMOTE ] KREF: Full fetch complete (53063 records). [2025-10-29T19:36:38.431193] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-29T19:36:38.795786] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-29T19:36:38.815971] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-29T19:36:38.816102] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-29T19:36:38.817261] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-29T19:36:38.817438] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-29T19:36:38.818720] [DEBUG] [LOCAL ] KREF: Trimmed 53063 records to 37720 (keeping 200 days of data) [2025-10-29T19:36:39.025267] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-29T19:36:39.058890] [DEBUG] [LOCAL ] KREF: Primary data saved (37720 records). [2025-10-29T19:36:39.059030] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-29T19:36:39.059109] [INFO ] [MAIN ] Update Progress: 1218/2367 symbols completed. KREF took 22.9s. Estimated remaining: 2h 27m 44s. Rate: 7.8 symbols/min [2025-10-29T19:36:39.226798] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:36:39.260759] [DEBUG] [LOCAL ] KRP: Loaded 35449 existing records from primary storage. [2025-10-29T19:36:39.261038] [INFO ] [MAIN ] KRP: Loaded 35449 existing records. [2025-10-29T19:36:39.436675] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:36:39.436899] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-29T19:36:39.436946] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-29T19:36:39.437393] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-29T19:36:39.437477] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-29T19:36:39.609878] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-29T19:36:39.801208] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:36:40.111359] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T19:36:40.366027] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-29T19:36:40.393581] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-29T19:36:41.193552] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-29T19:36:41.821345] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-29T19:36:41.993534] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-29T19:36:42.480203] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T19:36:42.793571] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-29T19:36:43.132135] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T19:36:43.593565] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-29T19:36:44.086405] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-29T19:36:44.393555] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-29T19:36:44.620512] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-29T19:36:45.193554] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-29T19:36:45.688179] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T19:36:45.698186] [INFO ] [REMOTE ] KRC: Full fetch complete (70071 records). [2025-10-29T19:36:45.698313] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-29T19:36:45.994423] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-29T19:36:46.086840] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-29T19:36:46.086934] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-29T19:36:46.087903] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-29T19:36:46.087981] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-29T19:36:46.089471] [DEBUG] [LOCAL ] KRC: Trimmed 70071 records to 47935 (keeping 200 days of data) [2025-10-29T19:36:46.383247] [DEBUG] [LOCAL ] KRC: Primary data saved (47935 records). [2025-10-29T19:36:46.383416] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-29T19:36:46.383555] [INFO ] [MAIN ] Update Progress: 1219/2367 symbols completed. KRC took 36.2s. Estimated remaining: 2h 27m 36s. Rate: 7.8 symbols/min [2025-10-29T19:36:46.588754] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:36:46.590677] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T19:36:46.648888] [DEBUG] [LOCAL ] KSS: Loaded 53573 existing records from primary storage. [2025-10-29T19:36:46.649190] [INFO ] [MAIN ] KSS: Loaded 53573 existing records. [2025-10-29T19:36:46.798796] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-29T19:36:46.828489] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:36:46.829976] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-29T19:36:46.830030] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-29T19:36:46.830329] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-29T19:36:46.830388] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-29T19:36:47.178574] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:36:47.418112] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T19:36:47.593545] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-29T19:36:47.845964] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-29T19:36:48.393565] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-29T19:36:48.749183] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T19:36:49.193586] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-29T19:36:49.310509] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-29T19:36:49.993566] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-29T19:36:50.193479] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T19:36:50.793565] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-29T19:36:51.329599] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-29T19:36:51.593594] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-29T19:36:51.783676] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T19:36:52.393597] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-29T19:36:52.425188] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-29T19:36:53.193629] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-29T19:36:53.942146] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-29T19:36:53.967222] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-29T19:36:53.993545] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-29T19:36:54.768897] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-29T19:36:54.793519] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-29T19:36:55.593537] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-29T19:36:55.761730] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T19:36:56.393526] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-29T19:36:56.946526] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-29T19:36:56.957175] [INFO ] [REMOTE ] KRG: Full fetch complete (71475 records). [2025-10-29T19:36:56.957320] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-29T19:36:57.198818] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-29T19:36:57.355076] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-29T19:36:57.355243] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-29T19:36:57.356292] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-29T19:36:57.356441] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-29T19:36:57.358245] [DEBUG] [LOCAL ] KRG: Trimmed 71475 records to 49210 (keeping 200 days of data) [2025-10-29T19:36:57.378749] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-29T19:36:57.677298] [DEBUG] [LOCAL ] KRG: Primary data saved (49210 records). [2025-10-29T19:36:57.677429] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-29T19:36:57.677505] [INFO ] [MAIN ] Update Progress: 1220/2367 symbols completed. KRG took 35.5s. Estimated remaining: 2h 27m 32s. Rate: 7.8 symbols/min [2025-10-29T19:36:57.842940] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:36:57.881677] [DEBUG] [LOCAL ] KT: Loaded 45095 existing records from primary storage. [2025-10-29T19:36:57.881967] [INFO ] [MAIN ] KT: Loaded 45095 existing records. [2025-10-29T19:36:57.998759] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-29T19:36:58.065983] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:36:58.066171] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-29T19:36:58.066218] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-29T19:36:58.066995] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-29T19:36:58.067051] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-29T19:36:58.406125] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-29T19:36:58.453187] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:36:58.793566] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-29T19:36:59.593577] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-29T19:36:59.687757] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-29T19:37:00.142338] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T19:37:00.393558] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-29T19:37:00.552433] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T19:37:00.558341] [INFO ] [REMOTE ] KRO: Full fetch complete (35487 records). [2025-10-29T19:37:00.558434] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-29T19:37:00.928787] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-29T19:37:00.928876] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-29T19:37:00.929533] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-29T19:37:00.929573] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-29T19:37:00.930497] [DEBUG] [LOCAL ] KRO: Trimmed 35487 records to 26472 (keeping 200 days of data) [2025-10-29T19:37:01.083805] [DEBUG] [LOCAL ] KRO: Primary data saved (26472 records). [2025-10-29T19:37:01.083988] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-29T19:37:01.084081] [INFO ] [MAIN ] Update Progress: 1221/2367 symbols completed. KRO took 24.5s. Estimated remaining: 2h 27m 20s. Rate: 7.8 symbols/min [2025-10-29T19:37:01.198755] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-29T19:37:01.255054] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:37:01.291568] [DEBUG] [LOCAL ] KTB: Loaded 39775 existing records from primary storage. [2025-10-29T19:37:01.291903] [INFO ] [MAIN ] KTB: Loaded 39775 existing records. [2025-10-29T19:37:01.467159] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:37:01.467394] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-29T19:37:01.467442] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-29T19:37:01.468011] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-29T19:37:01.468069] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-29T19:37:01.841975] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:37:01.866396] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-29T19:37:01.993550] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-29T19:37:02.348072] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T19:37:02.793589] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-29T19:37:03.593569] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-29T19:37:03.744051] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-29T19:37:03.844171] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T19:37:04.393548] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-29T19:37:04.807527] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-29T19:37:05.193619] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-29T19:37:05.971884] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-29T19:37:05.993522] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-29T19:37:06.299123] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T19:37:06.793565] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-29T19:37:07.412726] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T19:37:07.593566] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-29T19:37:07.737604] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T19:37:07.745301] [INFO ] [REMOTE ] KRP: Full fetch complete (54582 records). [2025-10-29T19:37:07.745426] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-29T19:37:08.173340] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-29T19:37:08.173417] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-29T19:37:08.174235] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-29T19:37:08.174296] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-29T19:37:08.175335] [DEBUG] [LOCAL ] KRP: Trimmed 54582 records to 35423 (keeping 200 days of data) [2025-10-29T19:37:08.383126] [DEBUG] [LOCAL ] KRP: Primary data saved (35423 records). [2025-10-29T19:37:08.383273] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-29T19:37:08.383410] [INFO ] [MAIN ] Update Progress: 1222/2367 symbols completed. KRP took 29.3s. Estimated remaining: 2h 27m 12s. Rate: 7.8 symbols/min [2025-10-29T19:37:08.398826] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-29T19:37:08.582908] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:37:08.597379] [DEBUG] [LOCAL ] KTF: Loaded 11465 existing records from primary storage. [2025-10-29T19:37:08.597620] [INFO ] [MAIN ] KTF: Loaded 11465 existing records. [2025-10-29T19:37:08.786806] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-29T19:37:08.851827] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:37:08.851999] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-29T19:37:08.852045] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-29T19:37:08.852192] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-29T19:37:08.852230] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-29T19:37:09.198722] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-29T19:37:09.334106] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:37:09.993547] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-29T19:37:10.050489] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-29T19:37:10.301203] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T19:37:10.793581] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-29T19:37:11.160354] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T19:37:11.593550] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-29T19:37:11.904685] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T19:37:12.393581] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-29T19:37:12.802901] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T19:37:13.193601] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-29T19:37:13.889987] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-29T19:37:13.993558] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-29T19:37:14.451284] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T19:37:14.793602] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-29T19:37:15.496948] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-29T19:37:15.547595] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-29T19:37:15.593545] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-29T19:37:16.096804] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-29T19:37:16.393571] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-29T19:37:16.977301] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-29T19:37:17.193549] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-29T19:37:17.993597] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-29T19:37:18.393740] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-29T19:37:18.793611] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-29T19:37:19.139780] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T19:37:19.593576] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-29T19:37:19.962908] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T19:37:20.393557] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-29T19:37:20.803764] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T19:37:21.193565] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-29T19:37:21.621480] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-29T19:37:21.993594] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-29T19:37:22.348328] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T19:37:22.793536] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-29T19:37:23.079447] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T19:37:23.593556] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-29T19:37:23.847991] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-29T19:37:24.393574] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-29T19:37:24.802518] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T19:37:24.816220] [INFO ] [REMOTE ] KT: Full fetch complete (66499 records). [2025-10-29T19:37:24.816426] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-29T19:37:25.198390] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-29T19:37:25.198819] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-29T19:37:25.199858] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-29T19:37:25.200789] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-29T19:37:25.200855] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-29T19:37:25.202104] [DEBUG] [LOCAL ] KT: Trimmed 66499 records to 45035 (keeping 200 days of data) [2025-10-29T19:37:25.472069] [DEBUG] [LOCAL ] KT: Primary data saved (45035 records). [2025-10-29T19:37:25.472200] [INFO ] [MAIN ] KT: Full history saved. [2025-10-29T19:37:25.472273] [INFO ] [MAIN ] Update Progress: 1223/2367 symbols completed. KT took 27.8s. Estimated remaining: 2h 27m 13s. Rate: 7.8 symbols/min [2025-10-29T19:37:25.641951] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:37:25.690814] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-29T19:37:25.691137] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-29T19:37:25.867365] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:37:25.867674] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-29T19:37:25.867734] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-29T19:37:25.868350] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-29T19:37:25.868390] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-29T19:37:26.007329] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-29T19:37:26.007273] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-29T19:37:26.294009] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:37:26.335026] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-29T19:37:26.351252] [INFO ] [REMOTE ] KSS: Full fetch complete (77734 records). [2025-10-29T19:37:26.351541] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-29T19:37:26.798772] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-29T19:37:26.804016] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-29T19:37:26.804153] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-29T19:37:26.805955] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-29T19:37:26.806170] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-29T19:37:26.808150] [DEBUG] [LOCAL ] KSS: Trimmed 77734 records to 53570 (keeping 200 days of data) [2025-10-29T19:37:27.137229] [DEBUG] [LOCAL ] KSS: Primary data saved (53570 records). [2025-10-29T19:37:27.137424] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-29T19:37:27.137510] [INFO ] [MAIN ] Update Progress: 1224/2367 symbols completed. KSS took 40.8s. Estimated remaining: 2h 26m 60s. Rate: 7.8 symbols/min [2025-10-29T19:37:27.310918] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:37:27.332741] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:37:27.340717] [INFO ] [REMOTE ] KTB: Full fetch complete (58198 records). [2025-10-29T19:37:27.340854] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-29T19:37:27.597786] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-29T19:37:27.684513] [DEBUG] [LOCAL ] KVYO: Loaded 50922 existing records from primary storage. [2025-10-29T19:37:27.706218] [INFO ] [MAIN ] KVYO: Loaded 50922 existing records. [2025-10-29T19:37:27.890796] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-29T19:37:27.891181] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-29T19:37:27.897671] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-29T19:37:27.902872] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-29T19:37:27.956780] [DEBUG] [LOCAL ] KTB: Trimmed 58198 records to 39713 (keeping 200 days of data) [2025-10-29T19:37:27.978785] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:37:27.979311] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-29T19:37:27.979387] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-29T19:37:27.979789] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-29T19:37:27.979848] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-29T19:37:28.377815] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-29T19:37:28.451384] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-29T19:37:28.549778] [DEBUG] [LOCAL ] KTB: Primary data saved (39713 records). [2025-10-29T19:37:28.610083] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-29T19:37:28.609955] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:37:28.610613] [INFO ] [MAIN ] Update Progress: 1225/2367 symbols completed. KTB took 27.5s. Estimated remaining: 2h 26m 46s. Rate: 7.8 symbols/min [2025-10-29T19:37:28.783409] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:37:28.811690] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-29T19:37:28.853837] [DEBUG] [LOCAL ] KW: Loaded 39949 existing records from primary storage. [2025-10-29T19:37:28.854129] [INFO ] [MAIN ] KW: Loaded 39949 existing records. [2025-10-29T19:37:29.037394] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:37:29.037787] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-29T19:37:29.037858] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-29T19:37:29.038342] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-29T19:37:29.038400] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-29T19:37:29.149345] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T19:37:29.202823] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-29T19:37:29.408112] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:37:29.993569] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-29T19:37:30.580538] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-29T19:37:30.793574] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-29T19:37:31.180556] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T19:37:31.329860] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-29T19:37:31.593553] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-29T19:37:32.393582] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-29T19:37:32.506099] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-29T19:37:33.193560] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-29T19:37:33.673532] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-29T19:37:33.691677] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-29T19:37:33.993566] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-29T19:37:34.504439] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-29T19:37:34.793604] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-29T19:37:35.593536] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-29T19:37:35.963518] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-29T19:37:36.393571] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-29T19:37:36.721107] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T19:37:37.193556] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-29T19:37:37.810807] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-29T19:37:37.814116] [INFO ] [REMOTE ] KTF: Full fetch complete (17637 records). [2025-10-29T19:37:37.814271] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-29T19:37:38.022150] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-29T19:37:38.232676] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-29T19:37:38.270137] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-29T19:37:38.270718] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-29T19:37:38.271404] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-29T19:37:38.271492] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-29T19:37:38.272796] [DEBUG] [LOCAL ] KTF: Trimmed 17637 records to 11541 (keeping 200 days of data) [2025-10-29T19:37:38.349626] [DEBUG] [LOCAL ] KTF: Primary data saved (11541 records). [2025-10-29T19:37:38.349867] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-29T19:37:38.349973] [INFO ] [MAIN ] Update Progress: 1226/2367 symbols completed. KTF took 30.0s. Estimated remaining: 2h 26m 40s. Rate: 7.8 symbols/min [2025-10-29T19:37:38.526505] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:37:38.546469] [DEBUG] [LOCAL ] KWR: Loaded 15320 existing records from primary storage. [2025-10-29T19:37:38.546805] [INFO ] [MAIN ] KWR: Loaded 15320 existing records. [2025-10-29T19:37:38.732753] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:37:38.733077] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-29T19:37:38.733130] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-29T19:37:38.733359] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-29T19:37:38.733404] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-29T19:37:38.806179] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-29T19:37:39.127209] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:37:39.366009] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T19:37:39.593619] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-29T19:37:39.947870] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T19:37:40.246126] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-29T19:37:40.393568] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-29T19:37:41.193557] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-29T19:37:41.601243] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-29T19:37:41.993553] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-29T19:37:42.591446] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-29T19:37:42.615001] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-29T19:37:42.793612] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-29T19:37:43.593556] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-29T19:37:43.852400] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-29T19:37:44.393548] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-29T19:37:44.910988] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-29T19:37:45.193560] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-29T19:37:45.734395] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T19:37:45.993555] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-29T19:37:46.258948] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-29T19:37:46.793590] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-29T19:37:46.971050] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T19:37:47.593686] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-29T19:37:48.173516] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-29T19:37:48.329290] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-29T19:37:48.393520] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-29T19:37:49.109361] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-29T19:37:49.193520] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-29T19:37:49.856623] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-29T19:37:49.993608] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-29T19:37:50.793545] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-29T19:37:51.205363] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-29T19:37:51.593605] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-29T19:37:51.866694] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T19:37:52.393605] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-29T19:37:52.864248] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T19:37:53.134312] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-29T19:37:53.193571] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-29T19:37:53.993585] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-29T19:37:54.443197] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-29T19:37:54.664905] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-29T19:37:54.793520] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-29T19:37:55.471862] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-29T19:37:55.593540] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-29T19:37:56.393616] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-29T19:37:56.967892] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-29T19:37:57.193561] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-29T19:37:57.448768] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-29T19:37:57.993587] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-29T19:37:58.676178] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-29T19:37:58.793555] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-29T19:37:58.876691] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-29T19:37:59.593624] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-29T19:38:00.132823] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-29T19:38:00.393621] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-29T19:38:00.904395] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-29T19:38:01.193558] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-29T19:38:01.993571] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-29T19:38:02.586319] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-29T19:38:02.598150] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-29T19:38:02.598413] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-29T19:38:02.734283] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-29T19:38:02.806878] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-29T19:38:02.807691] [INFO ] [REMOTE ] KVYO: Full fetch complete (72469 records). [2025-10-29T19:38:02.814669] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-29T19:38:03.061260] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-29T19:38:03.151190] [INFO ] [REMOTE ] KWR: Full fetch complete (22943 records). [2025-10-29T19:38:03.226234] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-29T19:38:03.297372] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-29T19:38:03.335503] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-29T19:38:03.359929] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-29T19:38:03.458983] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-29T19:38:03.639256] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 53667 (keeping 200 days of data) [2025-10-29T19:38:03.811850] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-29T19:38:03.825838] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-29T19:38:03.834958] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-29T19:38:03.859511] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-29T19:38:03.945093] [DEBUG] [LOCAL ] KVYO: Trimmed 72469 records to 50916 (keeping 200 days of data) [2025-10-29T19:38:04.220553] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-29T19:38:04.248847] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-29T19:38:04.256360] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-29T19:38:04.279726] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-29T19:38:04.377365] [DEBUG] [LOCAL ] KWR: Trimmed 22943 records to 15294 (keeping 200 days of data) [2025-10-29T19:38:04.610060] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-29T19:38:04.631337] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-29T19:38:04.631506] [INFO ] [MAIN ] Update Progress: 1227/2367 symbols completed. KVUE took 39.2s. Estimated remaining: 2h 26m 50s. Rate: 7.8 symbols/min [2025-10-29T19:38:04.630540] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-29T19:38:04.687721] [DEBUG] [LOCAL ] KVYO: Primary data saved (50916 records). [2025-10-29T19:38:04.725401] [DEBUG] [LOCAL ] KWR: Primary data saved (15294 records). [2025-10-29T19:38:04.734357] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-29T19:38:04.783350] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-29T19:38:04.768750] [INFO ] [MAIN ] Update Progress: 1228/2367 symbols completed. KVYO took 37.6s. Estimated remaining: 2h 26m 35s. Rate: 7.8 symbols/min [2025-10-29T19:38:04.794531] [INFO ] [MAIN ] Update Progress: 1229/2367 symbols completed. KWR took 26.4s. Estimated remaining: 2h 26m 20s. Rate: 7.8 symbols/min [2025-10-29T19:38:04.857880] [INFO ] [REMOTE ] KW: Full fetch complete (57180 records). [2025-10-29T19:38:04.920238] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-29T19:38:05.042752] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:05.325479] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:05.367110] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:05.466896] [DEBUG] [LOCAL ] KYN: Loaded 29647 existing records from primary storage. [2025-10-29T19:38:05.503286] [INFO ] [MAIN ] KYN: Loaded 29647 existing records. [2025-10-29T19:38:05.806532] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-29T19:38:05.858339] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-29T19:38:05.861259] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:38:05.862431] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-29T19:38:05.862756] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-29T19:38:05.876317] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-29T19:38:05.876225] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-29T19:38:05.877020] [DEBUG] [LOCAL ] L: Loaded 40788 existing records from primary storage. [2025-10-29T19:38:05.878754] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-29T19:38:05.878684] [INFO ] [MAIN ] L: Loaded 40788 existing records. [2025-10-29T19:38:05.879903] [DEBUG] [LOCAL ] LAC: Loaded 52592 existing records from primary storage. [2025-10-29T19:38:05.878981] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-29T19:38:05.914263] [INFO ] [MAIN ] LAC: Loaded 52592 existing records. [2025-10-29T19:38:06.013274] [DEBUG] [LOCAL ] KW: Trimmed 57180 records to 39905 (keeping 200 days of data) [2025-10-29T19:38:06.402572] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:38:06.462509] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-29T19:38:06.548864] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-29T19:38:06.587312] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-29T19:38:06.602372] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-29T19:38:06.575960] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:38:06.672636] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-29T19:38:06.702104] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-29T19:38:06.893962] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-29T19:38:06.913962] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-29T19:38:06.965163] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:38:06.993162] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-29T19:38:07.200042] [DEBUG] [LOCAL ] KW: Primary data saved (39905 records). [2025-10-29T19:38:07.219195] [INFO ] [MAIN ] KW: Full history saved. [2025-10-29T19:38:07.269632] [INFO ] [MAIN ] Update Progress: 1230/2367 symbols completed. KW took 38.7s. Estimated remaining: 2h 26m 8s. Rate: 7.8 symbols/min [2025-10-29T19:38:07.634943] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:38:07.671336] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-29T19:38:07.778976] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:38:07.775962] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:07.779550] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-29T19:38:07.801134] [DEBUG] [LOCAL ] LAD: Loaded 23261 existing records from primary storage. [2025-10-29T19:38:07.801368] [INFO ] [MAIN ] LAD: Loaded 23261 existing records. [2025-10-29T19:38:07.975857] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:38:07.976087] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-29T19:38:07.976133] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-29T19:38:07.976466] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-29T19:38:07.976522] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-29T19:38:08.349669] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:38:08.350132] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-29T19:38:08.371958] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T19:38:08.379376] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-29T19:38:08.930518] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T19:38:08.938799] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-29T19:38:09.089316] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-29T19:38:09.099789] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-29T19:38:09.527319] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-29T19:38:09.533342] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-29T19:38:09.618951] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:38:09.813053] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T19:38:09.993569] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-29T19:38:10.426110] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T19:38:10.470836] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T19:38:10.793590] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-29T19:38:10.859044] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-29T19:38:11.593623] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-29T19:38:12.160714] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-29T19:38:12.393580] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-29T19:38:12.832798] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T19:38:13.193601] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-29T19:38:13.323682] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-29T19:38:13.993639] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-29T19:38:14.266421] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-29T19:38:14.793533] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-29T19:38:14.960504] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T19:38:15.593546] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-29T19:38:15.797408] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T19:38:16.393605] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-29T19:38:17.027113] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T19:38:17.193532] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-29T19:38:17.285736] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T19:38:17.993526] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-29T19:38:18.654189] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-29T19:38:18.793525] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-29T19:38:18.922491] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-29T19:38:19.593563] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-29T19:38:20.124514] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T19:38:20.393632] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-29T19:38:20.644875] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-29T19:38:21.193564] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-29T19:38:22.000392] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-29T19:38:22.024324] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-29T19:38:22.051631] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-29T19:38:22.793576] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-29T19:38:23.584623] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-29T19:38:23.594660] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-29T19:38:24.397820] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-29T19:38:24.404108] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-29T19:38:24.513719] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-29T19:38:25.086613] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T19:38:25.193568] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-29T19:38:25.993532] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-29T19:38:26.020012] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-29T19:38:26.793626] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-29T19:38:27.171949] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-29T19:38:27.593707] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-29T19:38:27.679555] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T19:38:28.393574] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-29T19:38:28.675205] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T19:38:29.193604] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-29T19:38:29.212232] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-29T19:38:29.993578] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-29T19:38:30.069906] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-29T19:38:30.793568] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-29T19:38:30.953113] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T19:38:30.959939] [INFO ] [REMOTE ] KYN: Full fetch complete (44322 records). [2025-10-29T19:38:30.960068] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-29T19:38:31.333197] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-29T19:38:31.333279] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-29T19:38:31.334022] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-29T19:38:31.334082] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-29T19:38:31.334993] [DEBUG] [LOCAL ] KYN: Trimmed 44322 records to 29641 (keeping 200 days of data) [2025-10-29T19:38:31.519735] [DEBUG] [LOCAL ] KYN: Primary data saved (29641 records). [2025-10-29T19:38:31.519916] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-29T19:38:31.520004] [INFO ] [MAIN ] Update Progress: 1231/2367 symbols completed. KYN took 26.9s. Estimated remaining: 2h 26m 15s. Rate: 7.8 symbols/min [2025-10-29T19:38:31.599941] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-29T19:38:31.702499] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:31.742465] [DEBUG] [LOCAL ] LADR: Loaded 39034 existing records from primary storage. [2025-10-29T19:38:31.742776] [INFO ] [MAIN ] LADR: Loaded 39034 existing records. [2025-10-29T19:38:31.929765] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:38:31.930038] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-29T19:38:31.930095] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-29T19:38:31.930605] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-29T19:38:31.930695] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-29T19:38:32.337795] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:38:32.369925] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-29T19:38:32.393514] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-29T19:38:32.462598] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-29T19:38:33.193544] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-29T19:38:33.506313] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T19:38:33.993558] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-29T19:38:34.793553] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-29T19:38:35.101942] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T19:38:35.593551] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-29T19:38:35.820071] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-29T19:38:35.947421] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-29T19:38:35.958899] [INFO ] [REMOTE ] LAC: Full fetch complete (76164 records). [2025-10-29T19:38:35.959100] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-29T19:38:36.346869] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-29T19:38:36.346954] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-29T19:38:36.347927] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-29T19:38:36.347991] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-29T19:38:36.349425] [DEBUG] [LOCAL ] LAC: Trimmed 76164 records to 52607 (keeping 200 days of data) [2025-10-29T19:38:36.401965] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-29T19:38:36.561613] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-29T19:38:36.573916] [INFO ] [REMOTE ] LAD: Full fetch complete (35802 records). [2025-10-29T19:38:36.576112] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-29T19:38:36.897937] [DEBUG] [LOCAL ] LAC: Primary data saved (52607 records). [2025-10-29T19:38:36.916237] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-29T19:38:36.926785] [INFO ] [MAIN ] Update Progress: 1232/2367 symbols completed. LAC took 32.1s. Estimated remaining: 2h 26m 5s. Rate: 7.8 symbols/min [2025-10-29T19:38:37.234692] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-29T19:38:37.307517] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:37.310238] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-29T19:38:37.310338] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-29T19:38:37.311193] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-29T19:38:37.311330] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-29T19:38:37.313385] [DEBUG] [LOCAL ] LAD: Trimmed 35802 records to 23180 (keeping 200 days of data) [2025-10-29T19:38:37.315788] [DEBUG] [LOCAL ] LANV: Loaded 2765 existing records from primary storage. [2025-10-29T19:38:37.316336] [INFO ] [MAIN ] LANV: Loaded 2765 existing records. [2025-10-29T19:38:37.630497] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:38:37.636707] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-29T19:38:37.640088] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-29T19:38:37.641613] [DEBUG] [LOCAL ] LAD: Primary data saved (23180 records). [2025-10-29T19:38:37.641857] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-29T19:38:37.641951] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-29T19:38:37.641819] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-29T19:38:37.673367] [INFO ] [MAIN ] Update Progress: 1233/2367 symbols completed. LAD took 30.3s. Estimated remaining: 2h 25m 51s. Rate: 7.8 symbols/min [2025-10-29T19:38:38.016558] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:38.057680] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-29T19:38:38.057955] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-29T19:38:38.063340] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-29T19:38:38.094202] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-29T19:38:38.104693] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-29T19:38:38.113211] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-29T19:38:38.326110] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:38:38.343490] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-29T19:38:38.559454] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-29T19:38:38.673931] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:38:38.674846] [INFO ] [REMOTE ] L: Full fetch complete (59209 records). [2025-10-29T19:38:38.675319] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-29T19:38:38.684155] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T19:38:38.804867] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-29T19:38:38.809762] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-29T19:38:39.109161] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-29T19:38:39.109263] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-29T19:38:39.110151] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-29T19:38:39.110216] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-29T19:38:39.111484] [DEBUG] [LOCAL ] L: Trimmed 59209 records to 40742 (keeping 200 days of data) [2025-10-29T19:38:39.333014] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-29T19:38:39.378237] [DEBUG] [LOCAL ] L: Primary data saved (40742 records). [2025-10-29T19:38:39.378380] [INFO ] [MAIN ] L: Full history saved. [2025-10-29T19:38:39.378476] [INFO ] [MAIN ] Update Progress: 1234/2367 symbols completed. L took 34.6s. Estimated remaining: 2h 25m 38s. Rate: 7.8 symbols/min [2025-10-29T19:38:39.546836] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:39.567875] [DEBUG] [LOCAL ] LAW: Loaded 15102 existing records from primary storage. [2025-10-29T19:38:39.568159] [INFO ] [MAIN ] LAW: Loaded 15102 existing records. [2025-10-29T19:38:39.599600] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-29T19:38:39.748445] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:38:39.748622] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-29T19:38:39.748716] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-29T19:38:39.749107] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-29T19:38:39.749174] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-29T19:38:40.100748] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:38:40.121002] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-29T19:38:40.393627] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-29T19:38:41.074559] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-29T19:38:41.193515] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-29T19:38:41.800849] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T19:38:41.993553] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-29T19:38:42.793582] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-29T19:38:43.291714] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T19:38:43.593556] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-29T19:38:43.732887] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-29T19:38:44.393597] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-29T19:38:44.723007] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T19:38:45.193560] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-29T19:38:45.508706] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-29T19:38:45.672415] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-29T19:38:45.993560] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-29T19:38:46.517625] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-29T19:38:46.793545] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-29T19:38:47.370561] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-29T19:38:47.593520] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-29T19:38:47.889618] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-29T19:38:48.393538] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-29T19:38:49.076226] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-29T19:38:49.193529] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-29T19:38:49.993585] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-29T19:38:50.276060] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T19:38:50.590691] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-29T19:38:50.793605] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-29T19:38:51.593568] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-29T19:38:51.962285] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T19:38:52.393635] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-29T19:38:52.622397] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T19:38:52.743785] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-29T19:38:53.193588] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-29T19:38:53.993592] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-29T19:38:54.275727] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T19:38:54.653944] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T19:38:54.793556] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-29T19:38:55.593580] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-29T19:38:55.858259] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-29T19:38:56.393543] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-29T19:38:56.667467] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T19:38:57.051087] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T19:38:57.193560] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-29T19:38:57.993581] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-29T19:38:58.611201] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-29T19:38:58.619881] [INFO ] [REMOTE ] LADR: Full fetch complete (55687 records). [2025-10-29T19:38:58.620016] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-29T19:38:58.798019] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-29T19:38:58.915907] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-29T19:38:58.965838] [INFO ] [REMOTE ] LAW: Full fetch complete (21166 records). [2025-10-29T19:38:58.966110] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-29T19:38:59.230306] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-29T19:38:59.232798] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-29T19:38:59.249449] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-29T19:38:59.301484] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-29T19:38:59.381285] [DEBUG] [LOCAL ] LADR: Trimmed 55687 records to 39025 (keeping 200 days of data) [2025-10-29T19:38:59.501934] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-29T19:38:59.502309] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-29T19:38:59.502803] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-29T19:38:59.528162] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-29T19:38:59.530971] [DEBUG] [LOCAL ] LAW: Trimmed 21166 records to 15110 (keeping 200 days of data) [2025-10-29T19:38:59.597048] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-29T19:38:59.631116] [DEBUG] [LOCAL ] LAW: Primary data saved (15110 records). [2025-10-29T19:38:59.632442] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-29T19:38:59.636257] [INFO ] [MAIN ] Update Progress: 1235/2367 symbols completed. LAW took 20.3s. Estimated remaining: 2h 25m 42s. Rate: 7.8 symbols/min [2025-10-29T19:38:59.882621] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:38:59.911905] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-29T19:38:59.954140] [DEBUG] [LOCAL ] LADR: Primary data saved (39025 records). [2025-10-29T19:38:59.954429] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-29T19:38:59.954593] [INFO ] [MAIN ] Update Progress: 1236/2367 symbols completed. LADR took 28.4s. Estimated remaining: 2h 25m 27s. Rate: 7.8 symbols/min [2025-10-29T19:39:00.080223] [DEBUG] [LOCAL ] LAZ: Loaded 44224 existing records from primary storage. [2025-10-29T19:39:00.106776] [INFO ] [MAIN ] LAZ: Loaded 44224 existing records. [2025-10-29T19:39:00.174941] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:39:00.364123] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:00.364951] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-29T19:39:00.365006] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-29T19:39:00.358853] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-29T19:39:00.373058] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-29T19:39:00.373346] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-29T19:39:00.408206] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-29T19:39:00.504358] [DEBUG] [LOCAL ] LB: Loaded 36485 existing records from primary storage. [2025-10-29T19:39:00.525130] [INFO ] [MAIN ] LB: Loaded 36485 existing records. [2025-10-29T19:39:00.879847] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:00.908458] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-29T19:39:00.929148] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-29T19:39:00.950265] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-29T19:39:00.950214] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:00.950685] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-29T19:39:01.198742] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-29T19:39:01.301370] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:01.534309] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-29T19:39:01.852026] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T19:39:01.993607] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-29T19:39:02.793627] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-29T19:39:03.361733] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T19:39:03.593610] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-29T19:39:03.923916] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-29T19:39:04.046998] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-29T19:39:04.393578] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-29T19:39:04.753361] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-29T19:39:05.193559] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-29T19:39:05.616943] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-29T19:39:05.993613] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-29T19:39:06.793565] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-29T19:39:07.518275] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-29T19:39:07.593629] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-29T19:39:07.993258] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T19:39:08.393608] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-29T19:39:08.669892] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-29T19:39:08.817477] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-29T19:39:08.819247] [INFO ] [REMOTE ] LANV: Full fetch complete (4179 records). [2025-10-29T19:39:08.819329] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-29T19:39:09.199147] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-29T19:39:09.205528] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-29T19:39:09.206591] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-29T19:39:09.206815] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-29T19:39:09.206873] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-29T19:39:09.207216] [DEBUG] [LOCAL ] LANV: Trimmed 4179 records to 2766 (keeping 200 days of data) [2025-10-29T19:39:09.222201] [DEBUG] [LOCAL ] LANV: Primary data saved (2766 records). [2025-10-29T19:39:09.222261] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-29T19:39:09.222325] [INFO ] [MAIN ] Update Progress: 1237/2367 symbols completed. LANV took 32.3s. Estimated remaining: 2h 25m 21s. Rate: 7.8 symbols/min [2025-10-29T19:39:09.993574] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-29T19:39:10.793610] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-29T19:39:11.005828] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:39:11.330607] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-29T19:39:11.341810] [INFO ] [REMOTE ] LAR: Full fetch complete (64367 records). [2025-10-29T19:39:11.341938] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-29T19:39:11.529677] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-29T19:39:11.530324] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:39:11.530391] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:39:11.530438] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-29T19:39:11.530492] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-29T19:39:11.530535] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-29T19:39:11.530572] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-29T19:39:11.530626] [INFO ] [MAIN ] Update Progress: 1238/2367 symbols completed. LAR took 33.8s. Estimated remaining: 2h 25m 8s. Rate: 7.8 symbols/min [2025-10-29T19:39:11.593579] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-29T19:39:12.176766] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-29T19:39:12.393552] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-29T19:39:12.835786] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T19:39:13.193557] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-29T19:39:13.509963] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-29T19:39:13.993619] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-29T19:39:14.469357] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T19:39:14.793708] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-29T19:39:14.987722] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-29T19:39:15.593576] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-29T19:39:15.904225] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T19:39:16.393569] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-29T19:39:16.604588] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-29T19:39:17.193623] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-29T19:39:17.339675] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-29T19:39:17.993564] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-29T19:39:18.386607] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T19:39:18.793721] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-29T19:39:19.178889] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T19:39:19.593637] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-29T19:39:19.928885] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-29T19:39:20.393564] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-29T19:39:20.677447] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T19:39:21.193638] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-29T19:39:21.292443] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T19:39:21.993564] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-29T19:39:22.169251] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-29T19:39:22.793604] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-29T19:39:22.979023] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T19:39:22.987147] [INFO ] [REMOTE ] LB: Full fetch complete (55265 records). [2025-10-29T19:39:22.987255] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-29T19:39:23.373572] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-29T19:39:23.373684] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-29T19:39:23.374635] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-29T19:39:23.374724] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-29T19:39:23.375912] [DEBUG] [LOCAL ] LB: Trimmed 55265 records to 36445 (keeping 200 days of data) [2025-10-29T19:39:23.597428] [DEBUG] [LOCAL ] LB: Primary data saved (36445 records). [2025-10-29T19:39:23.597601] [INFO ] [MAIN ] LB: Full history saved. [2025-10-29T19:39:23.597741] [INFO ] [MAIN ] Update Progress: 1239/2367 symbols completed. LB took 23.6s. Estimated remaining: 2h 25m 5s. Rate: 7.8 symbols/min [2025-10-29T19:39:23.913441] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-29T19:39:23.923256] [INFO ] [REMOTE ] LAZ: Full fetch complete (65290 records). [2025-10-29T19:39:23.923490] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-29T19:39:24.341270] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-29T19:39:24.341371] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-29T19:39:24.342857] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-29T19:39:24.342922] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-29T19:39:24.344595] [DEBUG] [LOCAL ] LAZ: Trimmed 65290 records to 44210 (keeping 200 days of data) [2025-10-29T19:39:24.623924] [DEBUG] [LOCAL ] LAZ: Primary data saved (44210 records). [2025-10-29T19:39:24.624110] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-29T19:39:24.624213] [INFO ] [MAIN ] Update Progress: 1240/2367 symbols completed. LAZ took 25.0s. Estimated remaining: 2h 24m 51s. Rate: 7.8 symbols/min [2025-10-29T19:39:25.261856] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:39:25.322145] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:39:25.308937] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:39:25.358295] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:39:25.416310] [DEBUG] [LOCAL ] LCII: Loaded 26239 existing records from primary storage. [2025-10-29T19:39:25.416816] [INFO ] [MAIN ] LCII: Loaded 26239 existing records. [2025-10-29T19:39:25.562220] [DEBUG] [LOCAL ] LDI: Loaded 45252 existing records from primary storage. [2025-10-29T19:39:25.570322] [DEBUG] [LOCAL ] LBRT: Loaded 53005 existing records from primary storage. [2025-10-29T19:39:25.570624] [INFO ] [MAIN ] LDI: Loaded 45252 existing records. [2025-10-29T19:39:25.592258] [DEBUG] [LOCAL ] LC: Loaded 48227 existing records from primary storage. [2025-10-29T19:39:25.616282] [INFO ] [MAIN ] LBRT: Loaded 53005 existing records. [2025-10-29T19:39:25.625128] [INFO ] [MAIN ] LC: Loaded 48227 existing records. [2025-10-29T19:39:25.790791] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:25.917603] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-29T19:39:25.957079] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-29T19:39:26.039764] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-29T19:39:26.166136] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:26.154090] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-29T19:39:26.152200] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:26.183814] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-29T19:39:26.211211] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-29T19:39:26.273830] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-29T19:39:26.303259] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-29T19:39:26.308538] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-29T19:39:26.331633] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-29T19:39:26.348437] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-29T19:39:26.348499] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-29T19:39:26.343138] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:26.429753] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-29T19:39:26.490424] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-29T19:39:26.596575] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-29T19:39:26.684450] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-29T19:39:27.372206] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:27.417550] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-29T19:39:27.640307] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:27.687449] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-29T19:39:27.780512] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:27.810774] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-29T19:39:27.832080] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:27.832434] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-29T19:39:28.337421] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-29T19:39:28.343271] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-29T19:39:28.593740] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T19:39:28.600431] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-29T19:39:29.068499] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-29T19:39:29.078701] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-29T19:39:29.153241] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T19:39:29.186677] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T19:39:29.193506] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-29T19:39:29.526828] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-29T19:39:29.993523] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-29T19:39:30.136662] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-29T19:39:30.190243] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T19:39:30.793571] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-29T19:39:31.117908] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-29T19:39:31.593583] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-29T19:39:32.192310] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T19:39:32.393574] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-29T19:39:32.486498] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-29T19:39:33.193573] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-29T19:39:33.772756] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-29T19:39:33.993546] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-29T19:39:34.490279] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-29T19:39:34.793577] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-29T19:39:34.881747] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-29T19:39:35.593552] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-29T19:39:36.046228] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:39:36.393526] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-29T19:39:36.842340] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T19:39:37.193597] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-29T19:39:37.719501] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T19:39:37.993542] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-29T19:39:38.350885] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-29T19:39:38.793563] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-29T19:39:39.273507] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T19:39:39.593669] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-29T19:39:39.945989] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:39:40.399465] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-29T19:39:40.404294] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-29T19:39:41.193564] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-29T19:39:41.681611] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:39:41.993560] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-29T19:39:42.488279] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-29T19:39:42.793573] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-29T19:39:42.850414] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-29T19:39:43.593555] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-29T19:39:44.201434] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T19:39:44.393568] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-29T19:39:44.875266] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T19:39:45.193575] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-29T19:39:45.258088] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-29T19:39:45.993567] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-29T19:39:46.457924] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-29T19:39:46.793553] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-29T19:39:47.233537] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:39:47.593562] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-29T19:39:47.899746] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-29T19:39:48.393567] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-29T19:39:49.193529] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-29T19:39:49.267152] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-29T19:39:49.295040] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-29T19:39:49.993625] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-29T19:39:50.486748] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T19:39:50.497403] [INFO ] [REMOTE ] LC: Full fetch complete (70711 records). [2025-10-29T19:39:50.497537] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-29T19:39:50.798729] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-29T19:39:50.885424] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-29T19:39:50.885508] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-29T19:39:50.886455] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-29T19:39:50.886517] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-29T19:39:50.887938] [DEBUG] [LOCAL ] LC: Trimmed 70711 records to 48253 (keeping 200 days of data) [2025-10-29T19:39:51.159384] [DEBUG] [LOCAL ] LC: Primary data saved (48253 records). [2025-10-29T19:39:51.159495] [INFO ] [MAIN ] LC: Full history saved. [2025-10-29T19:39:51.159571] [INFO ] [MAIN ] Update Progress: 1241/2367 symbols completed. LC took 26.5s. Estimated remaining: 2h 25m 0s. Rate: 7.8 symbols/min [2025-10-29T19:39:51.330994] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:39:51.371574] [DEBUG] [LOCAL ] LDOS: Loaded 44181 existing records from primary storage. [2025-10-29T19:39:51.371908] [INFO ] [MAIN ] LDOS: Loaded 44181 existing records. [2025-10-29T19:39:51.545214] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:51.545425] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-29T19:39:51.545480] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-29T19:39:51.546273] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-29T19:39:51.546333] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-29T19:39:51.602743] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-29T19:39:51.913635] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:51.943496] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-29T19:39:51.954609] [INFO ] [REMOTE ] LDI: Full fetch complete (62705 records). [2025-10-29T19:39:51.954745] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-29T19:39:52.350740] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-29T19:39:52.350961] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-29T19:39:52.351874] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-29T19:39:52.351984] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-29T19:39:52.383411] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-29T19:39:52.383623] [DEBUG] [LOCAL ] LDI: Trimmed 62705 records to 45381 (keeping 200 days of data) [2025-10-29T19:39:52.393931] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-29T19:39:52.595532] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-29T19:39:52.611830] [INFO ] [REMOTE ] LCII: Full fetch complete (39103 records). [2025-10-29T19:39:52.615477] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-29T19:39:52.966185] [DEBUG] [LOCAL ] LDI: Primary data saved (45381 records). [2025-10-29T19:39:52.966385] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-29T19:39:52.972260] [INFO ] [MAIN ] Update Progress: 1242/2367 symbols completed. LDI took 28.3s. Estimated remaining: 2h 24m 47s. Rate: 7.8 symbols/min [2025-10-29T19:39:53.174875] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-29T19:39:53.180140] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-29T19:39:53.191537] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-29T19:39:53.205122] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-29T19:39:53.205239] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-29T19:39:53.240167] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:39:53.240853] [DEBUG] [LOCAL ] LCII: Trimmed 39103 records to 26223 (keeping 200 days of data) [2025-10-29T19:39:53.364139] [DEBUG] [LOCAL ] LDP: Loaded 12139 existing records from primary storage. [2025-10-29T19:39:53.379461] [INFO ] [MAIN ] LDP: Loaded 12139 existing records. [2025-10-29T19:39:53.536526] [DEBUG] [LOCAL ] LCII: Primary data saved (26223 records). [2025-10-29T19:39:53.536802] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-29T19:39:53.542992] [INFO ] [MAIN ] Update Progress: 1243/2367 symbols completed. LCII took 28.8s. Estimated remaining: 2h 24m 33s. Rate: 7.8 symbols/min [2025-10-29T19:39:53.692618] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:53.731500] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-29T19:39:53.737105] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-29T19:39:53.748534] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-29T19:39:53.769429] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-29T19:39:53.836799] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:39:54.179306] [DEBUG] [LOCAL ] LEA: Loaded 40774 existing records from primary storage. [2025-10-29T19:39:54.241770] [INFO ] [MAIN ] LEA: Loaded 40774 existing records. [2025-10-29T19:39:54.259777] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-29T19:39:54.348226] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-29T19:39:54.468796] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:54.538132] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:39:54.538371] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-29T19:39:54.538434] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-29T19:39:54.538894] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-29T19:39:54.538955] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-29T19:39:54.793768] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-29T19:39:54.914603] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:39:54.947806] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-29T19:39:55.593525] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-29T19:39:55.638826] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-29T19:39:55.749470] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-29T19:39:56.393622] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-29T19:39:56.989677] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T19:39:57.193572] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-29T19:39:57.631012] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-29T19:39:57.993559] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-29T19:39:58.575512] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T19:39:58.793568] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-29T19:39:59.252515] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-29T19:39:59.269816] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-29T19:39:59.593570] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-29T19:40:00.393616] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-29T19:40:01.074019] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-29T19:40:01.142096] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T19:40:01.193579] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-29T19:40:01.993605] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-29T19:40:02.672294] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-29T19:40:02.695145] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T19:40:02.793587] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-29T19:40:03.593547] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-29T19:40:04.184208] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T19:40:04.393699] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-29T19:40:04.654994] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T19:40:05.193636] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-29T19:40:05.823480] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T19:40:05.917318] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-29T19:40:05.928555] [INFO ] [REMOTE ] LBRT: Full fetch complete (76939 records). [2025-10-29T19:40:05.928727] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-29T19:40:05.998862] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-29T19:40:06.316795] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-29T19:40:06.316877] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-29T19:40:06.317952] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-29T19:40:06.318042] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-29T19:40:06.319457] [DEBUG] [LOCAL ] LBRT: Trimmed 76939 records to 53005 (keeping 200 days of data) [2025-10-29T19:40:06.629888] [DEBUG] [LOCAL ] LBRT: Primary data saved (53005 records). [2025-10-29T19:40:06.630012] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-29T19:40:06.630086] [INFO ] [MAIN ] Update Progress: 1244/2367 symbols completed. LBRT took 42.0s. Estimated remaining: 2h 24m 30s. Rate: 7.8 symbols/min [2025-10-29T19:40:06.806334] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-29T19:40:06.851885] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:40:06.901139] [DEBUG] [LOCAL ] LEG: Loaded 49848 existing records from primary storage. [2025-10-29T19:40:06.901446] [INFO ] [MAIN ] LEG: Loaded 49848 existing records. [2025-10-29T19:40:07.098557] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:40:07.098885] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-29T19:40:07.098968] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-29T19:40:07.099419] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-29T19:40:07.099477] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-29T19:40:07.457016] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:40:07.481487] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T19:40:07.593516] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-29T19:40:08.124553] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-29T19:40:08.393528] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-29T19:40:08.825101] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T19:40:09.193593] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-29T19:40:09.556783] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T19:40:09.993569] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-29T19:40:10.591332] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-29T19:40:10.793552] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-29T19:40:11.504744] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T19:40:11.593549] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-29T19:40:12.244233] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T19:40:12.393553] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-29T19:40:12.695772] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T19:40:13.193606] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-29T19:40:13.768347] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T19:40:13.993565] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-29T19:40:14.303107] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T19:40:14.793550] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-29T19:40:15.201061] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-29T19:40:15.593549] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-29T19:40:16.035028] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T19:40:16.393590] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-29T19:40:16.621993] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-29T19:40:16.756208] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-29T19:40:17.193555] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-29T19:40:17.688720] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-29T19:40:17.993563] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-29T19:40:18.793588] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-29T19:40:19.211581] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T19:40:19.428986] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-29T19:40:19.593563] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-29T19:40:20.393561] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-29T19:40:20.962146] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-29T19:40:20.975264] [INFO ] [REMOTE ] LDOS: Full fetch complete (66468 records). [2025-10-29T19:40:20.975556] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-29T19:40:21.198786] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-29T19:40:21.393796] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-29T19:40:21.393903] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-29T19:40:21.394882] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-29T19:40:21.394962] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-29T19:40:21.396359] [DEBUG] [LOCAL ] LDOS: Trimmed 66468 records to 44096 (keeping 200 days of data) [2025-10-29T19:40:21.674564] [DEBUG] [LOCAL ] LDOS: Primary data saved (44096 records). [2025-10-29T19:40:21.674773] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-29T19:40:21.674889] [INFO ] [MAIN ] Update Progress: 1245/2367 symbols completed. LDOS took 30.5s. Estimated remaining: 2h 24m 29s. Rate: 7.8 symbols/min [2025-10-29T19:40:21.902229] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:40:21.906318] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T19:40:21.930311] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-29T19:40:21.977921] [DEBUG] [LOCAL ] LEN: Loaded 53188 existing records from primary storage. [2025-10-29T19:40:21.978252] [INFO ] [MAIN ] LEN: Loaded 53188 existing records. [2025-10-29T19:40:21.998738] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-29T19:40:22.178902] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:40:22.179128] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-29T19:40:22.179175] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-29T19:40:22.180454] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-29T19:40:22.180513] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-29T19:40:22.535527] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:40:22.793554] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-29T19:40:23.153408] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-29T19:40:23.593622] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-29T19:40:24.031536] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-29T19:40:24.393574] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-29T19:40:24.719396] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-29T19:40:25.134503] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-29T19:40:25.137203] [INFO ] [REMOTE ] LDP: Full fetch complete (18590 records). [2025-10-29T19:40:25.137281] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-29T19:40:25.198799] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-29T19:40:25.495074] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-29T19:40:25.495148] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-29T19:40:25.495499] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-29T19:40:25.495539] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-29T19:40:25.496087] [DEBUG] [LOCAL ] LDP: Trimmed 18590 records to 12102 (keeping 200 days of data) [2025-10-29T19:40:25.569943] [DEBUG] [LOCAL ] LDP: Primary data saved (12102 records). [2025-10-29T19:40:25.570070] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-29T19:40:25.570148] [INFO ] [MAIN ] Update Progress: 1246/2367 symbols completed. LDP took 32.6s. Estimated remaining: 2h 24m 18s. Rate: 7.8 symbols/min [2025-10-29T19:40:25.737135] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:40:25.751735] [DEBUG] [LOCAL ] LEO: Loaded 16438 existing records from primary storage. [2025-10-29T19:40:25.751968] [INFO ] [MAIN ] LEO: Loaded 16438 existing records. [2025-10-29T19:40:25.926923] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:40:25.927149] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-29T19:40:25.927195] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-29T19:40:25.927577] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-29T19:40:25.927633] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-29T19:40:26.000301] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-29T19:40:26.277457] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:40:26.578982] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T19:40:26.793592] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-29T19:40:27.247883] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-29T19:40:27.256002] [INFO ] [REMOTE ] LEA: Full fetch complete (60304 records). [2025-10-29T19:40:27.256107] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-29T19:40:27.598730] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-29T19:40:27.644157] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-29T19:40:27.644230] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-29T19:40:27.645119] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-29T19:40:27.645179] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-29T19:40:27.646311] [DEBUG] [LOCAL ] LEA: Trimmed 60304 records to 40721 (keeping 200 days of data) [2025-10-29T19:40:27.891317] [DEBUG] [LOCAL ] LEA: Primary data saved (40721 records). [2025-10-29T19:40:27.891433] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-29T19:40:27.891504] [INFO ] [MAIN ] Update Progress: 1247/2367 symbols completed. LEA took 34.3s. Estimated remaining: 2h 24m 5s. Rate: 7.8 symbols/min [2025-10-29T19:40:28.086503] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:40:28.135512] [DEBUG] [LOCAL ] LEVI: Loaded 51799 existing records from primary storage. [2025-10-29T19:40:28.136038] [INFO ] [MAIN ] LEVI: Loaded 51799 existing records. [2025-10-29T19:40:28.343766] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:40:28.346161] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-29T19:40:28.355811] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-29T19:40:28.356504] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-29T19:40:28.357489] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-29T19:40:28.357551] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-29T19:40:28.399837] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-29T19:40:28.721776] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:40:29.032847] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-29T19:40:29.193545] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-29T19:40:29.823219] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T19:40:29.993516] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-29T19:40:30.632368] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-29T19:40:30.642618] [INFO ] [REMOTE ] LEG: Full fetch complete (72810 records). [2025-10-29T19:40:30.642793] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-29T19:40:30.813866] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-29T19:40:31.044665] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-29T19:40:31.044756] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-29T19:40:31.045778] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-29T19:40:31.045838] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-29T19:40:31.047205] [DEBUG] [LOCAL ] LEG: Trimmed 72810 records to 49840 (keeping 200 days of data) [2025-10-29T19:40:31.339941] [DEBUG] [LOCAL ] LEG: Primary data saved (49840 records). [2025-10-29T19:40:31.340067] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-29T19:40:31.340140] [INFO ] [MAIN ] Update Progress: 1248/2367 symbols completed. LEG took 24.7s. Estimated remaining: 2h 23m 54s. Rate: 7.8 symbols/min [2025-10-29T19:40:31.514176] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:40:31.544445] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-29T19:40:31.568324] [DEBUG] [LOCAL ] LFT: Loaded 18066 existing records from primary storage. [2025-10-29T19:40:31.568558] [INFO ] [MAIN ] LFT: Loaded 18066 existing records. [2025-10-29T19:40:31.598667] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-29T19:40:31.787083] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:40:31.787320] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-29T19:40:31.787367] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-29T19:40:31.787603] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-29T19:40:31.787669] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-29T19:40:32.147864] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:40:32.183697] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T19:40:32.393588] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-29T19:40:32.993585] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T19:40:33.108625] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T19:40:33.193524] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-29T19:40:33.748812] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-29T19:40:33.993528] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-29T19:40:34.793570] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-29T19:40:35.313692] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-29T19:40:35.394952] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-29T19:40:35.593599] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-29T19:40:36.393578] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-29T19:40:36.889456] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T19:40:37.193531] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-29T19:40:37.331567] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-29T19:40:37.993555] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-29T19:40:38.749107] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-29T19:40:38.793539] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-29T19:40:39.333829] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-29T19:40:39.546159] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T19:40:39.593531] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-29T19:40:40.379945] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-29T19:40:40.393521] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-29T19:40:41.088776] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-29T19:40:41.193596] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-29T19:40:41.993609] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-29T19:40:42.397184] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T19:40:42.793542] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-29T19:40:42.842124] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-29T19:40:43.493308] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-29T19:40:43.593563] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-29T19:40:44.185824] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-29T19:40:44.393566] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-29T19:40:45.096496] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-29T19:40:45.193543] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-29T19:40:45.804077] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-29T19:40:45.993595] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-29T19:40:46.793559] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-29T19:40:46.847354] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-29T19:40:47.593594] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-29T19:40:48.076086] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-29T19:40:48.393682] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-29T19:40:49.137235] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-29T19:40:49.193632] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-29T19:40:49.729520] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-29T19:40:49.993584] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-29T19:40:50.578786] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T19:40:50.793605] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-29T19:40:50.877287] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-29T19:40:51.513183] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-29T19:40:51.593558] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-29T19:40:52.316297] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-29T19:40:52.393594] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-29T19:40:53.193603] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-29T19:40:53.600455] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T19:40:53.993563] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-29T19:40:54.793535] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-29T19:40:54.931781] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T19:40:55.347468] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-29T19:40:55.353985] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T19:40:55.593550] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-29T19:40:56.393568] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-29T19:40:57.044206] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-29T19:40:57.193517] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-29T19:40:57.354391] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-29T19:40:57.365726] [INFO ] [REMOTE ] LEN: Full fetch complete (77219 records). [2025-10-29T19:40:57.365863] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-29T19:40:57.747850] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-29T19:40:57.747933] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-29T19:40:57.748941] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-29T19:40:57.749005] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-29T19:40:57.750345] [DEBUG] [LOCAL ] LEN: Trimmed 77219 records to 53188 (keeping 200 days of data) [2025-10-29T19:40:57.984018] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-29T19:40:57.989150] [INFO ] [REMOTE ] LFT: Full fetch complete (23790 records). [2025-10-29T19:40:57.989907] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-29T19:40:57.998752] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-29T19:40:58.332621] [DEBUG] [LOCAL ] LEN: Primary data saved (53188 records). [2025-10-29T19:40:58.359027] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-29T19:40:58.365724] [INFO ] [MAIN ] Update Progress: 1249/2367 symbols completed. LEN took 36.7s. Estimated remaining: 2h 24m 3s. Rate: 7.8 symbols/min [2025-10-29T19:40:58.647736] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-29T19:40:58.651529] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-29T19:40:58.651441] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:40:58.652810] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-29T19:40:58.652878] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-29T19:40:58.653554] [DEBUG] [LOCAL ] LFT: Trimmed 23790 records to 18027 (keeping 200 days of data) [2025-10-29T19:40:58.741019] [DEBUG] [LOCAL ] LGI: Loaded 9777 existing records from primary storage. [2025-10-29T19:40:58.746150] [INFO ] [MAIN ] LGI: Loaded 9777 existing records. [2025-10-29T19:40:58.825869] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T19:40:58.807907] [DEBUG] [LOCAL ] LFT: Primary data saved (18027 records). [2025-10-29T19:40:58.818253] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-29T19:40:58.843773] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-29T19:40:58.855922] [INFO ] [REMOTE ] LEO: Full fetch complete (26512 records). [2025-10-29T19:40:58.856136] [INFO ] [MAIN ] Update Progress: 1250/2367 symbols completed. LFT took 27.5s. Estimated remaining: 2h 23m 49s. Rate: 7.8 symbols/min [2025-10-29T19:40:58.856363] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-29T19:40:59.231131] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:40:59.289277] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-29T19:40:59.323350] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-29T19:40:59.344613] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:40:59.384876] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-29T19:40:59.412883] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-29T19:40:59.756866] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-29T19:40:59.761454] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-29T19:40:59.780220] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-29T19:40:59.797906] [DEBUG] [LOCAL ] LH: Loaded 36806 existing records from primary storage. [2025-10-29T19:40:59.826139] [INFO ] [MAIN ] LH: Loaded 36806 existing records. [2025-10-29T19:40:59.805207] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-29T19:40:59.920578] [DEBUG] [LOCAL ] LEO: Trimmed 26512 records to 16357 (keeping 200 days of data) [2025-10-29T19:41:00.199801] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:00.230416] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-29T19:41:00.265431] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:41:00.266868] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-29T19:41:00.267181] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-29T19:41:00.268585] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-29T19:41:00.268961] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-29T19:41:00.391460] [DEBUG] [LOCAL ] LEO: Primary data saved (16357 records). [2025-10-29T19:41:00.402481] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-29T19:41:00.402692] [INFO ] [MAIN ] Update Progress: 1251/2367 symbols completed. LEO took 34.8s. Estimated remaining: 2h 23m 36s. Rate: 7.8 symbols/min [2025-10-29T19:41:00.752464] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:41:00.826877] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:00.827487] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-29T19:41:00.861936] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-29T19:41:00.874115] [INFO ] [REMOTE ] LEVI: Full fetch complete (75014 records). [2025-10-29T19:41:00.874322] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-29T19:41:01.109037] [DEBUG] [LOCAL ] LHX: Loaded 48202 existing records from primary storage. [2025-10-29T19:41:01.169560] [INFO ] [MAIN ] LHX: Loaded 48202 existing records. [2025-10-29T19:41:01.482445] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-29T19:41:01.482857] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-29T19:41:01.502137] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-29T19:41:01.505888] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:41:01.506116] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-29T19:41:01.506190] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-29T19:41:01.506316] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-29T19:41:01.507407] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-29T19:41:01.507487] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-29T19:41:01.540096] [DEBUG] [LOCAL ] LEVI: Trimmed 75014 records to 51795 (keeping 200 days of data) [2025-10-29T19:41:01.838875] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-29T19:41:01.876609] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-29T19:41:02.050020] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:02.054345] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-29T19:41:02.259904] [DEBUG] [LOCAL ] LEVI: Primary data saved (51795 records). [2025-10-29T19:41:02.260055] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-29T19:41:02.260138] [INFO ] [MAIN ] Update Progress: 1252/2367 symbols completed. LEVI took 34.4s. Estimated remaining: 2h 23m 23s. Rate: 7.8 symbols/min [2025-10-29T19:41:02.433456] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:41:02.459736] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-29T19:41:02.495618] [DEBUG] [LOCAL ] LII: Loaded 27548 existing records from primary storage. [2025-10-29T19:41:02.495966] [INFO ] [MAIN ] LII: Loaded 27548 existing records. [2025-10-29T19:41:02.580191] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-29T19:41:02.695522] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:41:02.695800] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-29T19:41:02.695852] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-29T19:41:02.696551] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-29T19:41:02.696610] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-29T19:41:02.797983] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-29T19:41:03.064605] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:03.378056] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T19:41:03.410866] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-29T19:41:03.593572] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-29T19:41:04.393578] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-29T19:41:04.792867] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T19:41:04.900089] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T19:41:05.193574] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-29T19:41:05.993559] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-29T19:41:06.246368] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-29T19:41:06.793727] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-29T19:41:06.939144] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T19:41:07.346201] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-29T19:41:07.593560] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-29T19:41:08.393627] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-29T19:41:08.728111] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-29T19:41:09.193555] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-29T19:41:09.671406] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-29T19:41:09.993575] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-29T19:41:10.457150] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T19:41:10.793582] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-29T19:41:10.832172] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T19:41:11.593560] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-29T19:41:12.186256] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-29T19:41:12.393562] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-29T19:41:12.568004] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T19:41:13.193595] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-29T19:41:13.490737] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-29T19:41:13.993565] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-29T19:41:14.188868] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-29T19:41:14.793576] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-29T19:41:15.196710] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T19:41:15.266435] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-29T19:41:15.593553] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-29T19:41:15.999069] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-29T19:41:16.393588] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-29T19:41:17.002076] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-29T19:41:17.193563] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-29T19:41:17.664138] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-29T19:41:17.993617] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-29T19:41:18.627415] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-29T19:41:18.630129] [INFO ] [REMOTE ] LGI: Full fetch complete (14416 records). [2025-10-29T19:41:18.630212] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-29T19:41:18.805351] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-29T19:41:19.032905] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-29T19:41:19.032988] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-29T19:41:19.033367] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-29T19:41:19.033408] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-29T19:41:19.034033] [DEBUG] [LOCAL ] LGI: Trimmed 14416 records to 9697 (keeping 200 days of data) [2025-10-29T19:41:19.092398] [DEBUG] [LOCAL ] LGI: Primary data saved (9697 records). [2025-10-29T19:41:19.092529] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-29T19:41:19.092608] [INFO ] [MAIN ] Update Progress: 1253/2367 symbols completed. LGI took 20.7s. Estimated remaining: 2h 23m 23s. Rate: 7.8 symbols/min [2025-10-29T19:41:19.257326] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:41:19.298509] [DEBUG] [LOCAL ] LION: Loaded 47410 existing records from primary storage. [2025-10-29T19:41:19.298844] [INFO ] [MAIN ] LION: Loaded 47410 existing records. [2025-10-29T19:41:19.473521] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:41:19.473771] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-29T19:41:19.473820] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-29T19:41:19.474703] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-29T19:41:19.474760] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-29T19:41:19.598678] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-29T19:41:19.841807] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:19.860132] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-29T19:41:20.393606] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-29T19:41:21.167353] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T19:41:21.193511] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-29T19:41:21.408321] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-29T19:41:21.993597] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-29T19:41:22.020982] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T19:41:22.793615] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-29T19:41:23.056236] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-29T19:41:23.524949] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-29T19:41:23.593513] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-29T19:41:24.398163] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-29T19:41:24.404609] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-29T19:41:25.193581] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-29T19:41:25.729950] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T19:41:25.993568] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-29T19:41:26.361790] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-29T19:41:26.793594] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-29T19:41:26.821346] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-29T19:41:27.593565] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-29T19:41:27.902243] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T19:41:28.393601] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-29T19:41:28.715978] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T19:41:29.193554] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-29T19:41:29.685873] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-29T19:41:29.966836] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-29T19:41:29.993518] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-29T19:41:30.793563] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-29T19:41:30.867594] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-29T19:41:31.593543] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-29T19:41:31.695510] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-29T19:41:32.393592] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-29T19:41:32.797760] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T19:41:33.193601] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-29T19:41:33.352187] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T19:41:33.361557] [INFO ] [REMOTE ] LII: Full fetch complete (41911 records). [2025-10-29T19:41:33.361867] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-29T19:41:33.835416] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-29T19:41:33.835557] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-29T19:41:33.836875] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-29T19:41:33.836942] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-29T19:41:33.838524] [DEBUG] [LOCAL ] LII: Trimmed 41911 records to 27593 (keeping 200 days of data) [2025-10-29T19:41:34.009293] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-29T19:41:34.042320] [DEBUG] [LOCAL ] LII: Primary data saved (27593 records). [2025-10-29T19:41:34.043158] [INFO ] [MAIN ] LII: Full history saved. [2025-10-29T19:41:34.043280] [INFO ] [MAIN ] Update Progress: 1254/2367 symbols completed. LII took 31.8s. Estimated remaining: 2h 23m 22s. Rate: 7.8 symbols/min [2025-10-29T19:41:34.237921] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:41:34.249407] [DEBUG] [LOCAL ] LITB: Loaded 3682 existing records from primary storage. [2025-10-29T19:41:34.249858] [INFO ] [MAIN ] LITB: Loaded 3682 existing records. [2025-10-29T19:41:34.455436] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:41:34.456034] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-29T19:41:34.456179] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-29T19:41:34.456502] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-29T19:41:34.456569] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-29T19:41:34.798478] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-29T19:41:34.873149] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:34.911496] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-29T19:41:34.968028] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-29T19:41:35.593728] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-29T19:41:36.309516] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T19:41:36.357289] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-29T19:41:36.393552] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-29T19:41:36.689946] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T19:41:37.193556] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-29T19:41:37.993552] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-29T19:41:38.657591] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-29T19:41:38.793569] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-29T19:41:39.233113] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T19:41:39.241773] [INFO ] [REMOTE ] LH: Full fetch complete (54977 records). [2025-10-29T19:41:39.241945] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-29T19:41:39.605256] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-29T19:41:39.657112] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-29T19:41:39.657242] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-29T19:41:39.658099] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-29T19:41:39.658159] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-29T19:41:39.659259] [DEBUG] [LOCAL ] LH: Trimmed 54977 records to 36812 (keeping 200 days of data) [2025-10-29T19:41:39.883061] [DEBUG] [LOCAL ] LH: Primary data saved (36812 records). [2025-10-29T19:41:39.883186] [INFO ] [MAIN ] LH: Full history saved. [2025-10-29T19:41:39.883262] [INFO ] [MAIN ] Update Progress: 1255/2367 symbols completed. LH took 41.0s. Estimated remaining: 2h 23m 12s. Rate: 7.8 symbols/min [2025-10-29T19:41:40.051471] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:41:40.100319] [DEBUG] [LOCAL ] LLY: Loaded 53161 existing records from primary storage. [2025-10-29T19:41:40.100612] [INFO ] [MAIN ] LLY: Loaded 53161 existing records. [2025-10-29T19:41:40.284514] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:41:40.284862] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-29T19:41:40.284936] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-29T19:41:40.286276] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-29T19:41:40.286344] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-29T19:41:40.398186] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-29T19:41:40.619886] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-29T19:41:40.669143] [INFO ] [REMOTE ] LION: Full fetch complete (58806 records). [2025-10-29T19:41:40.682739] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-29T19:41:40.752295] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:41.040226] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-29T19:41:41.144206] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-29T19:41:41.144402] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-29T19:41:41.145322] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-29T19:41:41.145395] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-29T19:41:41.147044] [DEBUG] [LOCAL ] LION: Trimmed 58806 records to 47519 (keeping 200 days of data) [2025-10-29T19:41:41.204328] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-29T19:41:41.262852] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-29T19:41:41.455375] [DEBUG] [LOCAL ] LION: Primary data saved (47519 records). [2025-10-29T19:41:41.455508] [INFO ] [MAIN ] LION: Full history saved. [2025-10-29T19:41:41.455588] [INFO ] [MAIN ] Update Progress: 1256/2367 symbols completed. LION took 22.4s. Estimated remaining: 2h 22m 59s. Rate: 7.8 symbols/min [2025-10-29T19:41:41.626571] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:41:41.677931] [DEBUG] [LOCAL ] LMND: Loaded 52101 existing records from primary storage. [2025-10-29T19:41:41.678317] [INFO ] [MAIN ] LMND: Loaded 52101 existing records. [2025-10-29T19:41:41.850218] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-29T19:41:41.869484] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:41:41.872771] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-29T19:41:41.872866] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-29T19:41:41.873754] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-29T19:41:41.873833] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-29T19:41:41.998622] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-29T19:41:42.224583] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:42.793560] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-29T19:41:43.593556] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-29T19:41:44.112015] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T19:41:44.203146] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-29T19:41:44.393571] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-29T19:41:45.200039] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-29T19:41:45.218965] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-29T19:41:45.229569] [INFO ] [REMOTE ] LHX: Full fetch complete (70629 records). [2025-10-29T19:41:45.229765] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-29T19:41:45.618866] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-29T19:41:45.618946] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-29T19:41:45.619913] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-29T19:41:45.619985] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-29T19:41:45.621288] [DEBUG] [LOCAL ] LHX: Trimmed 70629 records to 48176 (keeping 200 days of data) [2025-10-29T19:41:45.942733] [DEBUG] [LOCAL ] LHX: Primary data saved (48176 records). [2025-10-29T19:41:45.942946] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-29T19:41:45.943055] [INFO ] [MAIN ] Update Progress: 1257/2367 symbols completed. LHX took 45.5s. Estimated remaining: 2h 22m 49s. Rate: 7.8 symbols/min [2025-10-29T19:41:46.003941] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-29T19:41:46.138729] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:41:46.188626] [DEBUG] [LOCAL ] LMT: Loaded 49484 existing records from primary storage. [2025-10-29T19:41:46.189123] [INFO ] [MAIN ] LMT: Loaded 49484 existing records. [2025-10-29T19:41:46.395454] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:41:46.396172] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-29T19:41:46.396450] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-29T19:41:46.397528] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-29T19:41:46.397593] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-29T19:41:46.519147] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-29T19:41:46.732755] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-29T19:41:46.798406] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-29T19:41:46.855451] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:41:46.883752] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-29T19:41:47.145444] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-29T19:41:47.593573] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-29T19:41:48.393573] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-29T19:41:48.685154] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-29T19:41:49.193564] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-29T19:41:49.479727] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-29T19:41:49.690972] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-29T19:41:49.993610] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-29T19:41:50.793562] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-29T19:41:51.562387] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-29T19:41:51.593541] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-29T19:41:52.210630] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-29T19:41:52.393562] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-29T19:41:53.108180] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-29T19:41:53.193535] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-29T19:41:53.920374] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-29T19:41:53.993533] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-29T19:41:54.752365] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-29T19:41:54.793531] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-29T19:41:55.593711] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-29T19:41:55.727614] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-29T19:41:56.378831] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-29T19:41:56.393512] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-29T19:41:57.193562] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-29T19:41:57.785543] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-29T19:41:57.829008] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-29T19:41:57.993595] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-29T19:41:58.466966] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-29T19:41:58.793524] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-29T19:41:59.057347] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-29T19:41:59.593601] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-29T19:42:00.393634] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-29T19:42:01.074521] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-29T19:42:01.193539] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-29T19:42:01.781137] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-29T19:42:01.993576] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-29T19:42:02.534438] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-29T19:42:02.536062] [INFO ] [REMOTE ] LITB: Full fetch complete (5807 records). [2025-10-29T19:42:02.536150] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-29T19:42:02.802048] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-29T19:42:02.923106] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-29T19:42:02.923358] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-29T19:42:02.923536] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-29T19:42:02.923684] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-29T19:42:02.924356] [DEBUG] [LOCAL ] LITB: Trimmed 5807 records to 3625 (keeping 200 days of data) [2025-10-29T19:42:02.945058] [DEBUG] [LOCAL ] LITB: Primary data saved (3625 records). [2025-10-29T19:42:02.945255] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-29T19:42:02.945426] [INFO ] [MAIN ] Update Progress: 1258/2367 symbols completed. LITB took 28.9s. Estimated remaining: 2h 22m 49s. Rate: 7.8 symbols/min [2025-10-29T19:42:03.121193] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:42:03.158875] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-29T19:42:03.212043] [DEBUG] [LOCAL ] LNC: Loaded 51302 existing records from primary storage. [2025-10-29T19:42:03.212390] [INFO ] [MAIN ] LNC: Loaded 51302 existing records. [2025-10-29T19:42:03.386853] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:42:03.387084] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-29T19:42:03.387140] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-29T19:42:03.388117] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-29T19:42:03.388174] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-29T19:42:03.601757] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-29T19:42:03.781200] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:42:03.818157] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-29T19:42:04.393550] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-29T19:42:04.511958] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-29T19:42:05.193572] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-29T19:42:05.866188] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-29T19:42:05.983665] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-29T19:42:05.994427] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-29T19:42:06.793535] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-29T19:42:06.935278] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-29T19:42:07.593711] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-29T19:42:07.942692] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-29T19:42:08.393576] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-29T19:42:08.790034] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-29T19:42:09.193609] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-29T19:42:09.722440] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-29T19:42:09.734338] [INFO ] [REMOTE ] LMND: Full fetch complete (75490 records). [2025-10-29T19:42:09.734515] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-29T19:42:10.009498] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-29T19:42:10.164779] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-29T19:42:10.165008] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-29T19:42:10.166540] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-29T19:42:10.166687] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-29T19:42:10.168715] [DEBUG] [LOCAL ] LMND: Trimmed 75490 records to 52111 (keeping 200 days of data) [2025-10-29T19:42:10.533687] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-29T19:42:10.568026] [DEBUG] [LOCAL ] LMND: Primary data saved (52111 records). [2025-10-29T19:42:10.569267] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-29T19:42:10.569402] [INFO ] [MAIN ] Update Progress: 1259/2367 symbols completed. LMND took 29.1s. Estimated remaining: 2h 22m 41s. Rate: 7.8 symbols/min [2025-10-29T19:42:10.744154] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:42:10.787097] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-29T19:42:10.790872] [DEBUG] [LOCAL ] LND: Loaded 4868 existing records from primary storage. [2025-10-29T19:42:10.791398] [INFO ] [MAIN ] LND: Loaded 4868 existing records. [2025-10-29T19:42:10.800884] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-29T19:42:10.994041] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:42:10.994318] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-29T19:42:10.994372] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-29T19:42:10.994557] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-29T19:42:10.994600] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-29T19:42:11.374421] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:42:11.593634] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-29T19:42:12.012951] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-29T19:42:12.255408] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-29T19:42:12.266116] [INFO ] [REMOTE ] LMT: Full fetch complete (72489 records). [2025-10-29T19:42:12.266262] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-29T19:42:12.398748] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-29T19:42:12.682129] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-29T19:42:12.682265] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-29T19:42:12.683679] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-29T19:42:12.683788] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-29T19:42:12.685971] [DEBUG] [LOCAL ] LMT: Trimmed 72489 records to 49440 (keeping 200 days of data) [2025-10-29T19:42:13.007331] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T19:42:13.045276] [DEBUG] [LOCAL ] LMT: Primary data saved (49440 records). [2025-10-29T19:42:13.045727] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-29T19:42:13.045872] [INFO ] [MAIN ] Update Progress: 1260/2367 symbols completed. LMT took 27.1s. Estimated remaining: 2h 22m 29s. Rate: 7.8 symbols/min [2025-10-29T19:42:13.196743] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-29T19:42:13.252918] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-29T19:42:13.274226] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:42:13.334008] [DEBUG] [LOCAL ] LNG: Loaded 50969 existing records from primary storage. [2025-10-29T19:42:13.334450] [INFO ] [MAIN ] LNG: Loaded 50969 existing records. [2025-10-29T19:42:13.523020] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:42:13.523317] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-29T19:42:13.523407] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-29T19:42:13.524409] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-29T19:42:13.524476] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-29T19:42:13.901051] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:42:13.993583] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-29T19:42:14.568323] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-29T19:42:14.793624] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-29T19:42:15.459857] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-29T19:42:15.472197] [INFO ] [REMOTE ] LLY: Full fetch complete (77184 records). [2025-10-29T19:42:15.472342] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-29T19:42:15.595436] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-29T19:42:15.700717] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-29T19:42:15.941464] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-29T19:42:15.941550] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-29T19:42:15.942722] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-29T19:42:15.942795] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-29T19:42:15.944971] [DEBUG] [LOCAL ] LLY: Trimmed 77184 records to 53161 (keeping 200 days of data) [2025-10-29T19:42:16.276245] [DEBUG] [LOCAL ] LLY: Primary data saved (53161 records). [2025-10-29T19:42:16.276380] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-29T19:42:16.276459] [INFO ] [MAIN ] Update Progress: 1261/2367 symbols completed. LLY took 36.4s. Estimated remaining: 2h 22m 17s. Rate: 7.8 symbols/min [2025-10-29T19:42:16.398754] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-29T19:42:16.461548] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:42:16.474995] [DEBUG] [LOCAL ] LNN: Loaded 11561 existing records from primary storage. [2025-10-29T19:42:16.475233] [INFO ] [MAIN ] LNN: Loaded 11561 existing records. [2025-10-29T19:42:16.665723] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:42:16.665977] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-29T19:42:16.666025] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-29T19:42:16.666291] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-29T19:42:16.666345] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-29T19:42:16.964047] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-29T19:42:17.076478] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:42:17.121243] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T19:42:17.193592] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-29T19:42:17.993609] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-29T19:42:18.013448] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-29T19:42:18.316125] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-29T19:42:18.793570] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-29T19:42:19.279153] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T19:42:19.593563] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-29T19:42:20.390976] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-29T19:42:20.393551] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-29T19:42:21.193611] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-29T19:42:21.987989] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-29T19:42:21.997543] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-29T19:42:22.393064] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-29T19:42:22.660353] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-29T19:42:22.793556] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-29T19:42:23.593551] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-29T19:42:24.393524] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-29T19:42:24.794486] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-29T19:42:24.916312] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-29T19:42:25.028133] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-29T19:42:25.193578] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-29T19:42:25.903125] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-29T19:42:25.993556] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-29T19:42:26.552278] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-29T19:42:26.793607] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-29T19:42:27.185935] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-29T19:42:27.593704] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-29T19:42:27.913294] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-29T19:42:28.393614] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-29T19:42:29.193595] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-29T19:42:29.827024] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T19:42:29.993586] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-29T19:42:30.394211] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T19:42:30.443296] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:42:30.793626] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-29T19:42:31.593585] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-29T19:42:32.202918] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-29T19:42:32.393596] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-29T19:42:32.947843] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-29T19:42:32.963194] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-29T19:42:32.964977] [INFO ] [REMOTE ] LND: Full fetch complete (7781 records). [2025-10-29T19:42:32.965045] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-29T19:42:33.200951] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-29T19:42:33.332937] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-29T19:42:33.333016] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-29T19:42:33.333329] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-29T19:42:33.333405] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-29T19:42:33.333930] [DEBUG] [LOCAL ] LND: Trimmed 7781 records to 4855 (keeping 200 days of data) [2025-10-29T19:42:33.361107] [DEBUG] [LOCAL ] LND: Primary data saved (4855 records). [2025-10-29T19:42:33.361173] [INFO ] [MAIN ] LND: Full history saved. [2025-10-29T19:42:33.361245] [INFO ] [MAIN ] Update Progress: 1262/2367 symbols completed. LND took 22.8s. Estimated remaining: 2h 22m 18s. Rate: 7.8 symbols/min [2025-10-29T19:42:33.524057] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:42:33.559727] [DEBUG] [LOCAL ] LOAR: Loaded 41655 existing records from primary storage. [2025-10-29T19:42:33.560005] [INFO ] [MAIN ] LOAR: Loaded 41655 existing records. [2025-10-29T19:42:33.731908] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:42:33.732168] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-29T19:42:33.732220] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-29T19:42:33.732861] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-29T19:42:33.732917] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-29T19:42:34.003792] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-29T19:42:34.082827] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:42:34.514249] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-29T19:42:34.793563] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-29T19:42:35.277697] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-29T19:42:35.593597] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-29T19:42:35.716288] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-29T19:42:36.239121] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-29T19:42:36.393554] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-29T19:42:37.033825] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-29T19:42:37.193581] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-29T19:42:37.993539] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-29T19:42:38.052148] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T19:42:38.793559] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-29T19:42:39.593573] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-29T19:42:39.651822] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-29T19:42:40.322599] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-29T19:42:40.393529] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-29T19:42:40.576976] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T19:42:41.193637] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-29T19:42:41.676212] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:42:41.993620] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-29T19:42:42.257043] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T19:42:42.397259] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-29T19:42:42.793608] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-29T19:42:43.309248] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-29T19:42:43.593598] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-29T19:42:44.393618] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-29T19:42:44.897361] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-29T19:42:45.193544] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-29T19:42:45.218906] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T19:42:45.222508] [INFO ] [REMOTE ] LNN: Full fetch complete (16417 records). [2025-10-29T19:42:45.222618] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-29T19:42:45.628714] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-29T19:42:45.628802] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-29T19:42:45.629158] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-29T19:42:45.629195] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-29T19:42:45.629769] [DEBUG] [LOCAL ] LNN: Trimmed 16417 records to 11615 (keeping 200 days of data) [2025-10-29T19:42:45.700818] [DEBUG] [LOCAL ] LNN: Primary data saved (11615 records). [2025-10-29T19:42:45.700949] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-29T19:42:45.701029] [INFO ] [MAIN ] Update Progress: 1263/2367 symbols completed. LNN took 29.4s. Estimated remaining: 2h 22m 14s. Rate: 7.8 symbols/min [2025-10-29T19:42:45.867976] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:42:45.893580] [DEBUG] [LOCAL ] LOB: Loaded 26260 existing records from primary storage. [2025-10-29T19:42:45.893894] [INFO ] [MAIN ] LOB: Loaded 26260 existing records. [2025-10-29T19:42:45.998786] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-29T19:42:46.072440] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:42:46.072709] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-29T19:42:46.072773] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-29T19:42:46.073150] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-29T19:42:46.073206] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-29T19:42:46.441588] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:42:46.793546] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-29T19:42:47.006714] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-29T19:42:47.022270] [INFO ] [REMOTE ] LNG: Full fetch complete (74659 records). [2025-10-29T19:42:47.022428] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-29T19:42:47.418106] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-29T19:42:47.418208] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-29T19:42:47.419196] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-29T19:42:47.419346] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-29T19:42:47.420777] [DEBUG] [LOCAL ] LNG: Trimmed 74659 records to 50961 (keeping 200 days of data) [2025-10-29T19:42:47.564066] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-29T19:42:47.641327] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-29T19:42:47.781721] [DEBUG] [LOCAL ] LNG: Primary data saved (50961 records). [2025-10-29T19:42:47.781879] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-29T19:42:47.782019] [INFO ] [MAIN ] Update Progress: 1264/2367 symbols completed. LNG took 34.7s. Estimated remaining: 2h 22m 1s. Rate: 7.8 symbols/min [2025-10-29T19:42:47.955882] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:42:47.961262] [DEBUG] [LOCAL ] LOCL: Loaded 3227 existing records from primary storage. [2025-10-29T19:42:47.961492] [INFO ] [MAIN ] LOCL: Loaded 3227 existing records. [2025-10-29T19:42:48.154381] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:42:48.154830] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-29T19:42:48.154902] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-29T19:42:48.155198] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-29T19:42:48.155307] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-29T19:42:48.402947] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-29T19:42:48.474338] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-29T19:42:48.548265] [INFO ] [REMOTE ] LNC: Full fetch complete (74506 records). [2025-10-29T19:42:48.562078] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-29T19:42:48.644752] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:42:48.991340] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-29T19:42:48.991598] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-29T19:42:48.992751] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-29T19:42:48.992956] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-29T19:42:49.023988] [DEBUG] [LOCAL ] LNC: Trimmed 74506 records to 51280 (keeping 200 days of data) [2025-10-29T19:42:49.028969] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-29T19:42:49.211504] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-29T19:42:49.355709] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-29T19:42:49.381818] [DEBUG] [LOCAL ] LNC: Primary data saved (51280 records). [2025-10-29T19:42:49.381964] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-29T19:42:49.382049] [INFO ] [MAIN ] Update Progress: 1265/2367 symbols completed. LNC took 46.4s. Estimated remaining: 2h 21m 48s. Rate: 7.8 symbols/min [2025-10-29T19:42:49.554256] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:42:49.585122] [DEBUG] [LOCAL ] LOMA: Loaded 33069 existing records from primary storage. [2025-10-29T19:42:49.585390] [INFO ] [MAIN ] LOMA: Loaded 33069 existing records. [2025-10-29T19:42:49.763821] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:42:49.764069] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-29T19:42:49.764117] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-29T19:42:49.764796] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-29T19:42:49.764853] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-29T19:42:49.998849] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-29T19:42:50.145624] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:42:50.475459] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T19:42:50.799097] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-29T19:42:50.811628] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-29T19:42:51.593519] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-29T19:42:51.734080] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T19:42:51.828921] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-29T19:42:52.393632] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-29T19:42:53.193599] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-29T19:42:53.248360] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-29T19:42:53.993567] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-29T19:42:54.117513] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-29T19:42:54.793605] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-29T19:42:55.333666] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-29T19:42:55.593552] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-29T19:42:55.740685] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-29T19:42:55.853518] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-29T19:42:56.393581] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-29T19:42:57.193560] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-29T19:42:57.465316] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-29T19:42:57.993611] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-29T19:42:58.276019] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-29T19:42:58.299590] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-29T19:42:58.793584] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-29T19:42:59.298900] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-29T19:42:59.593583] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-29T19:43:00.393633] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-29T19:43:00.735234] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-29T19:43:01.193626] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-29T19:43:01.845480] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T19:43:01.855077] [INFO ] [REMOTE ] LOAR: Full fetch complete (56001 records). [2025-10-29T19:43:01.855270] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-29T19:43:01.998711] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-29T19:43:02.321529] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-29T19:43:02.321665] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-29T19:43:02.329419] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-29T19:43:02.340341] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-29T19:43:02.341963] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-29T19:43:02.350229] [DEBUG] [LOCAL ] LOAR: Trimmed 56001 records to 41547 (keeping 200 days of data) [2025-10-29T19:43:02.590246] [DEBUG] [LOCAL ] LOAR: Primary data saved (41547 records). [2025-10-29T19:43:02.590365] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-29T19:43:02.590439] [INFO ] [MAIN ] Update Progress: 1266/2367 symbols completed. LOAR took 29.2s. Estimated remaining: 2h 21m 45s. Rate: 7.8 symbols/min [2025-10-29T19:43:02.770783] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:43:02.784396] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-29T19:43:02.793518] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-29T19:43:02.838013] [DEBUG] [LOCAL ] LOW: Loaded 52926 existing records from primary storage. [2025-10-29T19:43:02.838359] [INFO ] [MAIN ] LOW: Loaded 52926 existing records. [2025-10-29T19:43:03.013573] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:43:03.013856] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-29T19:43:03.013913] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-29T19:43:03.015373] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-29T19:43:03.015437] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-29T19:43:03.388582] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:43:03.593528] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-29T19:43:03.672455] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-29T19:43:04.393539] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-29T19:43:04.589971] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-29T19:43:05.193532] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-29T19:43:05.288289] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T19:43:05.481599] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-29T19:43:05.993582] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-29T19:43:06.793572] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-29T19:43:07.365511] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T19:43:07.456491] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T19:43:07.593577] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-29T19:43:08.281971] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T19:43:08.393588] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-29T19:43:09.081147] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T19:43:09.193579] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-29T19:43:09.993600] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-29T19:43:10.496618] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T19:43:10.793614] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-29T19:43:10.994883] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-29T19:43:11.001521] [INFO ] [REMOTE ] LOB: Full fetch complete (38787 records). [2025-10-29T19:43:11.001778] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-29T19:43:11.434668] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-29T19:43:11.434823] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-29T19:43:11.436492] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-29T19:43:11.436576] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-29T19:43:11.438288] [DEBUG] [LOCAL ] LOB: Trimmed 38787 records to 26180 (keeping 200 days of data) [2025-10-29T19:43:11.593735] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-29T19:43:11.595744] [DEBUG] [LOCAL ] LOB: Primary data saved (26180 records). [2025-10-29T19:43:11.596968] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-29T19:43:11.597075] [INFO ] [MAIN ] Update Progress: 1267/2367 symbols completed. LOB took 25.9s. Estimated remaining: 2h 21m 39s. Rate: 7.8 symbols/min [2025-10-29T19:43:11.787317] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:43:11.827477] [DEBUG] [LOCAL ] LPG: Loaded 38700 existing records from primary storage. [2025-10-29T19:43:11.827831] [INFO ] [MAIN ] LPG: Loaded 38700 existing records. [2025-10-29T19:43:12.011665] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:43:12.012086] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-29T19:43:12.012290] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-29T19:43:12.012941] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-29T19:43:12.013001] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-29T19:43:12.380418] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:43:12.398707] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-29T19:43:12.414790] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-29T19:43:12.559391] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T19:43:12.701211] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-29T19:43:13.193618] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-29T19:43:13.993622] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-29T19:43:14.339058] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-29T19:43:14.480560] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-29T19:43:14.793563] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-29T19:43:15.593697] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-29T19:43:16.010242] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-29T19:43:16.018283] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T19:43:16.393599] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-29T19:43:16.788611] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-29T19:43:17.193561] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-29T19:43:17.993574] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-29T19:43:18.219253] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-29T19:43:18.373704] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-29T19:43:18.374967] [INFO ] [REMOTE ] LOCL: Full fetch complete (4535 records). [2025-10-29T19:43:18.375036] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-29T19:43:18.729727] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-29T19:43:18.729808] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-29T19:43:18.729939] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-29T19:43:18.729976] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-29T19:43:18.730308] [DEBUG] [LOCAL ] LOCL: Trimmed 4535 records to 3211 (keeping 200 days of data) [2025-10-29T19:43:18.747692] [DEBUG] [LOCAL ] LOCL: Primary data saved (3211 records). [2025-10-29T19:43:18.747758] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-29T19:43:18.747869] [INFO ] [MAIN ] Update Progress: 1268/2367 symbols completed. LOCL took 31.0s. Estimated remaining: 2h 21m 31s. Rate: 7.8 symbols/min [2025-10-29T19:43:18.795674] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-29T19:43:18.921778] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:43:18.948731] [DEBUG] [LOCAL ] LPL: Loaded 29274 existing records from primary storage. [2025-10-29T19:43:18.949001] [INFO ] [MAIN ] LPL: Loaded 29274 existing records. [2025-10-29T19:43:19.128416] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:43:19.128631] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-29T19:43:19.128713] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-29T19:43:19.129043] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-29T19:43:19.129101] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-29T19:43:19.485107] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:43:19.593554] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-29T19:43:20.032852] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-29T19:43:20.041425] [INFO ] [REMOTE ] LOMA: Full fetch complete (48181 records). [2025-10-29T19:43:20.041588] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-29T19:43:20.365901] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T19:43:20.399567] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-29T19:43:20.452623] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-29T19:43:20.452752] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-29T19:43:20.453581] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-29T19:43:20.453669] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-29T19:43:20.454811] [DEBUG] [LOCAL ] LOMA: Trimmed 48181 records to 33171 (keeping 200 days of data) [2025-10-29T19:43:20.640386] [DEBUG] [LOCAL ] LOMA: Primary data saved (33171 records). [2025-10-29T19:43:20.640518] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-29T19:43:20.640591] [INFO ] [MAIN ] Update Progress: 1269/2367 symbols completed. LOMA took 31.3s. Estimated remaining: 2h 21m 18s. Rate: 7.8 symbols/min [2025-10-29T19:43:20.810980] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:43:20.848421] [DEBUG] [LOCAL ] LPX: Loaded 39916 existing records from primary storage. [2025-10-29T19:43:20.848778] [INFO ] [MAIN ] LPX: Loaded 39916 existing records. [2025-10-29T19:43:21.031030] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:43:21.031241] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-29T19:43:21.031288] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-29T19:43:21.031680] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-29T19:43:21.031740] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-29T19:43:21.202615] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-29T19:43:21.414693] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:43:21.918050] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-29T19:43:21.993588] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-29T19:43:22.061431] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-29T19:43:22.793573] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-29T19:43:23.362678] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-29T19:43:23.593590] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-29T19:43:24.246281] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T19:43:24.278997] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-29T19:43:24.393582] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-29T19:43:25.193571] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-29T19:43:25.563041] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-29T19:43:25.993562] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-29T19:43:26.038791] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-29T19:43:26.793604] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-29T19:43:27.396245] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T19:43:27.498930] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-29T19:43:27.593577] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-29T19:43:28.204949] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-29T19:43:28.393577] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-29T19:43:29.193559] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-29T19:43:29.251725] [DEBUG] [REMOTE ] LPX: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-29T19:43:29.252060] [WARN ] [REMOTE ] LPX: No data returned for month 2025-02 [2025-10-29T19:43:29.252147] [FATAL] [REMOTE ] LPX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:43:29.252219] [FATAL] [MAIN ] LPX: Failed to fetch primary data. [2025-10-29T19:43:29.252281] [WARN ] [MAIN ] LPX: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:43:29.252350] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-29T19:43:29.252410] [DEBUG] [LOCAL ] LPX: No primary data file found to delete. [2025-10-29T19:43:29.252444] [INFO ] [LOCAL ] LPX: Starting deletion of derivative data. [2025-10-29T19:43:29.252619] [DEBUG] [LOCAL ] LPX: Deleted derivative data file. [2025-10-29T19:43:29.252735] [INFO ] [MAIN ] Update Progress: 1270/2367 symbols completed. LPX took 8.6s. Estimated remaining: 2h 21m 11s. Rate: 7.8 symbols/min [2025-10-29T19:43:29.453446] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:43:29.490852] [DEBUG] [LOCAL ] LRN: Loaded 39089 existing records from primary storage. [2025-10-29T19:43:29.491132] [INFO ] [MAIN ] LRN: Loaded 39089 existing records. [2025-10-29T19:43:29.667071] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:43:29.667355] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-29T19:43:29.667420] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-29T19:43:29.667936] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-29T19:43:29.667994] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-29T19:43:30.004548] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-29T19:43:30.026149] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:43:30.067223] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-29T19:43:30.793586] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-29T19:43:31.268636] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T19:43:31.593622] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-29T19:43:31.852901] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-29T19:43:32.393566] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-29T19:43:32.585310] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-29T19:43:33.193524] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-29T19:43:33.359186] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T19:43:33.993565] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-29T19:43:34.223518] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-29T19:43:34.793585] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-29T19:43:35.098073] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-29T19:43:35.593554] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-29T19:43:36.253196] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-29T19:43:36.393552] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-29T19:43:36.443386] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-29T19:43:37.193578] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-29T19:43:37.993549] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-29T19:43:38.113539] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-29T19:43:38.255865] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T19:43:38.793542] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-29T19:43:39.255637] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T19:43:39.593598] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-29T19:43:40.024170] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T19:43:40.393599] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-29T19:43:41.098135] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-29T19:43:41.110520] [INFO ] [REMOTE ] LPL: Full fetch complete (38453 records). [2025-10-29T19:43:41.110731] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-29T19:43:41.202154] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-29T19:43:41.542681] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-29T19:43:41.542795] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-29T19:43:41.543922] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-29T19:43:41.544010] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-29T19:43:41.545310] [DEBUG] [LOCAL ] LPL: Trimmed 38453 records to 29327 (keeping 200 days of data) [2025-10-29T19:43:41.654354] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T19:43:41.749304] [DEBUG] [LOCAL ] LPL: Primary data saved (29327 records). [2025-10-29T19:43:41.749445] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-29T19:43:41.749524] [INFO ] [MAIN ] Update Progress: 1271/2367 symbols completed. LPL took 23.0s. Estimated remaining: 2h 21m 7s. Rate: 7.8 symbols/min [2025-10-29T19:43:41.924672] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:43:41.963921] [DEBUG] [LOCAL ] LSPD: Loaded 41999 existing records from primary storage. [2025-10-29T19:43:41.964248] [INFO ] [MAIN ] LSPD: Loaded 41999 existing records. [2025-10-29T19:43:41.998813] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-29T19:43:42.140582] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:43:42.140821] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-29T19:43:42.140872] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-29T19:43:42.141357] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-29T19:43:42.141414] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-29T19:43:42.497051] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:43:42.527866] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T19:43:42.793575] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-29T19:43:43.090866] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-29T19:43:43.100481] [INFO ] [REMOTE ] LPG: Full fetch complete (58485 records). [2025-10-29T19:43:43.100813] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-29T19:43:43.541015] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-29T19:43:43.541143] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-29T19:43:43.542590] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-29T19:43:43.542692] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-29T19:43:43.544606] [DEBUG] [LOCAL ] LPG: Trimmed 58485 records to 38640 (keeping 200 days of data) [2025-10-29T19:43:43.608727] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-29T19:43:43.824021] [DEBUG] [LOCAL ] LPG: Primary data saved (38640 records). [2025-10-29T19:43:43.824253] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-29T19:43:43.824394] [INFO ] [MAIN ] Update Progress: 1272/2367 symbols completed. LPG took 32.2s. Estimated remaining: 2h 20m 55s. Rate: 7.8 symbols/min [2025-10-29T19:43:44.011156] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:43:44.046639] [DEBUG] [LOCAL ] LTC: Loaded 30479 existing records from primary storage. [2025-10-29T19:43:44.047112] [INFO ] [MAIN ] LTC: Loaded 30479 existing records. [2025-10-29T19:43:44.252266] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:43:44.252978] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-29T19:43:44.253205] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-29T19:43:44.253801] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-29T19:43:44.253901] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-29T19:43:44.394587] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-29T19:43:44.664599] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-29T19:43:44.738400] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:43:45.096043] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-29T19:43:45.193533] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-29T19:43:45.506823] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T19:43:45.993578] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-29T19:43:46.254356] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T19:43:46.793579] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-29T19:43:47.593618] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-29T19:43:47.711818] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-29T19:43:47.726048] [INFO ] [REMOTE ] LOW: Full fetch complete (76680 records). [2025-10-29T19:43:47.726321] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-29T19:43:47.908092] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T19:43:48.167659] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-29T19:43:48.167755] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-29T19:43:48.168800] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-29T19:43:48.168876] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-29T19:43:48.170371] [DEBUG] [LOCAL ] LOW: Trimmed 76680 records to 52910 (keeping 200 days of data) [2025-10-29T19:43:48.398723] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-29T19:43:48.513135] [DEBUG] [LOCAL ] LOW: Primary data saved (52910 records). [2025-10-29T19:43:48.526691] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-29T19:43:48.527640] [INFO ] [MAIN ] Update Progress: 1273/2367 symbols completed. LOW took 45.9s. Estimated remaining: 2h 20m 44s. Rate: 7.8 symbols/min [2025-10-29T19:43:48.562462] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-29T19:43:48.710600] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:43:48.760143] [DEBUG] [LOCAL ] LTH: Loaded 51532 existing records from primary storage. [2025-10-29T19:43:48.760453] [INFO ] [MAIN ] LTH: Loaded 51532 existing records. [2025-10-29T19:43:48.933983] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:43:48.934209] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-29T19:43:48.934303] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-29T19:43:48.934674] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-29T19:43:48.934733] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-29T19:43:49.203546] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-29T19:43:49.296830] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:43:49.486393] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T19:43:49.993566] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-29T19:43:50.096922] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T19:43:50.793609] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-29T19:43:51.180609] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T19:43:51.593572] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-29T19:43:51.865721] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-29T19:43:52.393603] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-29T19:43:52.899507] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-29T19:43:53.193600] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-29T19:43:53.285510] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-29T19:43:53.993583] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-29T19:43:54.353965] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-29T19:43:54.793586] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-29T19:43:55.181248] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-29T19:43:55.593567] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-29T19:43:56.015914] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T19:43:56.393595] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-29T19:43:56.655209] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T19:43:57.193572] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-29T19:43:57.677611] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-29T19:43:57.993531] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-29T19:43:58.073527] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-29T19:43:58.793621] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-29T19:43:59.182183] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-29T19:43:59.190198] [INFO ] [REMOTE ] LRN: Full fetch complete (58085 records). [2025-10-29T19:43:59.190352] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-29T19:43:59.583354] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-29T19:43:59.583434] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-29T19:43:59.584324] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-29T19:43:59.584400] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-29T19:43:59.585739] [DEBUG] [LOCAL ] LRN: Trimmed 58085 records to 39144 (keeping 200 days of data) [2025-10-29T19:43:59.635419] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-29T19:43:59.723742] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-29T19:43:59.848793] [DEBUG] [LOCAL ] LRN: Primary data saved (39144 records). [2025-10-29T19:43:59.848944] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-29T19:43:59.849038] [INFO ] [MAIN ] Update Progress: 1274/2367 symbols completed. LRN took 30.6s. Estimated remaining: 2h 20m 40s. Rate: 7.8 symbols/min [2025-10-29T19:44:00.040954] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:44:00.076986] [DEBUG] [LOCAL ] LTM: Loaded 39530 existing records from primary storage. [2025-10-29T19:44:00.077261] [INFO ] [MAIN ] LTM: Loaded 39530 existing records. [2025-10-29T19:44:00.255104] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:44:00.255331] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-29T19:44:00.255396] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-29T19:44:00.255603] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-29T19:44:00.255679] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-29T19:44:00.398753] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-29T19:44:00.619989] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:44:01.193533] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-29T19:44:01.248167] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-29T19:44:01.928940] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-29T19:44:01.993549] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-29T19:44:02.793571] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-29T19:44:02.876305] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-29T19:44:02.991601] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-29T19:44:03.593558] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-29T19:44:03.950952] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-29T19:44:04.393573] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-29T19:44:04.742869] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T19:44:05.193563] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-29T19:44:05.487151] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T19:44:05.993570] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-29T19:44:06.340199] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-29T19:44:06.793557] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-29T19:44:07.151335] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-29T19:44:07.556352] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-29T19:44:07.593565] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-29T19:44:08.393552] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-29T19:44:08.799594] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-29T19:44:08.808494] [INFO ] [REMOTE ] LTC: Full fetch complete (43921 records). [2025-10-29T19:44:08.808624] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-29T19:44:09.198701] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-29T19:44:09.259112] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-29T19:44:09.259188] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-29T19:44:09.260030] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-29T19:44:09.260091] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-29T19:44:09.261052] [DEBUG] [LOCAL ] LTC: Trimmed 43921 records to 30474 (keeping 200 days of data) [2025-10-29T19:44:09.441248] [DEBUG] [LOCAL ] LTC: Primary data saved (30474 records). [2025-10-29T19:44:09.441383] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-29T19:44:09.441459] [INFO ] [MAIN ] Update Progress: 1275/2367 symbols completed. LTC took 25.6s. Estimated remaining: 2h 20m 34s. Rate: 7.8 symbols/min [2025-10-29T19:44:09.609381] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:44:09.651745] [DEBUG] [LOCAL ] LU: Loaded 49221 existing records from primary storage. [2025-10-29T19:44:09.652042] [INFO ] [MAIN ] LU: Loaded 49221 existing records. [2025-10-29T19:44:09.829694] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:44:09.829939] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-29T19:44:09.829996] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-29T19:44:09.830529] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-29T19:44:09.830586] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-29T19:44:10.002768] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-29T19:44:10.043634] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-29T19:44:10.260132] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:44:10.261679] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-29T19:44:10.793562] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-29T19:44:11.279708] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-29T19:44:11.593528] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-29T19:44:11.708921] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-29T19:44:12.393594] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-29T19:44:12.940360] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-29T19:44:13.193568] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-29T19:44:13.664560] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T19:44:13.993560] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-29T19:44:14.058289] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-29T19:44:14.793555] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-29T19:44:14.925319] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-29T19:44:15.593553] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-29T19:44:15.924603] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-29T19:44:16.393584] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-29T19:44:17.126685] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T19:44:17.140817] [INFO ] [REMOTE ] LSPD: Full fetch complete (62545 records). [2025-10-29T19:44:17.141007] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-29T19:44:17.198681] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-29T19:44:17.529293] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-29T19:44:17.529510] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-29T19:44:17.530514] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-29T19:44:17.530580] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-29T19:44:17.531864] [DEBUG] [LOCAL ] LSPD: Trimmed 62545 records to 41978 (keeping 200 days of data) [2025-10-29T19:44:17.779439] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T19:44:17.834185] [DEBUG] [LOCAL ] LSPD: Primary data saved (41978 records). [2025-10-29T19:44:17.834307] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-29T19:44:17.834380] [INFO ] [MAIN ] Update Progress: 1276/2367 symbols completed. LSPD took 36.1s. Estimated remaining: 2h 20m 27s. Rate: 7.8 symbols/min [2025-10-29T19:44:17.999791] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-29T19:44:18.003922] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:44:18.028275] [DEBUG] [LOCAL ] LUCK: Loaded 23109 existing records from primary storage. [2025-10-29T19:44:18.028601] [INFO ] [MAIN ] LUCK: Loaded 23109 existing records. [2025-10-29T19:44:18.201262] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:44:18.201473] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-29T19:44:18.201521] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-29T19:44:18.201783] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-29T19:44:18.201840] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-29T19:44:18.554310] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:44:18.586051] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T19:44:18.793523] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-29T19:44:18.913437] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T19:44:19.593579] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-29T19:44:19.918553] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-29T19:44:20.393570] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-29T19:44:20.717300] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-29T19:44:21.193600] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-29T19:44:21.552558] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-29T19:44:21.993554] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-29T19:44:22.504005] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-29T19:44:22.515082] [INFO ] [REMOTE ] LTH: Full fetch complete (74737 records). [2025-10-29T19:44:22.515259] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-29T19:44:22.798716] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-29T19:44:22.904157] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-29T19:44:22.904253] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-29T19:44:22.905360] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-29T19:44:22.905429] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-29T19:44:22.907017] [DEBUG] [LOCAL ] LTH: Trimmed 74737 records to 51518 (keeping 200 days of data) [2025-10-29T19:44:23.205064] [DEBUG] [LOCAL ] LTH: Primary data saved (51518 records). [2025-10-29T19:44:23.205275] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-29T19:44:23.205501] [INFO ] [MAIN ] Update Progress: 1277/2367 symbols completed. LTH took 34.7s. Estimated remaining: 2h 20m 17s. Rate: 7.8 symbols/min [2025-10-29T19:44:23.334893] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:44:23.593555] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-29T19:44:23.815534] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T19:44:24.393688] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-29T19:44:24.606320] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:44:25.193630] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-29T19:44:25.447991] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T19:44:25.993611] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-29T19:44:26.090923] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T19:44:26.793595] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-29T19:44:27.016927] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-29T19:44:27.593587] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-29T19:44:27.672538] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T19:44:28.393547] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-29T19:44:28.857149] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T19:44:29.193533] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-29T19:44:29.235236] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-29T19:44:29.993576] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-29T19:44:30.620766] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-29T19:44:30.632235] [INFO ] [REMOTE ] LTM: Full fetch complete (52079 records). [2025-10-29T19:44:30.632397] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-29T19:44:30.795921] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-29T19:44:31.048854] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-29T19:44:31.071710] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-29T19:44:31.072173] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-29T19:44:31.073120] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-29T19:44:31.073186] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-29T19:44:31.074303] [DEBUG] [LOCAL ] LTM: Trimmed 52079 records to 39616 (keeping 200 days of data) [2025-10-29T19:44:31.297503] [DEBUG] [LOCAL ] LTM: Primary data saved (39616 records). [2025-10-29T19:44:31.297638] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-29T19:44:31.297759] [INFO ] [MAIN ] Update Progress: 1278/2367 symbols completed. LTM took 31.4s. Estimated remaining: 2h 20m 9s. Rate: 7.8 symbols/min [2025-10-29T19:44:31.593564] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-29T19:44:31.987069] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T19:44:32.393554] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-29T19:44:33.492918] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-29T19:44:33.499318] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-29T19:44:33.551600] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T19:44:33.993621] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-29T19:44:34.196769] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-29T19:44:34.793575] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-29T19:44:35.141159] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T19:44:35.545142] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T19:44:35.593594] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-29T19:44:36.393573] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-29T19:44:37.065104] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-29T19:44:37.076984] [INFO ] [REMOTE ] LU: Full fetch complete (71174 records). [2025-10-29T19:44:37.077250] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-29T19:44:37.330380] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T19:44:37.405455] [INFO ] [REMOTE ] LUCK: Full fetch complete (38648 records). [2025-10-29T19:44:37.408984] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-29T19:44:37.617410] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-29T19:44:37.617583] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-29T19:44:37.618757] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-29T19:44:37.618864] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-29T19:44:37.683067] [DEBUG] [LOCAL ] LU: Trimmed 71174 records to 49220 (keeping 200 days of data) [2025-10-29T19:44:38.044838] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-29T19:44:38.044930] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-29T19:44:38.045740] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-29T19:44:38.045822] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-29T19:44:38.124877] [DEBUG] [LOCAL ] LUCK: Trimmed 38648 records to 23098 (keeping 200 days of data) [2025-10-29T19:44:38.263991] [DEBUG] [LOCAL ] LU: Primary data saved (49220 records). [2025-10-29T19:44:38.275436] [INFO ] [MAIN ] LU: Full history saved. [2025-10-29T19:44:38.275540] [INFO ] [MAIN ] Update Progress: 1279/2367 symbols completed. LU took 28.8s. Estimated remaining: 2h 20m 1s. Rate: 7.8 symbols/min [2025-10-29T19:44:38.364447] [DEBUG] [LOCAL ] LUCK: Primary data saved (23098 records). [2025-10-29T19:44:38.364690] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-29T19:44:38.364812] [INFO ] [MAIN ] Update Progress: 1280/2367 symbols completed. LUCK took 20.5s. Estimated remaining: 2h 19m 47s. Rate: 7.8 symbols/min [2025-10-29T19:44:39.063103] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:44:39.097751] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:44:39.115296] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-29T19:44:39.133233] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:44:39.140580] [DEBUG] [LOCAL ] LUMN: No existing data file found in primary storage. [2025-10-29T19:44:39.140684] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-29T19:44:39.155800] [WARN ] [MAIN ] LUMN: No existing data found, performing full refresh instead. [2025-10-29T19:44:39.158809] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-29T19:44:39.156006] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-29T19:44:39.159028] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-29T19:44:39.158672] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:44:39.158975] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-29T19:44:39.159722] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-29T19:44:39.159799] [DEBUG] [LOCAL ] LUMN: No primary data file found to delete. [2025-10-29T19:44:39.159859] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-29T19:44:39.165145] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-29T19:44:39.672190] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-29T19:44:39.706101] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-29T19:44:39.712383] [INFO ] [MAIN ] LVS: Loaded 53569 existing records. [2025-10-29T19:44:39.748296] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-29T19:44:39.969708] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:44:40.024074] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-29T19:44:40.360829] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-29T19:44:40.408247] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-29T19:44:40.416629] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:44:40.408076] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:44:40.416834] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-29T19:44:40.423992] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-29T19:44:40.417572] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-29T19:44:40.442077] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-29T19:44:40.442273] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-29T19:44:40.450979] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-29T19:44:40.443945] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-29T19:44:40.451510] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-29T19:44:40.451443] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-29T19:44:40.451743] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-29T19:44:40.450874] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:44:40.452076] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-29T19:44:40.452318] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-29T19:44:40.464894] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-29T19:44:40.484332] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-29T19:44:40.495113] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-29T19:44:40.495887] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-29T19:44:40.501751] [INFO ] [MAIN ] Update Progress: 1281/2367 symbols completed. LUXE took 2.1s. Estimated remaining: 2h 19m 34s. Rate: 7.8 symbols/min [2025-10-29T19:44:41.083993] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:44:41.369003] [DEBUG] [LOCAL ] LVWR: Loaded 18684 existing records from primary storage. [2025-10-29T19:44:41.461282] [INFO ] [MAIN ] LVWR: Loaded 18684 existing records. [2025-10-29T19:44:41.505858] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:44:41.461166] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:44:41.532393] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-29T19:44:41.531480] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-29T19:44:41.680191] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:44:41.680429] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-29T19:44:41.680480] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-29T19:44:41.680825] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-29T19:44:41.680882] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-29T19:44:42.054418] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:44:42.054912] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-29T19:44:42.097404] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-29T19:44:42.108884] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-29T19:44:42.560549] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-29T19:44:42.562408] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-29T19:44:42.909357] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-29T19:44:42.916160] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-29T19:44:42.930364] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-29T19:44:42.978818] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-29T19:44:43.327665] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-29T19:44:43.600702] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-29T19:44:43.625334] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-29T19:44:44.393598] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-29T19:44:44.868183] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-29T19:44:45.193595] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-29T19:44:45.795730] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T19:44:45.993593] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-29T19:44:46.520930] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-29T19:44:46.793597] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-29T19:44:47.276120] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-29T19:44:47.593704] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-29T19:44:48.295498] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-29T19:44:48.393694] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-29T19:44:48.875059] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T19:44:49.193609] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-29T19:44:49.804501] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-29T19:44:49.993599] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-29T19:44:50.534561] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-29T19:44:50.793636] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-29T19:44:51.430565] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-29T19:44:51.593593] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-29T19:44:52.214015] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-29T19:44:52.393677] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-29T19:44:52.790106] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-29T19:44:53.193589] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-29T19:44:53.791973] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T19:44:53.993556] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-29T19:44:54.337576] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T19:44:54.451982] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-29T19:44:54.793598] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-29T19:44:55.593607] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-29T19:44:56.133403] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:44:56.393595] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-29T19:44:56.944952] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-29T19:44:57.193694] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-29T19:44:57.832883] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-29T19:44:57.915674] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T19:44:57.993624] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-29T19:44:58.793616] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-29T19:44:59.388962] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-29T19:44:59.593622] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-29T19:44:59.985368] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T19:45:00.393596] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-29T19:45:01.193539] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-29T19:45:01.332956] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-29T19:45:01.359873] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-29T19:45:01.993673] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-29T19:45:02.654427] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-29T19:45:02.813814] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-29T19:45:02.845051] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-29T19:45:03.593618] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-29T19:45:04.358858] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-29T19:45:04.393557] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-29T19:45:04.939686] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T19:45:05.193694] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-29T19:45:05.792267] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-29T19:45:05.993601] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-29T19:45:06.674667] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-29T19:45:06.781259] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-29T19:45:06.793516] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-29T19:45:07.593574] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-29T19:45:07.617629] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-29T19:45:07.621091] [INFO ] [REMOTE ] LVWR: Full fetch complete (20859 records). [2025-10-29T19:45:07.621231] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-29T19:45:08.039608] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-29T19:45:08.039767] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-29T19:45:08.040565] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-29T19:45:08.040613] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-29T19:45:08.041564] [DEBUG] [LOCAL ] LVWR: Trimmed 20859 records to 18716 (keeping 200 days of data) [2025-10-29T19:45:08.168703] [DEBUG] [LOCAL ] LVWR: Primary data saved (18716 records). [2025-10-29T19:45:08.168947] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-29T19:45:08.169060] [INFO ] [MAIN ] Update Progress: 1282/2367 symbols completed. LVWR took 27.6s. Estimated remaining: 2h 19m 44s. Rate: 7.8 symbols/min [2025-10-29T19:45:08.361344] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:08.393604] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-29T19:45:08.416481] [DEBUG] [LOCAL ] LW: Loaded 51101 existing records from primary storage. [2025-10-29T19:45:08.416931] [INFO ] [MAIN ] LW: Loaded 51101 existing records. [2025-10-29T19:45:08.606033] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:08.606352] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-29T19:45:08.606405] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-29T19:45:08.607129] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-29T19:45:08.607195] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-29T19:45:08.998590] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:09.193569] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-29T19:45:09.321143] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-29T19:45:09.334219] [INFO ] [REMOTE ] LVS: Full fetch complete (77729 records). [2025-10-29T19:45:09.334435] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-29T19:45:09.771517] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-29T19:45:09.771613] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-29T19:45:09.772691] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-29T19:45:09.772760] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-29T19:45:09.774265] [DEBUG] [LOCAL ] LVS: Trimmed 77729 records to 53569 (keeping 200 days of data) [2025-10-29T19:45:09.993796] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-29T19:45:10.116358] [DEBUG] [LOCAL ] LVS: Primary data saved (53569 records). [2025-10-29T19:45:10.116562] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-29T19:45:10.116714] [INFO ] [MAIN ] Update Progress: 1283/2367 symbols completed. LVS took 31.7s. Estimated remaining: 2h 19m 31s. Rate: 7.8 symbols/min [2025-10-29T19:45:10.300478] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:10.321703] [DEBUG] [LOCAL ] LXFR: Loaded 16103 existing records from primary storage. [2025-10-29T19:45:10.322118] [INFO ] [MAIN ] LXFR: Loaded 16103 existing records. [2025-10-29T19:45:10.546978] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:10.547438] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-29T19:45:10.547518] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-29T19:45:10.547913] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-29T19:45:10.547979] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-29T19:45:11.034686] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-29T19:45:11.138328] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:11.139514] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-29T19:45:11.141867] [INFO ] [REMOTE ] LUMN: Full fetch complete (77788 records). [2025-10-29T19:45:11.142405] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-29T19:45:11.408045] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-29T19:45:11.510937] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-29T19:45:11.584056] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-29T19:45:12.032327] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-29T19:45:12.105773] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-29T19:45:12.181106] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-29T19:45:12.203110] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-29T19:45:12.254161] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-29T19:45:12.258885] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-29T19:45:12.290488] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-29T19:45:12.398861] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-29T19:45:12.403499] [DEBUG] [LOCAL ] LUMN: Trimmed 77788 records to 53650 (keeping 200 days of data) [2025-10-29T19:45:12.600519] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-29T19:45:12.609318] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-29T19:45:12.611292] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-29T19:45:12.611386] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-29T19:45:12.639028] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-29T19:45:13.102970] [DEBUG] [LOCAL ] LUMN: Primary data saved (53650 records). [2025-10-29T19:45:13.103732] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-29T19:45:13.104488] [INFO ] [MAIN ] Update Progress: 1284/2367 symbols completed. LUMN took 34.7s. Estimated remaining: 2h 19m 19s. Rate: 7.8 symbols/min [2025-10-29T19:45:13.340011] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-29T19:45:13.376238] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-29T19:45:13.439918] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:13.462578] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-29T19:45:13.463028] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-29T19:45:13.463522] [INFO ] [MAIN ] Update Progress: 1285/2367 symbols completed. LUV took 35.1s. Estimated remaining: 2h 19m 5s. Rate: 7.8 symbols/min [2025-10-29T19:45:13.676292] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:13.713419] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-29T19:45:13.749027] [DEBUG] [LOCAL ] LXP: Loaded 50647 existing records from primary storage. [2025-10-29T19:45:13.750968] [INFO ] [MAIN ] LXP: Loaded 50647 existing records. [2025-10-29T19:45:13.920005] [DEBUG] [LOCAL ] LXU: Loaded 31022 existing records from primary storage. [2025-10-29T19:45:13.961808] [INFO ] [MAIN ] LXU: Loaded 31022 existing records. [2025-10-29T19:45:14.018451] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-29T19:45:14.031751] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:14.116855] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-29T19:45:14.137503] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-29T19:45:14.147439] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-29T19:45:14.158118] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-29T19:45:14.242334] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:14.311555] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-29T19:45:14.328634] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-29T19:45:14.350073] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-29T19:45:14.351907] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-29T19:45:14.457798] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-29T19:45:14.814545] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-29T19:45:15.009363] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:15.088681] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:15.304322] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-29T19:45:15.593553] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-29T19:45:15.840474] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T19:45:16.393611] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-29T19:45:16.892307] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T19:45:17.028561] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T19:45:17.193634] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-29T19:45:17.717698] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-29T19:45:17.993582] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-29T19:45:18.793596] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-29T19:45:19.295039] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-29T19:45:19.485232] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-29T19:45:19.593614] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-29T19:45:20.303885] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T19:45:20.393601] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-29T19:45:21.193585] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-29T19:45:21.721285] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T19:45:21.780192] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-29T19:45:21.993630] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-29T19:45:22.748395] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T19:45:22.793561] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-29T19:45:23.593549] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-29T19:45:23.748864] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-29T19:45:24.393619] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-29T19:45:24.858104] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T19:45:25.193626] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-29T19:45:25.491961] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T19:45:25.949514] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-29T19:45:25.953475] [INFO ] [REMOTE ] LXFR: Full fetch complete (24627 records). [2025-10-29T19:45:25.953581] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-29T19:45:25.998745] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-29T19:45:26.361542] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-29T19:45:26.361682] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-29T19:45:26.362838] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-29T19:45:26.362997] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-29T19:45:26.363938] [DEBUG] [LOCAL ] LXFR: Trimmed 24627 records to 16112 (keeping 200 days of data) [2025-10-29T19:45:26.472832] [DEBUG] [LOCAL ] LXFR: Primary data saved (16112 records). [2025-10-29T19:45:26.473049] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-29T19:45:26.473186] [INFO ] [MAIN ] Update Progress: 1286/2367 symbols completed. LXFR took 16.4s. Estimated remaining: 2h 19m 2s. Rate: 7.8 symbols/min [2025-10-29T19:45:26.660434] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:26.716886] [DEBUG] [LOCAL ] LYB: Loaded 53620 existing records from primary storage. [2025-10-29T19:45:26.717354] [INFO ] [MAIN ] LYB: Loaded 53620 existing records. [2025-10-29T19:45:26.800442] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-29T19:45:26.934511] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:26.934826] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-29T19:45:26.934888] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-29T19:45:26.935617] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-29T19:45:26.935743] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-29T19:45:27.325315] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:27.361147] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-29T19:45:27.593583] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-29T19:45:27.999299] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-29T19:45:28.393573] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-29T19:45:28.934882] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-29T19:45:29.193547] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-29T19:45:29.343520] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-29T19:45:29.993585] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-29T19:45:30.725660] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-29T19:45:30.793578] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-29T19:45:31.007829] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-29T19:45:31.593610] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-29T19:45:32.091000] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T19:45:32.393606] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-29T19:45:32.509180] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-29T19:45:33.193718] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-29T19:45:33.715431] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-29T19:45:33.993544] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-29T19:45:34.198593] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-29T19:45:34.793592] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-29T19:45:35.142804] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-29T19:45:35.593679] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-29T19:45:36.022462] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-29T19:45:36.393639] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-29T19:45:36.863256] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T19:45:37.193588] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-29T19:45:37.814740] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T19:45:37.993534] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-29T19:45:38.725180] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T19:45:38.736420] [INFO ] [REMOTE ] LW: Full fetch complete (74729 records). [2025-10-29T19:45:38.736582] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-29T19:45:38.802795] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-29T19:45:39.125983] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-29T19:45:39.126068] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-29T19:45:39.127280] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-29T19:45:39.127348] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-29T19:45:39.128788] [DEBUG] [LOCAL ] LW: Trimmed 74729 records to 51097 (keeping 200 days of data) [2025-10-29T19:45:39.459437] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-29T19:45:39.478450] [DEBUG] [LOCAL ] LW: Primary data saved (51097 records). [2025-10-29T19:45:39.478551] [INFO ] [MAIN ] LW: Full history saved. [2025-10-29T19:45:39.478622] [INFO ] [MAIN ] Update Progress: 1287/2367 symbols completed. LW took 31.3s. Estimated remaining: 2h 18m 59s. Rate: 7.8 symbols/min [2025-10-29T19:45:39.598663] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-29T19:45:39.645155] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:39.691664] [DEBUG] [LOCAL ] LYG: Loaded 52636 existing records from primary storage. [2025-10-29T19:45:39.691987] [INFO ] [MAIN ] LYG: Loaded 52636 existing records. [2025-10-29T19:45:39.873263] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:39.873578] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-29T19:45:39.873637] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-29T19:45:39.874069] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-29T19:45:39.874126] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-29T19:45:40.240111] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-29T19:45:40.270723] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:40.393513] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-29T19:45:40.931080] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-29T19:45:41.193536] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-29T19:45:41.499176] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-29T19:45:41.992381] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-29T19:45:41.994807] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-29T19:45:42.793534] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-29T19:45:43.236579] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-29T19:45:43.593595] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-29T19:45:44.244209] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-29T19:45:44.393597] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-29T19:45:44.864075] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:45:45.193550] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-29T19:45:45.225132] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-29T19:45:45.993603] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-29T19:45:46.602461] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-29T19:45:46.793598] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-29T19:45:47.075552] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-29T19:45:47.593578] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-29T19:45:48.170973] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-29T19:45:48.393611] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-29T19:45:48.883808] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T19:45:49.193564] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-29T19:45:49.332695] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-29T19:45:49.341483] [INFO ] [REMOTE ] LXU: Full fetch complete (45182 records). [2025-10-29T19:45:49.341776] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-29T19:45:49.786431] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-29T19:45:49.786530] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-29T19:45:49.787340] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-29T19:45:49.787406] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-29T19:45:49.788504] [DEBUG] [LOCAL ] LXU: Trimmed 45182 records to 31077 (keeping 200 days of data) [2025-10-29T19:45:49.963539] [DEBUG] [LOCAL ] LXU: Primary data saved (31077 records). [2025-10-29T19:45:49.963703] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-29T19:45:49.964387] [INFO ] [MAIN ] Update Progress: 1288/2367 symbols completed. LXU took 36.5s. Estimated remaining: 2h 18m 53s. Rate: 7.8 symbols/min [2025-10-29T19:45:49.998768] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-29T19:45:50.135595] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:50.187161] [DEBUG] [LOCAL ] LYV: Loaded 50878 existing records from primary storage. [2025-10-29T19:45:50.187496] [INFO ] [MAIN ] LYV: Loaded 50878 existing records. [2025-10-29T19:45:50.364280] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:50.364477] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-29T19:45:50.364523] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-29T19:45:50.364784] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-29T19:45:50.364857] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-29T19:45:50.723950] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:50.793554] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-29T19:45:50.832961] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-29T19:45:50.844384] [INFO ] [REMOTE ] LYB: Full fetch complete (77641 records). [2025-10-29T19:45:50.844560] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-29T19:45:51.248791] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-29T19:45:51.248936] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-29T19:45:51.250145] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-29T19:45:51.250335] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-29T19:45:51.252690] [DEBUG] [LOCAL ] LYB: Trimmed 77641 records to 53620 (keeping 200 days of data) [2025-10-29T19:45:51.375689] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-29T19:45:51.593750] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-29T19:45:51.606298] [DEBUG] [LOCAL ] LYB: Primary data saved (53620 records). [2025-10-29T19:45:51.607340] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-29T19:45:51.607455] [INFO ] [MAIN ] Update Progress: 1289/2367 symbols completed. LYB took 25.1s. Estimated remaining: 2h 18m 41s. Rate: 7.8 symbols/min [2025-10-29T19:45:51.779698] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:51.811626] [DEBUG] [LOCAL ] LZB: Loaded 34736 existing records from primary storage. [2025-10-29T19:45:51.811920] [INFO ] [MAIN ] LZB: Loaded 34736 existing records. [2025-10-29T19:45:51.985487] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:51.985724] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-29T19:45:51.985782] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-29T19:45:51.985965] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-29T19:45:51.986002] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-29T19:45:52.336886] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:52.381930] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-29T19:45:52.392921] [INFO ] [REMOTE ] LXP: Full fetch complete (72824 records). [2025-10-29T19:45:52.393112] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-29T19:45:52.405374] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-29T19:45:52.795808] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-29T19:45:52.795961] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-29T19:45:52.796994] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-29T19:45:52.797075] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-29T19:45:52.798553] [DEBUG] [LOCAL ] LXP: Trimmed 72824 records to 50625 (keeping 200 days of data) [2025-10-29T19:45:53.028392] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-29T19:45:53.130352] [DEBUG] [LOCAL ] LXP: Primary data saved (50625 records). [2025-10-29T19:45:53.130484] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-29T19:45:53.130561] [INFO ] [MAIN ] Update Progress: 1290/2367 symbols completed. LXP took 40.0s. Estimated remaining: 2h 18m 28s. Rate: 7.8 symbols/min [2025-10-29T19:45:53.203710] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-29T19:45:53.298115] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:45:53.312808] [DEBUG] [LOCAL ] LZM: Loaded 14881 existing records from primary storage. [2025-10-29T19:45:53.313031] [INFO ] [MAIN ] LZM: Loaded 14881 existing records. [2025-10-29T19:45:53.487972] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:45:53.488178] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-29T19:45:53.488225] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-29T19:45:53.488480] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-29T19:45:53.488537] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-29T19:45:53.844032] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:45:53.878504] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-29T19:45:53.993595] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-29T19:45:54.502709] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-29T19:45:54.793585] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-29T19:45:55.365267] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-29T19:45:55.593574] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-29T19:45:56.102536] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-29T19:45:56.393708] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-29T19:45:57.126368] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-29T19:45:57.193617] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-29T19:45:57.253030] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-29T19:45:57.762814] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-29T19:45:57.993565] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-29T19:45:58.474953] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-29T19:45:58.793581] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-29T19:45:59.593624] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-29T19:46:00.095619] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-29T19:46:00.393551] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-29T19:46:01.022275] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-29T19:46:01.193551] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-29T19:46:01.813554] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-29T19:46:01.906993] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-29T19:46:01.993610] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-29T19:46:02.743598] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-29T19:46:02.793590] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-29T19:46:03.283963] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-29T19:46:03.593632] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-29T19:46:04.129226] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-29T19:46:04.393624] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-29T19:46:05.193615] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-29T19:46:05.515101] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-29T19:46:05.993632] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-29T19:46:06.485811] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T19:46:06.793571] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-29T19:46:06.964043] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-29T19:46:07.593709] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-29T19:46:08.121687] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-29T19:46:08.393558] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-29T19:46:08.589097] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-29T19:46:08.824559] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-29T19:46:09.193568] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-29T19:46:09.993538] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-29T19:46:10.504304] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-29T19:46:10.541300] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-29T19:46:10.793601] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-29T19:46:11.457987] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-29T19:46:11.593585] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-29T19:46:12.393619] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-29T19:46:13.047901] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-29T19:46:13.059081] [INFO ] [REMOTE ] LYG: Full fetch complete (76278 records). [2025-10-29T19:46:13.059243] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-29T19:46:13.199180] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-29T19:46:13.455106] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-29T19:46:13.455271] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-29T19:46:13.456415] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-29T19:46:13.456499] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-29T19:46:13.458121] [DEBUG] [LOCAL ] LYG: Trimmed 76278 records to 52632 (keeping 200 days of data) [2025-10-29T19:46:13.607280] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-29T19:46:13.831281] [DEBUG] [LOCAL ] LYG: Primary data saved (52632 records). [2025-10-29T19:46:13.831421] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-29T19:46:13.831507] [INFO ] [MAIN ] Update Progress: 1291/2367 symbols completed. LYG took 34.4s. Estimated remaining: 2h 18m 31s. Rate: 7.8 symbols/min [2025-10-29T19:46:14.000456] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-29T19:46:14.038285] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:46:14.097895] [DEBUG] [LOCAL ] M: Loaded 53542 existing records from primary storage. [2025-10-29T19:46:14.098261] [INFO ] [MAIN ] M: Loaded 53542 existing records. [2025-10-29T19:46:14.325192] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:46:14.326570] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-29T19:46:14.332013] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-29T19:46:14.332259] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-29T19:46:14.332124] [INFO ] [REMOTE ] LZM: Full fetch complete (20313 records). [2025-10-29T19:46:14.332449] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-29T19:46:14.364409] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-29T19:46:14.407728] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-29T19:46:14.810939] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-29T19:46:15.077004] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-29T19:46:15.082337] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-29T19:46:15.097618] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-29T19:46:15.097798] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-29T19:46:15.137576] [DEBUG] [LOCAL ] LZM: Trimmed 20313 records to 14888 (keeping 200 days of data) [2025-10-29T19:46:15.140990] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:46:15.234148] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-29T19:46:15.268264] [DEBUG] [LOCAL ] LZM: Primary data saved (14888 records). [2025-10-29T19:46:15.268979] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-29T19:46:15.269567] [INFO ] [MAIN ] Update Progress: 1292/2367 symbols completed. LZM took 22.1s. Estimated remaining: 2h 18m 18s. Rate: 7.8 symbols/min [2025-10-29T19:46:15.440808] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:46:15.488997] [DEBUG] [LOCAL ] MA: Loaded 52412 existing records from primary storage. [2025-10-29T19:46:15.489305] [INFO ] [MAIN ] MA: Loaded 52412 existing records. [2025-10-29T19:46:15.602834] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-29T19:46:15.689910] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:46:15.690111] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-29T19:46:15.690160] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-29T19:46:15.690756] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-29T19:46:15.690814] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-29T19:46:16.106074] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:46:16.187955] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T19:46:16.393564] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-29T19:46:17.083017] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-29T19:46:17.193577] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-29T19:46:17.752806] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T19:46:17.993599] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-29T19:46:18.245324] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T19:46:18.793552] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-29T19:46:19.459880] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-29T19:46:19.593558] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-29T19:46:19.800136] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T19:46:20.393556] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-29T19:46:21.014890] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-29T19:46:21.193584] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-29T19:46:21.666709] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-29T19:46:21.993594] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-29T19:46:22.674218] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-29T19:46:22.793572] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-29T19:46:23.415568] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-29T19:46:23.426562] [INFO ] [REMOTE ] LYV: Full fetch complete (74165 records). [2025-10-29T19:46:23.426782] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-29T19:46:23.599445] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-29T19:46:23.859449] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-29T19:46:23.859541] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-29T19:46:23.860533] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-29T19:46:23.860597] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-29T19:46:23.861992] [DEBUG] [LOCAL ] LYV: Trimmed 74165 records to 50874 (keeping 200 days of data) [2025-10-29T19:46:24.173155] [DEBUG] [LOCAL ] LYV: Primary data saved (50874 records). [2025-10-29T19:46:24.173283] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-29T19:46:24.173358] [INFO ] [MAIN ] Update Progress: 1293/2367 symbols completed. LYV took 34.2s. Estimated remaining: 2h 18m 11s. Rate: 7.8 symbols/min [2025-10-29T19:46:24.356086] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:46:24.415769] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-29T19:46:24.430817] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-29T19:46:24.455834] [DEBUG] [LOCAL ] MAA: Loaded 42852 existing records from primary storage. [2025-10-29T19:46:24.456391] [INFO ] [MAIN ] MAA: Loaded 42852 existing records. [2025-10-29T19:46:24.639573] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:46:24.639813] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-29T19:46:24.639883] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-29T19:46:24.640411] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-29T19:46:24.640470] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-29T19:46:25.018577] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:46:25.047238] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-29T19:46:25.193551] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-29T19:46:25.612854] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T19:46:25.993550] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-29T19:46:26.763251] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-29T19:46:26.793518] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-29T19:46:26.868598] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-29T19:46:27.593553] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-29T19:46:28.258208] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-29T19:46:28.393564] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-29T19:46:28.719220] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T19:46:29.193611] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-29T19:46:29.968134] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-29T19:46:29.993513] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-29T19:46:30.290394] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-29T19:46:30.793567] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-29T19:46:31.593549] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-29T19:46:31.676490] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-29T19:46:32.397005] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-29T19:46:32.405760] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-29T19:46:32.764456] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T19:46:33.193610] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-29T19:46:33.528084] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-29T19:46:33.535639] [INFO ] [REMOTE ] LZB: Full fetch complete (51121 records). [2025-10-29T19:46:33.535873] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-29T19:46:33.919395] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-29T19:46:33.919477] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-29T19:46:33.920283] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-29T19:46:33.920346] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-29T19:46:33.921374] [DEBUG] [LOCAL ] LZB: Trimmed 51121 records to 34644 (keeping 200 days of data) [2025-10-29T19:46:34.007637] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-29T19:46:34.127097] [DEBUG] [LOCAL ] LZB: Primary data saved (34644 records). [2025-10-29T19:46:34.127228] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-29T19:46:34.127303] [INFO ] [MAIN ] Update Progress: 1294/2367 symbols completed. LZB took 42.5s. Estimated remaining: 2h 18m 5s. Rate: 7.8 symbols/min [2025-10-29T19:46:34.298159] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:46:34.298349] [DEBUG] [LOCAL ] MAC: No existing data file found in primary storage. [2025-10-29T19:46:34.298387] [WARN ] [MAIN ] MAC: No existing data found, performing full refresh instead. [2025-10-29T19:46:34.298497] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-29T19:46:34.298536] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-29T19:46:34.298575] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-29T19:46:34.298607] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-29T19:46:34.666802] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:46:34.707438] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-29T19:46:34.793541] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-29T19:46:35.593571] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-29T19:46:35.697671] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-29T19:46:36.042370] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-29T19:46:36.393622] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-29T19:46:36.811719] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-29T19:46:37.193538] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-29T19:46:37.993604] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-29T19:46:38.087070] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-29T19:46:38.286694] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T19:46:38.793596] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-29T19:46:39.448106] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-29T19:46:39.593584] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-29T19:46:40.393588] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-29T19:46:40.680479] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-29T19:46:40.706145] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T19:46:40.714857] [INFO ] [REMOTE ] MA: Full fetch complete (76369 records). [2025-10-29T19:46:40.715259] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-29T19:46:41.108069] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-29T19:46:41.108145] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-29T19:46:41.109141] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-29T19:46:41.109201] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-29T19:46:41.110501] [DEBUG] [LOCAL ] MA: Trimmed 76369 records to 52410 (keeping 200 days of data) [2025-10-29T19:46:41.202414] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-29T19:46:41.438143] [DEBUG] [LOCAL ] MA: Primary data saved (52410 records). [2025-10-29T19:46:41.438268] [INFO ] [MAIN ] MA: Full history saved. [2025-10-29T19:46:41.439172] [INFO ] [MAIN ] Update Progress: 1295/2367 symbols completed. MA took 26.2s. Estimated remaining: 2h 17m 57s. Rate: 7.8 symbols/min [2025-10-29T19:46:41.609597] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:46:41.645748] [DEBUG] [LOCAL ] MAGN: Loaded 35786 existing records from primary storage. [2025-10-29T19:46:41.646019] [INFO ] [MAIN ] MAGN: Loaded 35786 existing records. [2025-10-29T19:46:41.826711] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:46:41.827005] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-29T19:46:41.827145] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-29T19:46:41.827638] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-29T19:46:41.827767] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-29T19:46:41.993547] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-29T19:46:42.056349] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-29T19:46:42.226528] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:46:42.464368] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-29T19:46:42.793582] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-29T19:46:43.296887] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-29T19:46:43.593607] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-29T19:46:43.954796] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-29T19:46:44.393607] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-29T19:46:44.957271] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-29T19:46:45.193558] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-29T19:46:45.666558] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-29T19:46:45.993714] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-29T19:46:46.671280] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-29T19:46:46.793632] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-29T19:46:47.080413] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-29T19:46:47.593575] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-29T19:46:48.144162] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-29T19:46:48.393561] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-29T19:46:48.745339] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-29T19:46:49.193569] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-29T19:46:49.418094] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-29T19:46:49.964524] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-29T19:46:49.993531] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-29T19:46:50.793629] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-29T19:46:51.144483] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:46:51.593603] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-29T19:46:52.153960] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-29T19:46:52.164228] [INFO ] [REMOTE ] MAA: Full fetch complete (62110 records). [2025-10-29T19:46:52.164422] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-29T19:46:52.398714] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-29T19:46:52.577395] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-29T19:46:52.577504] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-29T19:46:52.578408] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-29T19:46:52.578473] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-29T19:46:52.579778] [DEBUG] [LOCAL ] MAA: Trimmed 62110 records to 42867 (keeping 200 days of data) [2025-10-29T19:46:52.866732] [DEBUG] [LOCAL ] MAA: Primary data saved (42867 records). [2025-10-29T19:46:52.867078] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-29T19:46:52.867951] [INFO ] [MAIN ] Update Progress: 1296/2367 symbols completed. MAA took 28.7s. Estimated remaining: 2h 17m 53s. Rate: 7.8 symbols/min [2025-10-29T19:46:53.026316] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-29T19:46:53.104225] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:46:53.146324] [DEBUG] [LOCAL ] MAIN: Loaded 41648 existing records from primary storage. [2025-10-29T19:46:53.146693] [INFO ] [MAIN ] MAIN: Loaded 41648 existing records. [2025-10-29T19:46:53.205362] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-29T19:46:53.345950] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:46:53.346171] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-29T19:46:53.346219] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-29T19:46:53.346684] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-29T19:46:53.346745] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-29T19:46:53.726074] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:46:53.993575] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-29T19:46:54.098667] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-29T19:46:54.217517] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-29T19:46:54.793600] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-29T19:46:55.318503] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-29T19:46:55.593555] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-29T19:46:56.393613] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-29T19:46:56.448342] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-29T19:46:56.460593] [INFO ] [REMOTE ] M: Full fetch complete (77656 records). [2025-10-29T19:46:56.460804] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-29T19:46:56.850275] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-29T19:46:56.850388] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-29T19:46:56.851436] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-29T19:46:56.851580] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-29T19:46:56.852994] [DEBUG] [LOCAL ] M: Trimmed 77656 records to 53542 (keeping 200 days of data) [2025-10-29T19:46:57.163547] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-29T19:46:57.198425] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-29T19:46:57.229122] [DEBUG] [LOCAL ] M: Primary data saved (53542 records). [2025-10-29T19:46:57.229488] [INFO ] [MAIN ] M: Full history saved. [2025-10-29T19:46:57.229592] [INFO ] [MAIN ] Update Progress: 1297/2367 symbols completed. M took 43.4s. Estimated remaining: 2h 17m 42s. Rate: 7.8 symbols/min [2025-10-29T19:46:57.399998] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:46:57.439781] [DEBUG] [LOCAL ] MAN: Loaded 44330 existing records from primary storage. [2025-10-29T19:46:57.440089] [INFO ] [MAIN ] MAN: Loaded 44330 existing records. [2025-10-29T19:46:57.623137] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:46:57.623733] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-29T19:46:57.623803] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-29T19:46:57.632359] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-29T19:46:57.646070] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-29T19:46:57.680369] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-29T19:46:58.002145] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-29T19:46:58.006830] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:46:58.439067] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:46:58.793571] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-29T19:46:59.390865] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-29T19:46:59.593570] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-29T19:46:59.926135] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T19:47:00.393558] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-29T19:47:01.193598] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-29T19:47:01.380923] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-29T19:47:01.391464] [INFO ] [REMOTE ] MAC: Full fetch complete (71494 records). [2025-10-29T19:47:01.391701] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-29T19:47:01.820096] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-29T19:47:01.820203] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-29T19:47:01.821392] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-29T19:47:01.821465] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-29T19:47:01.823249] [DEBUG] [LOCAL ] MAC: Trimmed 71494 records to 49357 (keeping 200 days of data) [2025-10-29T19:47:02.013122] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-29T19:47:02.169404] [DEBUG] [LOCAL ] MAC: Primary data saved (49357 records). [2025-10-29T19:47:02.169777] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-29T19:47:02.171716] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-29T19:47:02.171865] [INFO ] [MAIN ] Update Progress: 1298/2367 symbols completed. MAC took 28.0s. Estimated remaining: 2h 17m 32s. Rate: 7.8 symbols/min [2025-10-29T19:47:02.370489] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:47:02.399398] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-29T19:47:02.433526] [DEBUG] [LOCAL ] MANU: Loaded 26793 existing records from primary storage. [2025-10-29T19:47:02.433890] [INFO ] [MAIN ] MANU: Loaded 26793 existing records. [2025-10-29T19:47:02.658612] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:47:02.658909] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-29T19:47:02.658968] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-29T19:47:02.659317] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-29T19:47:02.659359] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-29T19:47:02.798795] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-29T19:47:03.118505] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:47:03.204376] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-29T19:47:03.593601] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-29T19:47:03.784616] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-29T19:47:04.370054] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-29T19:47:04.393548] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-29T19:47:05.193565] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-29T19:47:05.749924] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-29T19:47:05.993591] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-29T19:47:06.207544] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-29T19:47:06.793600] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-29T19:47:07.404690] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T19:47:07.593563] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-29T19:47:07.866939] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-29T19:47:08.393638] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-29T19:47:08.673809] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T19:47:09.193764] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-29T19:47:09.282852] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-29T19:47:09.993577] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-29T19:47:10.128674] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-29T19:47:10.793582] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-29T19:47:10.908177] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-29T19:47:11.593567] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-29T19:47:12.054046] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-29T19:47:12.393560] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-29T19:47:12.476294] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T19:47:13.193567] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-29T19:47:13.653611] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-29T19:47:13.993562] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-29T19:47:14.510609] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-29T19:47:14.522748] [INFO ] [REMOTE ] MAGN: Full fetch complete (51884 records). [2025-10-29T19:47:14.522971] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-29T19:47:14.798818] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-29T19:47:14.907452] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-29T19:47:14.907541] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-29T19:47:14.908514] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-29T19:47:14.908617] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-29T19:47:14.909838] [DEBUG] [LOCAL ] MAGN: Trimmed 51884 records to 35760 (keeping 200 days of data) [2025-10-29T19:47:15.042235] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-29T19:47:15.142416] [DEBUG] [LOCAL ] MAGN: Primary data saved (35760 records). [2025-10-29T19:47:15.142544] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-29T19:47:15.142628] [INFO ] [MAIN ] Update Progress: 1299/2367 symbols completed. MAGN took 33.7s. Estimated remaining: 2h 17m 29s. Rate: 7.8 symbols/min [2025-10-29T19:47:15.307369] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:47:15.357219] [DEBUG] [LOCAL ] MAS: Loaded 52159 existing records from primary storage. [2025-10-29T19:47:15.357570] [INFO ] [MAIN ] MAS: Loaded 52159 existing records. [2025-10-29T19:47:15.531566] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:47:15.531782] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-29T19:47:15.531830] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-29T19:47:15.532349] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-29T19:47:15.532405] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-29T19:47:15.598837] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-29T19:47:15.879162] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:47:16.130071] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-29T19:47:16.393564] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-29T19:47:16.636827] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-29T19:47:17.193630] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-29T19:47:17.559871] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-29T19:47:17.993571] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-29T19:47:18.549081] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-29T19:47:18.793554] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-29T19:47:19.197697] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T19:47:19.593522] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-29T19:47:19.792559] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-29T19:47:20.393597] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-29T19:47:21.079616] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-29T19:47:21.193550] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-29T19:47:21.559631] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-29T19:47:21.993570] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-29T19:47:22.725569] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T19:47:22.736878] [INFO ] [REMOTE ] MAIN: Full fetch complete (60323 records). [2025-10-29T19:47:22.737109] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-29T19:47:22.804832] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-29T19:47:23.195162] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-29T19:47:23.195327] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-29T19:47:23.197045] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-29T19:47:23.197147] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-29T19:47:23.198991] [DEBUG] [LOCAL ] MAIN: Trimmed 60323 records to 41641 (keeping 200 days of data) [2025-10-29T19:47:23.321435] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-29T19:47:23.497878] [DEBUG] [LOCAL ] MAIN: Primary data saved (41641 records). [2025-10-29T19:47:23.498034] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-29T19:47:23.498132] [INFO ] [MAIN ] Update Progress: 1300/2367 symbols completed. MAIN took 30.6s. Estimated remaining: 2h 17m 21s. Rate: 7.8 symbols/min [2025-10-29T19:47:23.597285] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-29T19:47:23.673299] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:47:23.712937] [DEBUG] [LOCAL ] MATV: Loaded 34396 existing records from primary storage. [2025-10-29T19:47:23.713257] [INFO ] [MAIN ] MATV: Loaded 34396 existing records. [2025-10-29T19:47:23.976094] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:47:23.976577] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-29T19:47:23.976701] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-29T19:47:23.982798] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-29T19:47:23.993859] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-29T19:47:23.995036] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-29T19:47:24.396209] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-29T19:47:24.396091] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:47:25.189509] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-29T19:47:25.199745] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-29T19:47:25.617061] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T19:47:25.987723] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-29T19:47:25.993516] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-29T19:47:26.793562] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-29T19:47:26.950899] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-29T19:47:27.593577] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-29T19:47:27.972916] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-29T19:47:28.393557] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-29T19:47:29.028352] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-29T19:47:29.039085] [INFO ] [REMOTE ] MAN: Full fetch complete (63083 records). [2025-10-29T19:47:29.039242] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-29T19:47:29.196181] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-29T19:47:29.504100] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-29T19:47:29.505955] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-29T19:47:29.504774] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-29T19:47:29.513557] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-29T19:47:29.514184] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-29T19:47:29.515624] [DEBUG] [LOCAL ] MAN: Trimmed 63083 records to 44346 (keeping 200 days of data) [2025-10-29T19:47:29.767630] [DEBUG] [LOCAL ] MAN: Primary data saved (44346 records). [2025-10-29T19:47:29.767791] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-29T19:47:29.767869] [INFO ] [MAIN ] Update Progress: 1301/2367 symbols completed. MAN took 32.5s. Estimated remaining: 2h 17m 12s. Rate: 7.8 symbols/min [2025-10-29T19:47:29.940748] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:47:29.973937] [DEBUG] [LOCAL ] MATX: Loaded 31448 existing records from primary storage. [2025-10-29T19:47:29.974243] [INFO ] [MAIN ] MATX: Loaded 31448 existing records. [2025-10-29T19:47:30.006339] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-29T19:47:30.167926] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:47:30.168131] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-29T19:47:30.168179] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-29T19:47:30.168593] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-29T19:47:30.168688] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-29T19:47:30.547314] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:47:30.793603] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-29T19:47:30.892890] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-29T19:47:31.403805] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-29T19:47:31.593572] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-29T19:47:31.834035] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-29T19:47:32.393636] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-29T19:47:32.872471] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T19:47:33.193613] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-29T19:47:33.450516] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T19:47:33.993637] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-29T19:47:34.029384] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-29T19:47:34.793533] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-29T19:47:34.902015] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-29T19:47:35.593565] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-29T19:47:35.689496] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-29T19:47:36.393560] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-29T19:47:36.683438] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-29T19:47:37.193569] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-29T19:47:37.494262] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-29T19:47:37.993560] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-29T19:47:38.201709] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T19:47:38.209180] [INFO ] [REMOTE ] MANU: Full fetch complete (39438 records). [2025-10-29T19:47:38.209336] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-29T19:47:38.602541] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-29T19:47:38.602621] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-29T19:47:38.603358] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-29T19:47:38.603411] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-29T19:47:38.604331] [DEBUG] [LOCAL ] MANU: Trimmed 39438 records to 26758 (keeping 200 days of data) [2025-10-29T19:47:38.766115] [DEBUG] [LOCAL ] MANU: Primary data saved (26758 records). [2025-10-29T19:47:38.766265] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-29T19:47:38.766392] [INFO ] [MAIN ] Update Progress: 1302/2367 symbols completed. MANU took 36.6s. Estimated remaining: 2h 17m 6s. Rate: 7.8 symbols/min [2025-10-29T19:47:38.798754] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-29T19:47:38.941523] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:47:38.970157] [DEBUG] [LOCAL ] MAX: Loaded 30439 existing records from primary storage. [2025-10-29T19:47:38.970463] [INFO ] [MAIN ] MAX: Loaded 30439 existing records. [2025-10-29T19:47:39.159085] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:47:39.159394] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-29T19:47:39.159470] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-29T19:47:39.160022] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-29T19:47:39.160123] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-29T19:47:39.288118] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-29T19:47:39.559114] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:47:39.593549] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-29T19:47:40.179740] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-29T19:47:40.393595] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-29T19:47:40.487595] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-29T19:47:41.193577] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-29T19:47:41.692882] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-29T19:47:41.993540] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-29T19:47:42.101104] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-29T19:47:42.793580] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-29T19:47:43.258521] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-29T19:47:43.593612] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-29T19:47:43.862875] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-29T19:47:44.197522] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-29T19:47:44.209279] [INFO ] [REMOTE ] MAS: Full fetch complete (75447 records). [2025-10-29T19:47:44.209485] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-29T19:47:44.396350] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-29T19:47:44.615322] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-29T19:47:44.615422] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-29T19:47:44.616535] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-29T19:47:44.616605] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-29T19:47:44.618138] [DEBUG] [LOCAL ] MAS: Trimmed 75447 records to 52160 (keeping 200 days of data) [2025-10-29T19:47:44.930958] [DEBUG] [LOCAL ] MAS: Primary data saved (52160 records). [2025-10-29T19:47:44.931094] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-29T19:47:44.931172] [INFO ] [MAIN ] Update Progress: 1303/2367 symbols completed. MAS took 29.8s. Estimated remaining: 2h 16m 57s. Rate: 7.8 symbols/min [2025-10-29T19:47:45.113221] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:47:45.156088] [DEBUG] [LOCAL ] MBC: Loaded 43688 existing records from primary storage. [2025-10-29T19:47:45.156399] [INFO ] [MAIN ] MBC: Loaded 43688 existing records. [2025-10-29T19:47:45.198784] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-29T19:47:45.347517] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:47:45.347886] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-29T19:47:45.347961] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-29T19:47:45.348533] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-29T19:47:45.348677] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-29T19:47:45.470858] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T19:47:45.739244] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:47:45.993565] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-29T19:47:46.409625] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-29T19:47:46.793560] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-29T19:47:47.120937] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-29T19:47:47.593556] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-29T19:47:47.706035] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-29T19:47:48.393601] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-29T19:47:48.660244] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-29T19:47:49.193576] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-29T19:47:49.217081] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-29T19:47:49.993693] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-29T19:47:50.202593] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T19:47:50.209378] [INFO ] [REMOTE ] MATV: Full fetch complete (51854 records). [2025-10-29T19:47:50.209545] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-29T19:47:50.613147] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-29T19:47:50.613236] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-29T19:47:50.614075] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-29T19:47:50.614139] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-29T19:47:50.615257] [DEBUG] [LOCAL ] MATV: Trimmed 51854 records to 34313 (keeping 200 days of data) [2025-10-29T19:47:50.794021] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-29T19:47:50.818308] [DEBUG] [LOCAL ] MATV: Primary data saved (34313 records). [2025-10-29T19:47:50.819331] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-29T19:47:50.819421] [INFO ] [MAIN ] Update Progress: 1304/2367 symbols completed. MATV took 27.3s. Estimated remaining: 2h 16m 48s. Rate: 7.8 symbols/min [2025-10-29T19:47:50.993003] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:47:51.015569] [DEBUG] [LOCAL ] MBI: Loaded 23464 existing records from primary storage. [2025-10-29T19:47:51.015858] [INFO ] [MAIN ] MBI: Loaded 23464 existing records. [2025-10-29T19:47:51.193806] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:47:51.194135] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-29T19:47:51.194239] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-29T19:47:51.194620] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-29T19:47:51.194715] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-29T19:47:51.385918] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-29T19:47:51.607081] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-29T19:47:51.612431] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:47:52.055845] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-29T19:47:52.393535] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-29T19:47:52.542375] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-29T19:47:53.193602] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-29T19:47:53.324745] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-29T19:47:53.966860] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-29T19:47:53.993520] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-29T19:47:54.740234] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-29T19:47:54.793516] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-29T19:47:55.593541] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-29T19:47:55.626111] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-29T19:47:56.393548] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-29T19:47:56.790123] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-29T19:47:57.193556] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-29T19:47:57.507176] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-29T19:47:57.993608] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-29T19:47:58.477686] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-29T19:47:58.793583] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-29T19:47:58.920070] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T19:47:59.504403] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-29T19:47:59.593587] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-29T19:48:00.267312] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-29T19:48:00.393568] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-29T19:48:01.193635] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-29T19:48:01.354408] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-29T19:48:01.993537] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-29T19:48:02.167478] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-29T19:48:02.793597] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-29T19:48:03.046880] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-29T19:48:03.474731] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-29T19:48:03.593580] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-29T19:48:04.393581] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-29T19:48:04.585486] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-29T19:48:05.193688] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-29T19:48:05.422254] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-29T19:48:05.993533] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-29T19:48:06.201108] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-29T19:48:06.753997] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-29T19:48:06.793524] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-29T19:48:07.593551] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-29T19:48:07.904292] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-29T19:48:08.393567] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-29T19:48:08.540489] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-29T19:48:08.545613] [INFO ] [REMOTE ] MBI: Full fetch complete (35389 records). [2025-10-29T19:48:08.545823] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-29T19:48:08.938798] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-29T19:48:08.938891] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-29T19:48:08.939586] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-29T19:48:08.939627] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-29T19:48:08.940484] [DEBUG] [LOCAL ] MBI: Trimmed 35389 records to 23394 (keeping 200 days of data) [2025-10-29T19:48:09.069588] [DEBUG] [LOCAL ] MBI: Primary data saved (23394 records). [2025-10-29T19:48:09.069768] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-29T19:48:09.069858] [INFO ] [MAIN ] Update Progress: 1305/2367 symbols completed. MBI took 18.3s. Estimated remaining: 2h 16m 48s. Rate: 7.8 symbols/min [2025-10-29T19:48:09.194887] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-29T19:48:09.242574] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:48:09.283913] [DEBUG] [LOCAL ] MC: Loaded 43337 existing records from primary storage. [2025-10-29T19:48:09.284230] [INFO ] [MAIN ] MC: Loaded 43337 existing records. [2025-10-29T19:48:09.476926] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:48:09.477244] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-29T19:48:09.477326] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-29T19:48:09.477887] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-29T19:48:09.477966] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-29T19:48:09.575551] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-29T19:48:09.886583] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:48:09.993549] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-29T19:48:10.350705] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-29T19:48:10.357988] [INFO ] [REMOTE ] MAX: Full fetch complete (45028 records). [2025-10-29T19:48:10.358152] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-29T19:48:10.730037] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-29T19:48:10.730126] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-29T19:48:10.730916] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-29T19:48:10.730978] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-29T19:48:10.732038] [DEBUG] [LOCAL ] MAX: Trimmed 45028 records to 30447 (keeping 200 days of data) [2025-10-29T19:48:10.813245] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-29T19:48:10.937965] [DEBUG] [LOCAL ] MAX: Primary data saved (30447 records). [2025-10-29T19:48:10.938232] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-29T19:48:10.938462] [INFO ] [MAIN ] Update Progress: 1306/2367 symbols completed. MAX took 32.2s. Estimated remaining: 2h 16m 36s. Rate: 7.8 symbols/min [2025-10-29T19:48:11.128871] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:48:11.154389] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-29T19:48:11.173753] [DEBUG] [LOCAL ] MCB: Loaded 11282 existing records from primary storage. [2025-10-29T19:48:11.174071] [INFO ] [MAIN ] MCB: Loaded 11282 existing records. [2025-10-29T19:48:11.362210] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:48:11.362528] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-29T19:48:11.362582] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-29T19:48:11.362871] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-29T19:48:11.362930] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-29T19:48:11.598745] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-29T19:48:11.763841] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:48:11.865125] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-29T19:48:12.393565] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-29T19:48:12.846867] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-29T19:48:13.193562] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-29T19:48:13.437553] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-29T19:48:13.993557] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-29T19:48:14.207275] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-29T19:48:14.214517] [INFO ] [REMOTE ] MATX: Full fetch complete (44132 records). [2025-10-29T19:48:14.214688] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-29T19:48:14.627483] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-29T19:48:14.627857] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-29T19:48:14.627956] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-29T19:48:14.631913] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-29T19:48:14.631977] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-29T19:48:14.632845] [DEBUG] [LOCAL ] MATX: Trimmed 44132 records to 31332 (keeping 200 days of data) [2025-10-29T19:48:14.809046] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-29T19:48:14.830876] [DEBUG] [LOCAL ] MATX: Primary data saved (31332 records). [2025-10-29T19:48:14.831011] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-29T19:48:14.831108] [INFO ] [MAIN ] Update Progress: 1307/2367 symbols completed. MATX took 45.1s. Estimated remaining: 2h 16m 25s. Rate: 7.8 symbols/min [2025-10-29T19:48:15.015491] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:48:15.015749] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-29T19:48:15.015805] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-29T19:48:15.015919] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-29T19:48:15.015962] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-29T19:48:15.016002] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-29T19:48:15.016035] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-29T19:48:15.399774] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:48:15.479252] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-29T19:48:15.593575] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-29T19:48:16.262062] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-29T19:48:16.393533] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-29T19:48:17.046081] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-29T19:48:17.193569] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-29T19:48:17.993553] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-29T19:48:18.793535] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-29T19:48:18.878776] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-29T19:48:19.047093] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-29T19:48:19.215920] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-29T19:48:19.593568] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-29T19:48:20.393548] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-29T19:48:21.198684] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-29T19:48:21.219404] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-29T19:48:21.611111] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-29T19:48:21.993575] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-29T19:48:22.623206] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-29T19:48:22.793551] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-29T19:48:23.598750] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-29T19:48:23.629101] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-29T19:48:23.946392] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-29T19:48:24.393553] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-29T19:48:24.927699] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:48:24.937716] [INFO ] [REMOTE ] MBC: Full fetch complete (63073 records). [2025-10-29T19:48:24.937843] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-29T19:48:25.198717] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-29T19:48:25.359624] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-29T19:48:25.359736] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-29T19:48:25.360633] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-29T19:48:25.360709] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-29T19:48:25.361935] [DEBUG] [LOCAL ] MBC: Trimmed 63073 records to 43666 (keeping 200 days of data) [2025-10-29T19:48:25.608403] [DEBUG] [LOCAL ] MBC: Primary data saved (43666 records). [2025-10-29T19:48:25.608518] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-29T19:48:25.608590] [INFO ] [MAIN ] Update Progress: 1308/2367 symbols completed. MBC took 40.7s. Estimated remaining: 2h 16m 20s. Rate: 7.8 symbols/min [2025-10-29T19:48:25.774428] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:48:25.783082] [DEBUG] [LOCAL ] MCI: Loaded 6116 existing records from primary storage. [2025-10-29T19:48:25.783278] [INFO ] [MAIN ] MCI: Loaded 6116 existing records. [2025-10-29T19:48:25.961280] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:48:25.961453] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-29T19:48:25.961542] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-29T19:48:25.961712] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-29T19:48:25.961767] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-29T19:48:25.994302] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-29T19:48:26.321590] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-29T19:48:26.433231] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:48:26.457799] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-29T19:48:26.595171] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-29T19:48:26.793589] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-29T19:48:27.317877] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-29T19:48:27.593568] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-29T19:48:28.141804] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-29T19:48:28.393560] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-29T19:48:29.193549] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-29T19:48:29.650798] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-29T19:48:29.993575] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-29T19:48:30.357824] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-29T19:48:30.600058] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-29T19:48:30.793572] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-29T19:48:31.280199] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-29T19:48:31.593617] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-29T19:48:32.393753] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-29T19:48:32.739051] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-29T19:48:32.990877] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-29T19:48:33.193553] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-29T19:48:33.993622] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-29T19:48:34.382289] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-29T19:48:34.793588] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-29T19:48:35.098445] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-29T19:48:35.593589] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-29T19:48:35.994811] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-29T19:48:36.181996] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-29T19:48:36.185850] [INFO ] [REMOTE ] MCB: Full fetch complete (16979 records). [2025-10-29T19:48:36.185941] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-29T19:48:36.398637] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-29T19:48:36.568025] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-29T19:48:36.568112] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-29T19:48:36.568536] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-29T19:48:36.568577] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-29T19:48:36.569105] [DEBUG] [LOCAL ] MCB: Trimmed 16979 records to 11315 (keeping 200 days of data) [2025-10-29T19:48:36.637867] [DEBUG] [LOCAL ] MCB: Primary data saved (11315 records). [2025-10-29T19:48:36.638034] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-29T19:48:36.638120] [INFO ] [MAIN ] Update Progress: 1309/2367 symbols completed. MCB took 25.7s. Estimated remaining: 2h 16m 15s. Rate: 7.8 symbols/min [2025-10-29T19:48:36.803169] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:48:36.837779] [DEBUG] [LOCAL ] MCK: Loaded 37402 existing records from primary storage. [2025-10-29T19:48:36.838058] [INFO ] [MAIN ] MCK: Loaded 37402 existing records. [2025-10-29T19:48:37.011926] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:48:37.012189] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-29T19:48:37.012237] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-29T19:48:37.012722] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-29T19:48:37.012784] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-29T19:48:37.198809] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-29T19:48:37.365174] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:48:37.824128] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-29T19:48:37.993549] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-29T19:48:38.121881] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-29T19:48:38.793589] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-29T19:48:39.015303] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-29T19:48:39.593545] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-29T19:48:40.393601] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-29T19:48:40.493001] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-29T19:48:41.006074] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-29T19:48:41.014986] [INFO ] [REMOTE ] MC: Full fetch complete (63198 records). [2025-10-29T19:48:41.015128] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-29T19:48:41.203444] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-29T19:48:41.434887] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-29T19:48:41.434966] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-29T19:48:41.435895] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-29T19:48:41.435957] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-29T19:48:41.437103] [DEBUG] [LOCAL ] MC: Trimmed 63198 records to 43332 (keeping 200 days of data) [2025-10-29T19:48:41.701528] [DEBUG] [LOCAL ] MC: Primary data saved (43332 records). [2025-10-29T19:48:41.701916] [INFO ] [MAIN ] MC: Full history saved. [2025-10-29T19:48:41.702004] [INFO ] [MAIN ] Update Progress: 1310/2367 symbols completed. MC took 32.6s. Estimated remaining: 2h 16m 5s. Rate: 7.8 symbols/min [2025-10-29T19:48:41.881872] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-29T19:48:41.922150] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:48:41.931628] [DEBUG] [LOCAL ] MCN: Loaded 7839 existing records from primary storage. [2025-10-29T19:48:41.931842] [INFO ] [MAIN ] MCN: Loaded 7839 existing records. [2025-10-29T19:48:41.998805] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-29T19:48:42.117353] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:48:42.117621] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-29T19:48:42.117702] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-29T19:48:42.118239] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-29T19:48:42.118298] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-29T19:48:42.491432] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:48:42.492537] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-29T19:48:42.702858] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-29T19:48:42.793600] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-29T19:48:43.593609] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-29T19:48:43.879441] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-29T19:48:43.904761] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-29T19:48:44.393577] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-29T19:48:45.019158] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-29T19:48:45.193584] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-29T19:48:45.593824] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-29T19:48:45.993553] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-29T19:48:46.793565] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-29T19:48:47.334128] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-29T19:48:47.539349] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-29T19:48:47.551914] [INFO ] [REMOTE ] MCD: Full fetch complete (77113 records). [2025-10-29T19:48:47.552115] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-29T19:48:47.598861] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-29T19:48:47.766104] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-29T19:48:47.767075] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-29T19:48:47.767157] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-29T19:48:47.767224] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-29T19:48:47.767323] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-29T19:48:47.767370] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-29T19:48:47.767471] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-29T19:48:47.767573] [INFO ] [MAIN ] Update Progress: 1311/2367 symbols completed. MCD took 32.9s. Estimated remaining: 2h 15m 56s. Rate: 7.8 symbols/min [2025-10-29T19:48:47.961448] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:48:48.015200] [DEBUG] [LOCAL ] MCO: Loaded 39204 existing records from primary storage. [2025-10-29T19:48:48.015762] [INFO ] [MAIN ] MCO: Loaded 39204 existing records. [2025-10-29T19:48:48.241134] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:48:48.241568] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-29T19:48:48.241673] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-29T19:48:48.242837] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-29T19:48:48.242919] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-29T19:48:48.398907] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-29T19:48:48.844313] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:48:48.928023] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-29T19:48:48.944038] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T19:48:49.193556] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-29T19:48:49.993581] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-29T19:48:50.589497] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-29T19:48:50.793608] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-29T19:48:51.198554] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-29T19:48:51.266269] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-29T19:48:51.593584] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-29T19:48:52.127946] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-29T19:48:52.129829] [INFO ] [REMOTE ] MCI: Full fetch complete (9750 records). [2025-10-29T19:48:52.129905] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-29T19:48:52.398801] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-29T19:48:52.491550] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-29T19:48:52.491626] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-29T19:48:52.491913] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-29T19:48:52.491963] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-29T19:48:52.492381] [DEBUG] [LOCAL ] MCI: Trimmed 9750 records to 6090 (keeping 200 days of data) [2025-10-29T19:48:52.528484] [DEBUG] [LOCAL ] MCI: Primary data saved (6090 records). [2025-10-29T19:48:52.528594] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-29T19:48:52.528690] [INFO ] [MAIN ] Update Progress: 1312/2367 symbols completed. MCI took 26.9s. Estimated remaining: 2h 15m 46s. Rate: 7.8 symbols/min [2025-10-29T19:48:52.696595] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:48:52.707032] [DEBUG] [LOCAL ] MCR: Loaded 8864 existing records from primary storage. [2025-10-29T19:48:52.707239] [INFO ] [MAIN ] MCR: Loaded 8864 existing records. [2025-10-29T19:48:52.888626] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:48:52.888917] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-29T19:48:52.888975] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-29T19:48:52.889212] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-29T19:48:52.889271] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-29T19:48:53.198723] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-29T19:48:53.259618] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:48:53.532016] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-29T19:48:53.726612] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-29T19:48:53.993566] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-29T19:48:54.793553] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-29T19:48:55.117565] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-29T19:48:55.593537] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-29T19:48:55.661891] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-29T19:48:56.393548] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-29T19:48:56.754181] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-29T19:48:56.950601] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-29T19:48:57.193604] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-29T19:48:57.993568] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-29T19:48:58.532926] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-29T19:48:58.642854] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-29T19:48:58.793562] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-29T19:48:59.593555] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-29T19:49:00.118237] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-29T19:49:00.177171] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-29T19:49:00.393521] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-29T19:49:01.193610] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-29T19:49:01.810730] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-29T19:49:01.993563] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-29T19:49:02.570262] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-29T19:49:02.793795] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-29T19:49:02.831193] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-29T19:49:03.374686] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-29T19:49:03.593596] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-29T19:49:04.158559] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-29T19:49:04.393565] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-29T19:49:04.907050] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-29T19:49:05.193579] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-29T19:49:05.993621] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-29T19:49:06.488772] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-29T19:49:06.520139] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-29T19:49:06.527269] [INFO ] [REMOTE ] MCK: Full fetch complete (56301 records). [2025-10-29T19:49:06.527401] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-29T19:49:06.798740] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-29T19:49:06.908826] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-29T19:49:06.908901] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-29T19:49:06.909760] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-29T19:49:06.909823] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-29T19:49:06.910923] [DEBUG] [LOCAL ] MCK: Trimmed 56301 records to 37281 (keeping 200 days of data) [2025-10-29T19:49:07.135662] [DEBUG] [LOCAL ] MCK: Primary data saved (37281 records). [2025-10-29T19:49:07.135810] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-29T19:49:07.135893] [INFO ] [MAIN ] Update Progress: 1313/2367 symbols completed. MCK took 30.5s. Estimated remaining: 2h 15m 44s. Rate: 7.8 symbols/min [2025-10-29T19:49:07.301257] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:49:07.321515] [DEBUG] [LOCAL ] MCS: Loaded 21032 existing records from primary storage. [2025-10-29T19:49:07.321764] [INFO ] [MAIN ] MCS: Loaded 21032 existing records. [2025-10-29T19:49:07.498538] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:49:07.498778] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-29T19:49:07.498829] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-29T19:49:07.499134] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-29T19:49:07.499191] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-29T19:49:07.597418] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-29T19:49:07.847814] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:49:08.037995] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:49:08.160806] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-29T19:49:08.393595] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-29T19:49:09.103684] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-29T19:49:09.193589] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-29T19:49:09.993546] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-29T19:49:10.019806] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T19:49:10.793548] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-29T19:49:11.074905] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-29T19:49:11.593530] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-29T19:49:11.772877] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-29T19:49:12.393564] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-29T19:49:12.817542] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T19:49:12.921523] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T19:49:13.193554] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-29T19:49:13.662060] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-29T19:49:13.993554] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-29T19:49:14.435674] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-29T19:49:14.793559] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-29T19:49:15.370283] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-29T19:49:15.372606] [INFO ] [REMOTE ] MCN: Full fetch complete (11515 records). [2025-10-29T19:49:15.372734] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-29T19:49:15.598732] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-29T19:49:15.798626] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-29T19:49:15.798740] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-29T19:49:15.799048] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-29T19:49:15.799109] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-29T19:49:15.799549] [DEBUG] [LOCAL ] MCN: Trimmed 11515 records to 7808 (keeping 200 days of data) [2025-10-29T19:49:15.849007] [DEBUG] [LOCAL ] MCN: Primary data saved (7808 records). [2025-10-29T19:49:15.849164] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-29T19:49:15.849272] [INFO ] [MAIN ] Update Progress: 1314/2367 symbols completed. MCN took 34.1s. Estimated remaining: 2h 15m 37s. Rate: 7.8 symbols/min [2025-10-29T19:49:16.058696] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:49:16.082192] [DEBUG] [LOCAL ] MCY: Loaded 22925 existing records from primary storage. [2025-10-29T19:49:16.082456] [INFO ] [MAIN ] MCY: Loaded 22925 existing records. [2025-10-29T19:49:16.308542] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:49:16.309430] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-29T19:49:16.312673] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-29T19:49:16.312973] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-29T19:49:16.313322] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-29T19:49:16.313376] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-29T19:49:16.398682] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-29T19:49:16.671797] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:49:16.872080] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-29T19:49:17.193556] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-29T19:49:17.993561] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-29T19:49:18.519520] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-29T19:49:18.793609] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-29T19:49:19.211020] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-29T19:49:19.449959] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-29T19:49:19.453058] [INFO ] [REMOTE ] MCR: Full fetch complete (13316 records). [2025-10-29T19:49:19.453142] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-29T19:49:19.598770] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-29T19:49:19.824092] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-29T19:49:19.824170] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-29T19:49:19.824475] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-29T19:49:19.824518] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-29T19:49:19.825002] [DEBUG] [LOCAL ] MCR: Trimmed 13316 records to 8871 (keeping 200 days of data) [2025-10-29T19:49:19.874413] [DEBUG] [LOCAL ] MCR: Primary data saved (8871 records). [2025-10-29T19:49:19.874528] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-29T19:49:19.874609] [INFO ] [MAIN ] Update Progress: 1315/2367 symbols completed. MCR took 27.3s. Estimated remaining: 2h 15m 26s. Rate: 7.8 symbols/min [2025-10-29T19:49:20.051590] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:49:20.089218] [DEBUG] [LOCAL ] MD: Loaded 38397 existing records from primary storage. [2025-10-29T19:49:20.089494] [INFO ] [MAIN ] MD: Loaded 38397 existing records. [2025-10-29T19:49:20.272174] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:49:20.272428] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-29T19:49:20.272489] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-29T19:49:20.272938] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-29T19:49:20.273012] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-29T19:49:20.398726] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-29T19:49:20.637187] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:49:20.961063] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-29T19:49:21.193589] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-29T19:49:21.279049] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-29T19:49:21.993572] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-29T19:49:22.388349] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-29T19:49:22.793612] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-29T19:49:23.488202] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-29T19:49:23.510407] [INFO ] [REMOTE ] MCO: Full fetch complete (58452 records). [2025-10-29T19:49:23.511179] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-29T19:49:23.511584] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-29T19:49:23.600731] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-29T19:49:23.902252] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-29T19:49:23.902364] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-29T19:49:23.903306] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-29T19:49:23.903372] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-29T19:49:23.904621] [DEBUG] [LOCAL ] MCO: Trimmed 58452 records to 39195 (keeping 200 days of data) [2025-10-29T19:49:24.144213] [DEBUG] [LOCAL ] MCO: Primary data saved (39195 records). [2025-10-29T19:49:24.144345] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-29T19:49:24.144420] [INFO ] [MAIN ] Update Progress: 1316/2367 symbols completed. MCO took 36.4s. Estimated remaining: 2h 15m 15s. Rate: 7.8 symbols/min [2025-10-29T19:49:24.334786] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:49:24.342664] [DEBUG] [LOCAL ] MDST: Loaded 6210 existing records from primary storage. [2025-10-29T19:49:24.342852] [INFO ] [MAIN ] MDST: Loaded 6210 existing records. [2025-10-29T19:49:24.405239] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-29T19:49:24.521215] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:49:24.521440] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-29T19:49:24.521488] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-29T19:49:24.521696] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-29T19:49:24.521755] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-29T19:49:24.914493] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:49:24.937409] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-29T19:49:25.193554] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-29T19:49:25.207571] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-29T19:49:25.993615] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-29T19:49:26.308150] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-29T19:49:26.793588] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-29T19:49:26.966778] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-29T19:49:27.234827] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T19:49:27.593563] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-29T19:49:28.393611] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-29T19:49:28.412014] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-29T19:49:29.193590] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-29T19:49:29.364206] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-29T19:49:29.993560] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-29T19:49:30.339513] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-29T19:49:30.793557] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-29T19:49:30.970882] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-29T19:49:31.593569] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-29T19:49:31.930632] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-29T19:49:32.393525] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-29T19:49:32.569953] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-29T19:49:32.884153] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-29T19:49:33.193559] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-29T19:49:33.993595] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-29T19:49:34.096346] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-29T19:49:34.432188] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-29T19:49:34.793588] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-29T19:49:35.547141] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-29T19:49:35.593527] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-29T19:49:36.393613] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-29T19:49:36.641213] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-29T19:49:36.646393] [INFO ] [REMOTE ] MCS: Full fetch complete (30735 records). [2025-10-29T19:49:36.646467] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-29T19:49:37.003781] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-29T19:49:37.003869] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-29T19:49:37.004550] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-29T19:49:37.004597] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-29T19:49:37.005447] [DEBUG] [LOCAL ] MCS: Trimmed 30735 records to 21084 (keeping 200 days of data) [2025-10-29T19:49:37.145173] [DEBUG] [LOCAL ] MCS: Primary data saved (21084 records). [2025-10-29T19:49:37.146525] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-29T19:49:37.145819] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-29T19:49:37.152180] [INFO ] [MAIN ] Update Progress: 1317/2367 symbols completed. MCS took 30.0s. Estimated remaining: 2h 15m 12s. Rate: 7.8 symbols/min [2025-10-29T19:49:37.193523] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-29T19:49:37.622678] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-29T19:49:37.993535] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-29T19:49:38.793527] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-29T19:49:38.899360] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-29T19:49:39.593606] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-29T19:49:40.032726] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-29T19:49:40.354022] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-29T19:49:40.393597] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-29T19:49:40.771264] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-29T19:49:41.193636] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-29T19:49:41.993576] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-29T19:49:42.230674] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-29T19:49:42.370219] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-29T19:49:42.793595] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-29T19:49:43.320573] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-29T19:49:43.593570] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-29T19:49:44.393564] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-29T19:49:44.551743] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-29T19:49:44.556682] [INFO ] [REMOTE ] MCY: Full fetch complete (39928 records). [2025-10-29T19:49:44.556844] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-29T19:49:44.896095] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-29T19:49:44.979853] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-29T19:49:44.979956] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-29T19:49:44.981253] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-29T19:49:44.981328] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-29T19:49:44.982411] [DEBUG] [LOCAL ] MCY: Trimmed 39928 records to 22870 (keeping 200 days of data) [2025-10-29T19:49:45.121057] [DEBUG] [LOCAL ] MCY: Primary data saved (22870 records). [2025-10-29T19:49:45.121178] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-29T19:49:45.121251] [INFO ] [MAIN ] Update Progress: 1318/2367 symbols completed. MCY took 29.3s. Estimated remaining: 2h 15m 4s. Rate: 7.8 symbols/min [2025-10-29T19:49:45.193617] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-29T19:49:45.677063] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-29T19:49:45.993568] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-29T19:49:46.769464] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-29T19:49:46.771815] [INFO ] [REMOTE ] MDST: Full fetch complete (8955 records). [2025-10-29T19:49:46.771885] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-29T19:49:46.804049] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-29T19:49:47.139936] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-29T19:49:47.140019] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-29T19:49:47.140366] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-29T19:49:47.140405] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-29T19:49:47.140874] [DEBUG] [LOCAL ] MDST: Trimmed 8955 records to 6233 (keeping 200 days of data) [2025-10-29T19:49:47.177889] [DEBUG] [LOCAL ] MDST: Primary data saved (6233 records). [2025-10-29T19:49:47.178001] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-29T19:49:47.178076] [INFO ] [MAIN ] Update Progress: 1319/2367 symbols completed. MDST took 23.0s. Estimated remaining: 2h 14m 52s. Rate: 7.8 symbols/min [2025-10-29T19:49:47.911980] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-29T19:49:47.920217] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-29T19:49:49.190825] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-29T19:49:49.200340] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-29T19:49:50.341859] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-29T19:49:50.349895] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-29T19:49:51.639377] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-29T19:49:51.647742] [INFO ] [REMOTE ] MD: Full fetch complete (55401 records). [2025-10-29T19:49:51.647859] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-29T19:49:52.041662] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-29T19:49:52.041763] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-29T19:49:52.042614] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-29T19:49:52.042684] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-29T19:49:52.043761] [DEBUG] [LOCAL ] MD: Trimmed 55401 records to 38404 (keeping 200 days of data) [2025-10-29T19:49:52.258517] [DEBUG] [LOCAL ] MD: Primary data saved (38404 records). [2025-10-29T19:49:52.258675] [INFO ] [MAIN ] MD: Full history saved. [2025-10-29T19:49:52.258770] [INFO ] [MAIN ] Update Progress: 1320/2367 symbols completed. MD took 32.4s. Estimated remaining: 2h 14m 42s. Rate: 7.8 symbols/min [2025-10-29T19:49:52.999961] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:49:52.995342] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:49:53.030142] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:49:53.034052] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:49:53.052690] [DEBUG] [LOCAL ] MDV: Loaded 8222 existing records from primary storage. [2025-10-29T19:49:53.053131] [INFO ] [MAIN ] MDV: Loaded 8222 existing records. [2025-10-29T19:49:53.158980] [DEBUG] [LOCAL ] MEC: Loaded 16939 existing records from primary storage. [2025-10-29T19:49:53.199137] [INFO ] [MAIN ] MEC: Loaded 16939 existing records. [2025-10-29T19:49:53.321630] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-29T19:49:53.360285] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-29T19:49:53.444125] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:49:53.518090] [DEBUG] [LOCAL ] MDU: Loaded 47933 existing records from primary storage. [2025-10-29T19:49:53.566125] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-29T19:49:53.571742] [INFO ] [MAIN ] MDU: Loaded 47933 existing records. [2025-10-29T19:49:53.647309] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-29T19:49:53.651194] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:49:53.683261] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-29T19:49:53.698271] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-29T19:49:53.740925] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-29T19:49:53.717862] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-29T19:49:53.799815] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-29T19:49:53.817219] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-29T19:49:53.911886] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:49:54.025973] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-29T19:49:54.111741] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-29T19:49:54.209959] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-29T19:49:54.231227] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:49:54.236015] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-29T19:49:54.236227] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-29T19:49:54.263151] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-29T19:49:54.353318] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-29T19:49:54.457104] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-29T19:49:55.200449] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:49:55.292141] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-29T19:49:55.290901] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:49:55.379182] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-29T19:49:55.530998] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:49:55.541805] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-29T19:49:55.604240] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:49:55.604805] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-29T19:49:55.882070] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-29T19:49:55.884051] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-29T19:49:55.994038] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-29T19:49:55.997281] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-29T19:49:56.276612] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-29T19:49:56.278528] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-29T19:49:56.550933] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-29T19:49:56.553795] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-29T19:49:56.876917] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-29T19:49:56.886710] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-29T19:49:57.033818] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-29T19:49:57.174068] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-29T19:49:57.193534] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-29T19:49:57.265933] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-29T19:49:57.993579] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-29T19:49:58.118620] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-29T19:49:58.582219] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-29T19:49:58.665445] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-29T19:49:58.793533] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-29T19:49:59.593587] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-29T19:50:00.320505] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-29T19:50:00.393521] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-29T19:50:01.193526] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-29T19:50:01.373234] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-29T19:50:01.636481] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-29T19:50:01.993562] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-29T19:50:02.238509] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-29T19:50:02.793597] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-29T19:50:03.008085] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-29T19:50:03.549228] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-29T19:50:03.593570] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-29T19:50:04.288468] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-29T19:50:04.393543] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-29T19:50:05.036541] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-29T19:50:05.193564] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-29T19:50:05.993569] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-29T19:50:06.793587] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-29T19:50:06.891057] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-29T19:50:07.278551] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-29T19:50:07.514033] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-29T19:50:07.593565] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-29T19:50:08.393635] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-29T19:50:08.887039] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-29T19:50:08.990339] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-29T19:50:09.193582] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-29T19:50:09.993561] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-29T19:50:10.216493] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-29T19:50:10.221619] [INFO ] [REMOTE ] MEC: Full fetch complete (23245 records). [2025-10-29T19:50:10.221785] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-29T19:50:10.603893] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-29T19:50:10.637238] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-29T19:50:10.637320] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-29T19:50:10.638034] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-29T19:50:10.638098] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-29T19:50:10.638777] [DEBUG] [LOCAL ] MEC: Trimmed 23245 records to 17023 (keeping 200 days of data) [2025-10-29T19:50:10.735334] [DEBUG] [LOCAL ] MEC: Primary data saved (17023 records). [2025-10-29T19:50:10.735493] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-29T19:50:10.735582] [INFO ] [MAIN ] Update Progress: 1321/2367 symbols completed. MEC took 18.5s. Estimated remaining: 2h 14m 43s. Rate: 7.8 symbols/min [2025-10-29T19:50:10.802601] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-29T19:50:10.918570] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:50:10.940498] [DEBUG] [LOCAL ] MED: Loaded 20631 existing records from primary storage. [2025-10-29T19:50:10.940799] [INFO ] [MAIN ] MED: Loaded 20631 existing records. [2025-10-29T19:50:11.123581] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:50:11.123851] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-29T19:50:11.123899] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-29T19:50:11.124167] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-29T19:50:11.124210] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-29T19:50:11.474274] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:50:11.593525] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-29T19:50:12.388006] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-29T19:50:12.398439] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-29T19:50:12.511264] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-29T19:50:13.193561] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-29T19:50:13.667673] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-29T19:50:13.993571] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-29T19:50:14.793561] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-29T19:50:14.836758] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-29T19:50:15.246539] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-29T19:50:15.593529] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-29T19:50:15.619316] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-29T19:50:16.393573] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-29T19:50:17.165534] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-29T19:50:17.193526] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-29T19:50:17.441163] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-29T19:50:17.993526] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-29T19:50:18.048702] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-29T19:50:18.793592] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-29T19:50:19.384507] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-29T19:50:19.515476] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-29T19:50:19.593542] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-29T19:50:20.369234] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-29T19:50:20.393572] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-29T19:50:21.193547] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-29T19:50:21.221035] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-29T19:50:21.993605] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-29T19:50:22.789968] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-29T19:50:22.794944] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-29T19:50:22.883959] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-29T19:50:22.895140] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-29T19:50:22.895275] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-29T19:50:23.283544] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-29T19:50:23.309630] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-29T19:50:23.310009] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-29T19:50:23.311053] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-29T19:50:23.311113] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-29T19:50:23.312409] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-29T19:50:23.597936] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-29T19:50:23.641341] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-29T19:50:23.641464] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-29T19:50:23.641541] [INFO ] [MAIN ] Update Progress: 1322/2367 symbols completed. MDT took 31.4s. Estimated remaining: 2h 14m 40s. Rate: 7.8 symbols/min [2025-10-29T19:50:23.823615] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:50:23.854622] [DEBUG] [LOCAL ] MEG: Loaded 31110 existing records from primary storage. [2025-10-29T19:50:23.854914] [INFO ] [MAIN ] MEG: Loaded 31110 existing records. [2025-10-29T19:50:24.031105] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:50:24.031297] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-29T19:50:24.031339] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-29T19:50:24.031805] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-29T19:50:24.031862] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-29T19:50:24.382063] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:50:24.393521] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-29T19:50:24.813629] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T19:50:25.193590] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-29T19:50:25.515601] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-29T19:50:25.658982] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-29T19:50:25.661341] [INFO ] [REMOTE ] MDV: Full fetch complete (11789 records). [2025-10-29T19:50:25.661417] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-29T19:50:25.998782] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-29T19:50:26.049899] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-29T19:50:26.050023] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-29T19:50:26.050694] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-29T19:50:26.050760] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-29T19:50:26.051386] [DEBUG] [LOCAL ] MDV: Trimmed 11789 records to 8265 (keeping 200 days of data) [2025-10-29T19:50:26.106839] [DEBUG] [LOCAL ] MDV: Primary data saved (8265 records). [2025-10-29T19:50:26.107056] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-29T19:50:26.107169] [INFO ] [MAIN ] Update Progress: 1323/2367 symbols completed. MDV took 33.8s. Estimated remaining: 2h 14m 28s. Rate: 7.8 symbols/min [2025-10-29T19:50:26.282131] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:50:26.305263] [DEBUG] [LOCAL ] MEGI: Loaded 19566 existing records from primary storage. [2025-10-29T19:50:26.305630] [INFO ] [MAIN ] MEGI: Loaded 19566 existing records. [2025-10-29T19:50:26.499757] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:50:26.500116] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-29T19:50:26.500176] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-29T19:50:26.500490] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-29T19:50:26.500568] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-29T19:50:26.798703] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-29T19:50:26.873674] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:50:26.889824] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-29T19:50:27.593611] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-29T19:50:27.804127] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-29T19:50:28.318462] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-29T19:50:28.393633] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-29T19:50:29.122738] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-29T19:50:29.193596] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-29T19:50:29.996178] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-29T19:50:30.001924] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-29T19:50:30.793576] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-29T19:50:31.247416] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-29T19:50:31.593635] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-29T19:50:31.933500] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-29T19:50:32.394199] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-29T19:50:32.394025] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-29T19:50:33.135593] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-29T19:50:33.193583] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-29T19:50:33.993576] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-29T19:50:34.258022] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-29T19:50:34.793712] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-29T19:50:34.881177] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-29T19:50:34.886022] [INFO ] [REMOTE ] MED: Full fetch complete (31655 records). [2025-10-29T19:50:34.886144] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-29T19:50:35.257569] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-29T19:50:35.257673] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-29T19:50:35.258369] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-29T19:50:35.258434] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-29T19:50:35.259216] [DEBUG] [LOCAL ] MED: Trimmed 31655 records to 20570 (keeping 200 days of data) [2025-10-29T19:50:35.378954] [DEBUG] [LOCAL ] MED: Primary data saved (20570 records). [2025-10-29T19:50:35.379158] [INFO ] [MAIN ] MED: Full history saved. [2025-10-29T19:50:35.379249] [INFO ] [MAIN ] Update Progress: 1324/2367 symbols completed. MED took 24.6s. Estimated remaining: 2h 14m 21s. Rate: 7.8 symbols/min [2025-10-29T19:50:35.567340] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:50:35.568943] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-29T19:50:35.600675] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-29T19:50:35.603312] [DEBUG] [LOCAL ] MEI: Loaded 30990 existing records from primary storage. [2025-10-29T19:50:35.603593] [INFO ] [MAIN ] MEI: Loaded 30990 existing records. [2025-10-29T19:50:35.787610] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:50:35.787882] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-29T19:50:35.787932] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-29T19:50:35.788359] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-29T19:50:35.788429] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-29T19:50:36.161027] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:50:36.330841] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T19:50:36.393544] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-29T19:50:37.193539] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-29T19:50:37.304008] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-29T19:50:37.993545] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-29T19:50:38.506827] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-29T19:50:38.793638] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-29T19:50:38.919889] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-29T19:50:39.593607] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-29T19:50:39.724710] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-29T19:50:40.327746] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-29T19:50:40.393602] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-29T19:50:41.193558] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-29T19:50:41.559386] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-29T19:50:41.993570] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-29T19:50:42.719015] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-29T19:50:42.730530] [INFO ] [REMOTE ] MDU: Full fetch complete (70752 records). [2025-10-29T19:50:42.730726] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-29T19:50:42.795004] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-29T19:50:42.932030] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-29T19:50:43.156177] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-29T19:50:43.156270] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-29T19:50:43.157286] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-29T19:50:43.157350] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-29T19:50:43.158723] [DEBUG] [LOCAL ] MDU: Trimmed 70752 records to 47929 (keeping 200 days of data) [2025-10-29T19:50:43.437616] [DEBUG] [LOCAL ] MDU: Primary data saved (47929 records). [2025-10-29T19:50:43.437764] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-29T19:50:43.437855] [INFO ] [MAIN ] Update Progress: 1325/2367 symbols completed. MDU took 51.2s. Estimated remaining: 2h 14m 14s. Rate: 7.8 symbols/min [2025-10-29T19:50:43.608142] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:50:43.605539] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-29T19:50:43.657407] [DEBUG] [LOCAL ] MET: Loaded 53277 existing records from primary storage. [2025-10-29T19:50:43.657741] [INFO ] [MAIN ] MET: Loaded 53277 existing records. [2025-10-29T19:50:43.845069] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:50:43.845442] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-29T19:50:43.845521] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-29T19:50:43.852166] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-29T19:50:43.862592] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-29T19:50:43.934327] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-29T19:50:44.227509] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:50:44.393553] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-29T19:50:44.630846] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-29T19:50:45.193539] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-29T19:50:45.226476] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-29T19:50:45.896812] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-29T19:50:45.993542] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-29T19:50:46.793715] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-29T19:50:46.819328] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-29T19:50:46.823960] [INFO ] [REMOTE ] MEGI: Full fetch complete (28923 records). [2025-10-29T19:50:46.824078] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-29T19:50:47.256283] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-29T19:50:47.256361] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-29T19:50:47.256958] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-29T19:50:47.257039] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-29T19:50:47.257742] [DEBUG] [LOCAL ] MEGI: Trimmed 28923 records to 19577 (keeping 200 days of data) [2025-10-29T19:50:47.372481] [DEBUG] [LOCAL ] MEGI: Primary data saved (19577 records). [2025-10-29T19:50:47.372611] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-29T19:50:47.372714] [INFO ] [MAIN ] Update Progress: 1326/2367 symbols completed. MEGI took 21.3s. Estimated remaining: 2h 14m 3s. Rate: 7.8 symbols/min [2025-10-29T19:50:47.539002] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:50:47.579578] [DEBUG] [LOCAL ] MFA: Loaded 45144 existing records from primary storage. [2025-10-29T19:50:47.579888] [INFO ] [MAIN ] MFA: Loaded 45144 existing records. [2025-10-29T19:50:47.600139] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-29T19:50:47.758428] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:50:47.758627] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-29T19:50:47.758708] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-29T19:50:47.759293] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-29T19:50:47.759349] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-29T19:50:48.111840] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:50:48.393550] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-29T19:50:48.670765] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-29T19:50:49.204081] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-29T19:50:49.206711] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-29T19:50:49.623016] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-29T19:50:49.936220] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-29T19:50:49.993521] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-29T19:50:50.793572] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-29T19:50:51.214004] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-29T19:50:51.593621] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-29T19:50:51.824697] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-29T19:50:52.393551] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-29T19:50:52.554206] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-29T19:50:53.193551] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-29T19:50:53.380527] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-29T19:50:53.993555] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-29T19:50:54.755238] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-29T19:50:54.793684] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-29T19:50:55.028450] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-29T19:50:55.593630] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-29T19:50:55.953182] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-29T19:50:56.393609] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-29T19:50:56.694972] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-29T19:50:56.702227] [INFO ] [REMOTE ] MEG: Full fetch complete (47020 records). [2025-10-29T19:50:56.702324] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-29T19:50:57.085603] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-29T19:50:57.085746] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-29T19:50:57.086585] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-29T19:50:57.086633] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-29T19:50:57.087761] [DEBUG] [LOCAL ] MEG: Trimmed 47020 records to 31038 (keeping 200 days of data) [2025-10-29T19:50:57.200729] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-29T19:50:57.278168] [DEBUG] [LOCAL ] MEG: Primary data saved (31038 records). [2025-10-29T19:50:57.278321] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-29T19:50:57.278406] [INFO ] [MAIN ] Update Progress: 1327/2367 symbols completed. MEG took 33.6s. Estimated remaining: 2h 13m 57s. Rate: 7.8 symbols/min [2025-10-29T19:50:57.474477] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:50:57.480722] [DEBUG] [LOCAL ] MFAN: Loaded 4177 existing records from primary storage. [2025-10-29T19:50:57.480910] [INFO ] [MAIN ] MFAN: Loaded 4177 existing records. [2025-10-29T19:50:57.661746] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:50:57.662429] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-29T19:50:57.662707] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-29T19:50:57.663326] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-29T19:50:57.663608] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-29T19:50:58.009246] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-29T19:50:58.063464] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-29T19:50:58.176159] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:50:58.720563] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-29T19:50:58.793559] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-29T19:50:59.350125] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-29T19:50:59.356501] [INFO ] [REMOTE ] MEI: Full fetch complete (45266 records). [2025-10-29T19:50:59.356621] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-29T19:50:59.601470] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-29T19:50:59.736823] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-29T19:50:59.736907] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-29T19:50:59.737678] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-29T19:50:59.737740] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-29T19:50:59.738801] [DEBUG] [LOCAL ] MEI: Trimmed 45266 records to 30894 (keeping 200 days of data) [2025-10-29T19:50:59.915229] [DEBUG] [LOCAL ] MEI: Primary data saved (30894 records). [2025-10-29T19:50:59.915366] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-29T19:50:59.915444] [INFO ] [MAIN ] Update Progress: 1328/2367 symbols completed. MEI took 24.5s. Estimated remaining: 2h 13m 45s. Rate: 7.8 symbols/min [2025-10-29T19:51:00.083172] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-21 to 2025-10-29. [2025-10-29T19:51:00.089152] [DEBUG] [LOCAL ] MFAO: Loaded 3740 existing records from primary storage. [2025-10-29T19:51:00.089332] [INFO ] [MAIN ] MFAO: Loaded 3740 existing records. [2025-10-29T19:51:00.161183] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-29T19:51:00.276815] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-11, but need from 2025-01-14 for 200 day retention. Performing full refresh. [2025-10-29T19:51:00.277136] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-29T19:51:00.277294] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-29T19:51:00.277434] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-29T19:51:00.277472] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-29T19:51:00.398724] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-29T19:51:00.670210] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-14 to 2025-10-29 (requires 10 months of data pull). [2025-10-29T19:51:00.700803] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-29T19:51:01.193561] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-29T19:51:01.908073] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-29T19:51:01.993636] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-29T19:51:02.431277] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-29T19:51:02.793571] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-29T19:51:02.979009] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-29T19:51:03.593556] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-29T19:51:04.129767] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-29T19:51:04.393537] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-29T19:51:04.806618] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-29T19:51:05.001059] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-29T19:51:05.193561] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-29T19:51:05.564242] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-29T19:51:05.993553] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-29T19:51:06.793562] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-29T19:51:07.091470] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-29T19:51:07.420097] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-29T19:51:07.593570] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-29T19:51:08.393616] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-29T19:51:08.789338] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-29T19:51:09.198772] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-29T19:51:09.213518] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-29T19:51:09.611005] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-29T19:51:09.993617] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-29T19:51:10.793553] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-29T19:51:11.389608] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-29T19:51:11.593548] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-29T19:51:12.339265] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-29T19:51:12.393523] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-29T19:51:13.193538] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-29T19:51:13.465001] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-29T19:51:13.541018] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-29T19:51:13.674779] [INFO ] [REMOTE ] MFA: Incremental fetch